KazParaD: Paralinguistic and Non-Verbal Vocalization Corpus
for Kazakh Speech Synthesis

Submitted to IEEE ICASSP 2027

Dataset and model repositories are access-controlled while the paper is under review. All audio on this page is freely playable and requires no account.

Abstract

Prompt-based controllable text-to-speech (TTS) has recently become an effective approach for voice styling. Extending these methods to low-resource languages is limited by data scarcity, and the systematic integration of paralinguistic attributes and non-verbal vocalizations (NVVs) has not been explored. We introduce KazParaD, a Kazakh speech corpus of over eighty hours with controlled-vocabulary style annotations, combining in-the-wild recordings validated by native speakers with a synthetic subset covering 18 NVV categories. On this resource we build KazGenericTTS, a prompt-controllable system with a discrete, non-autoregressive architecture initialized from a large language model (LLM), whose unified token space treats NVV tags as decoding targets and thus avoids multi-stage style encoders. We evaluate it with subjective listening tests and objective probes validated against Kazakh human labels. The model outperforms zero-shot multilingual baselines in NVV realization and speaker gender control, and in-language adaptation reduces recognition error below that of the noisy ground-truth recordings while maintaining multi-attribute control.

Paralinguistic control

Prompt-based speech generation with different styles, the same Kazakh sentence is used for different styles. Only the parameter specified in each line changes, while the text remains constant.

Бүгін ауа райы өте жақсы екен.
The weather is very nice today.

Gender

PromptAudio
male, young adult, moderate pitch, neutral
female, young adult, moderate pitch, neutral

Age

PromptAudio
female, child, moderate pitch, neutral
female, teenager, moderate pitch, neutral
female, young adult, moderate pitch, neutral
female, middle-aged, moderate pitch, neutral
female, elderly, moderate pitch, neutral

Pitch

PromptAudio
female, young adult, very low pitch, neutral
female, young adult, low pitch, neutral
female, young adult, moderate pitch, neutral
female, young adult, high pitch, neutral
female, young adult, very high pitch, neutral

Emotion

PromptAudio
female, young adult, moderate pitch, neutral
female, young adult, moderate pitch, happy
female, young adult, moderate pitch, sad
female, young adult, moderate pitch, angry
female, young adult, moderate pitch, surprised
female, young adult, moderate pitch, disgusted
female, young adult, moderate pitch, fearful

Non-verbal vocalizations (NVVs)

All 18 NVV categories, each requested with an inline tag placed at a specific position in the transcript. The tag appears in the text exactly as shown.

TextAudio
Мен бүгін цирктегі сайқымазақты көріп [laugh] қатты күлдім.
Today I saw the clown at the circus and [laugh] laughed a lot.
Мына жаңалықты оқып отырып, [chuckle] еріксіз езу тарттым.
Reading this news, [chuckle] I couldn't help but smile.
Бүгін мектептегі сабақтар [sigh] өте көп әрі қиын болды.
Today's lessons at school were [sigh] long and difficult.
Мынадай сұмдық жаңалықты [gasp] мен бірінші рет естіп тұрмын!
Such shocking news [gasp] I'm hearing it for the first time!
Ішім қатты ауырып тұр, [groan] мектепке барғым келмейді.
My stomach hurts badly, [groan] I don't want to go to school.
Тамағым жыбырлап, [cough] суық тигізіп алған сияқтымын, дәрі ішу керек.
My throat is scratchy, [cough] I think I've caught a cold, I need to take medicine.
Мұрнымнан су ағып, [sniffle] басым қатты ауырып тұр.
My nose is running, [sniffle] and my head hurts badly.
Кеше түнге дейін есеп беріп, [yawn] өте кеш ұйықтадым.
I worked on the report until late last night, [yawn] and went to sleep very late.
Апай естіп қоймасын, [whispers] маған қаламыңды бере тұршы.
Don't let the teacher hear [whispers] lend me your pen for a moment.
Осы бөлшекті орнына бекітсек, [singing] бәрі дайын болады.
Once we fasten this part in place, [singing] everything will be ready.
Мен бүгін сабаққа [stutters] мүлдем дайындалмай келіп едім.
I came to class today [stutters] completely unprepared.
Газдалған сусынды көп ішіп қойсам керек, [burps] ғафу етіңіздер.
I must have drunk too much soda, [burps] excuse me.
Мен тамақты өте тез жеп қойған [hiccups] сияқтымын.
I think I ate my food [hiccups] too quickly.
Бұл еттің пісуі [chewing] өте жақсы екен, жұмсақ болыпты.
This meat is cooked [chewing] very well, it turned out tender.
Анашымның пісірген бәлішінің иісі [smacks lips] мұрнымды жарып барады.
The smell of my mother's pie [smacks lips] is irresistible.
Бұл жобаны бастамас бұрын, [swallows] барлық құжаттарды тексеріп шығу қажет.
Before we start this project, [swallows] we need to check all the documents.
Қап, [tsking] мен тағы да дәптерімді үйде ұмытып кетіппін ғой.
Oh no, [tsking] I've forgotten my notebook at home again.
Бұл шешімді қабылдауға [long pause] бізді көптеген себептер итермеледі.
Many reasons pushed us [long pause] to make this decision.

Results

Synthesis quality

SystemCERWERMOS
OmniVoice (zero-shot)4.112.2–
Ground truth (real)8.319.54.51 ± 0.21
KazGenericTTS2.4 9.33.04 ± 0.37

Paralinguistic attribute controllability

AttributeMetricResult
GenderObjective accuracy (%)99.3
GenderHuman accuracy (%), synth / real92.9 / 86.5
EmotionHuman accuracy (%), 7-class, synth / real33.8 / 39.9
AgeHuman accuracy (%), 4-class, synth / real29.2 / 44.2
PitchRequested vs. F0 (CREPE), M / F0.94 / 0.82

NVVs

Paired tagged-versus-control AUC rises from 0.55 for the zero-shot base model, near the chance level of 0.5, to 0.86 after adaptation. In a blind identification study, four native-speaker moderators produced 720 judgments over 18 tags: per-tag accuracy is 58.1%, and identification at the level of perceptual acoustic groups reaches 80.7%.

Comparison

Identical text and identical style prompt, rendered by the unadapted multilingual base model, by KazGenericTTS after full fine-tuning, and by the LoRA variant.

Text and prompt Base (zero-shot) LoRA variant KazGenericTTS
Оның айтқан әзілі маған қатты ұнады [laugh]
I really liked the joke they told. [laugh]
malemiddle-agedlow pitchneutral
Жылдар қалай тез өтіп кеткенін байқамай қалдым [sigh]
I didn't notice how quickly the years went by. [sigh]
femaleelderlylow pitchsad
Ертең біз бәріміз бірге саябаққа барамыз.
Tomorrow we are all going to the park together.
femaleyoung adulthigh pitchhappy

Citation

The paper is under review. A citation will be added here once it is published.

@unpublished{kazparad,
  title  = {KazParaD: Paralinguistic and Non-Verbal Vocalization Corpus for
            Kazakh Speech Synthesis},
  year   = {2026},
  note   = {Under review at IEEE ICASSP 2027}
}