Controllable generation
Target text, a natural-language style instruction, and reference audio are composed into expressive speech.
- Speaker and acoustic attributes
- Detailed speaking-style descriptions
- Role-playing scenarios
Bilingual speech intelligence
Cyclespeech brings controllable speech generation and structured speech understanding into one bilingual framework.
Paper, code, and model release details coming soon.
One model, two directions
Describe how a line should sound, then synthesize it with a reference voice. Or provide speech and recover a structured account of what was said and how it was delivered.
Target text, a natural-language style instruction, and reference audio are composed into expressive speech.
Speech is analyzed into a consistent voice-profile JSON object together with its transcript.
Audio showcase
Compare reference speech with outputs from Step-Audio-2-mini, Cyclespeech(SFT), and Cyclespeech(CycleGRPO) under identical inputs across all three instruction types. Headphones recommended.
Target text
gender: Male; age: young adult; timbre / pitch: baritone, smooth, resonant, polished, warm, velvety, breathy; speech rate: moderate, rhythmic; volume: normal; accent annotation: British, contemporary Southern English (Modern Received Pronunciation).
目标文本
男性,青壮年;中低音,浑厚磁性、细腻圆润;语速较快,音量适中;标准普通话。
Target text
Speak in a General American accent slowly, in a deep baritone register, with velvety and resonant timbre, at soft volume. Keep the tone vulnerable and tentative, with an emotionally presence, letting the delivery sound sensitive.
目标文本
展现出中高音声线与清脆、明亮、富有弹性、金属般清透的音色质感,表现出说话人强烈的自豪感和松弛感,并夹杂自信,展现出冷静、自信的性格特点,语音韵律节奏感强,语速中等偏快。
Target text
In a cozy bedroom or dressing room, a young woman in her late teens or early twenties stands before a mirror or phone camera, her eyes sparkling with mischief.
目标文本
在医院的走廊里,一名年轻女性紧握双手,声音颤抖地向医生诉说。
Application · Video dubbing
These examples pair Cyclespeech speech generation with video to illustrate a dubbing workflow. The model uses a reference voice, target text, and a style instruction.
Target line
In a car, an adult woman suddenly remembers a family keepsake while speaking to her husband. She reacts with an immediate, spontaneous burst of surprise, then asks the question at a brisk, lively conversational pace with minimal pauses.
目标台词
一位男性领导在进行正式讲话,语调沉稳有力,语速缓慢,旨在强调听众肩负的重要职责,整体情感庄重而富有号召力。
Structured listening
The understanding mode maps an input waveform to a stable voice-profile object. It captures the transcript alongside speaker, delivery, emotion, and scene attributes.
{
"gender": "...",
"age": "...",
"accent": "...",
"emotion": "...",
"emotion_detail": ["..."],
"personality": "...",
"scene": "...",
"speed": "...",
"volume": "...",
"texture": "...",
"txt": "full transcript"
}
Understanding examples
Each example pairs an unseen test utterance with Cyclespeech's structured analysis.
Transcript
Cyclespeech prediction
转写文本
Cyclespeech 预测
Transcript
Cyclespeech prediction
转写文本
Cyclespeech 预测
The cycle
Cyclespeech connects generation and understanding around a shared audio-language foundation, with task-specific adapters for each direction.
Explore the project
Explore bilingual generation and structured understanding examples.