a_gentle_whisper.safetensors

349 MB · SafeTensor

Requires membership

<soft-whisper-ltx23>

LTX-2.3 Whisper & Soft-Spoken Audio LoRA Base model: LTX-2.3 · Type: Audio-style LoRA · Rank: 32 --- ## What this does LTX-2.3 can generate dialogue, multi-speaker scenes, and full dynamic range audio including screaming — but it cannot whisper. This LoRA adds two quiet vocal registers to the model: - Whispering — devoiced, breathy, close-mic delivery - Soft-spoken — voiced but low-volume, intimate, relaxed The LoRA targets only the three attention modules that write to the audio branch audio_attn1, audio_attn2, video_to_audio_attn). Video output is provably unchanged — no visual fighting, no style drift. --- ## Usage Load at strength 1.0. The register is controlled entirely by the manner keyword in your prompt — no special strength tuning needed. ### Trigger words (none, use natural language) | Whispering | (woman, whispering) | (man, whispering quietly) | | Soft-spoken | (woman, speaking softly) | (man, speaking softly) | > Note: Male whisper may requires the extra word quietly to tip the model over. (man, whispering) alone produces soft-spoken, not true whisper. ### Prompt format Follow the LTX-2.3 dialogue caption style: ``` a [scene description], ([gender], [manner]): "[what they say]", intimate ASMR ``` Examples: ``` a woman sitting close to a microphone in warm dim lighting, (woman, whispering): "close your eyes and listen" a man at a desk late at night, (man, speaking softly): "I've been thinking about this all day" a woman doing a skincare routine, (woman, whispering quietly): "this is my favourite step" ``` ### Without manner keywords Using the LoRA without any manner keyword defaults to soft-spoken — a subtle volume-softening effect on whatever the base model would have generated. Useful as a gentle "quieter audio" modifier. --- ## What it can't do - No intra-clip register mixing. You can't have one character whisper and another speak normally in the same clip. The register applies to the whole generation. For mixed-register dialogue, generate each part separately and cut them together. - No magic above the vocoder ceiling. The audio chain passes through a mel spectrogram bottleneck. Breathy whisper HF energy gets partially smoothed. Expect intimate and quiet, not studio-crisp ASMR. - Video is untouched by design. If you want the visuals to also feel ASMR (soft lighting, close-up framing), describe that in the scene prompt — the LoRA won't help or hurt. --- ## Training details | | | |---|---| | Base model | LTX-2.3 dev | | Steps | 2000 | | Rank / Alpha | 32 / 32 | | Target modules | audio_attn1, audio_attn2, video_to_audio_attn | | Training resolution | 192×192, 97 frames (~4s @ 24fps) | | Dataset | 74 clips, 8 voices (4F / 4M), 2 registers each | Clips were 4-second segments sourced from ASMR content across 8 speakers — 4 female (2 soft-spoken, 2 whisper) and 4 male (2 soft-spoken, 2 whisper). Captions used Whisper ASR transcription in (gender, manner): "transcript", intimate ASMR format.

SHA256

DBBDC78B8B6EF0405FE237B21ED6BB61EEE0621665C267EA890EBB7784D5CECA

ModelTrends.ai Model ID

#24136

Seed

914554288

Size

768x1152

Weight used

1

Size

448x640

Seed

1445100364

Size

768x1152

Weight used

0.45

Seed

125903531

Size

768x1152

Weight used

0.1

Size

448x640