25launches

Caramel-1

Open speech model that learned to talk from audio alone

0 followers

Visit github.com (opens in a new tab)

Artificial IntelligenceAudioOpen Source

Caramel-1 is an open-source, full-duplex speech-to-speech model trained only on recordings of people talking, never on text. It has 413M parameters and hears both sides of a conversation, deciding every 80 ms whether to speak, with no turn-taking rules. It learned from about 11,500 hours of public speech in roughly 4 GPU-hours. Runs on NVIDIA GPUs, Apple Silicon or CPU. Code, recipe and weights under Apache-2.0. The voices sound human, but most of what it says does not make sense yet.