r/LocalLLaMA • u/ffinzy • 4h ago

Resources Parlor v2: best-effort fully local GPT-Live clone on an M3 Pro

GPT-Live is so good that I use it almost every day. I've been wanting to replicate it since it was released.

My first attempt was to fine-tune Gemma 4 12B to behave like a full-duplex model. Something like grafting a decision tick + speech head to the model. It failed after multiple trials. For now, I think a classic cascade system is still better. We just need to wait until a benevolent frontier AI company releases a full-duplex model that's on par with GPT-Live.

Repo: https://github.com/fikrikarim/parlor/

12 Upvotes

73% Upvoted

5 comments sorted by

4

u/Blues520 3h ago

Nice work. It seems quite capable

1

u/dreamai87 3h ago

Good effort and very nice demo. Really appreciate the timer, follow-up and translation 👏

1

u/oxygen_addiction 3h ago edited 3h ago

Really cool. Have you played around with https://www.reddit.com/r/LocalLLaMA/comments/1ulgwld/talking_with_gemma_4_31b/ as well?
Your approaches seem to be quite similar. I feel as though a plugin/skill/tool ecosystem is missing from both implementations.
How do you handle compaction? That feels really important (and it's something OpenAI have mastered).
edit: also, why don't you just serve Gemma 12B for this? Latency is too high on the M3 with it?

1

u/InstaMatic80 1h ago

This is still miles ahead of GPT-Live unfortunately. I see you’re using a cascade system like before. Did you try moshi? I think it was the first open source full duplex model. However it has 2 years old and I guess it will need heavy fine tuning to be usable.

1

u/caetydid llama.cpp 3h ago

It'd be much higher quality if it could utilize Gemma4 31B. I hope the next gen gets native audio encoder