Enhance FireRedTTS3 with streaming, batching, and server integration - #439

Closed

duj12 wants to merge 12 commits into

0xShug0:mainfrom

Commits on Aug 31, 2026

Add FireRedTTS3 audiocpp_server config (firered-base, offline clone)

dujing
and
claude
committed
7e4bcbe

Commits on Sep 1, 2026

Add incremental streaming to FireRedTTS3 Base (offline + streaming dual mode)

dujing
and
claude
committed
254e1ee
Add per-member position/mask/cache-slot to batched decode (P2a-1)

dujing
and
claude
committed
8c8d608
Add batch passthroughs + per-slot RedAE decode state (P2a-2, P2a-3)

dujing
and
claude
committed
bb001c4
Add shared batch scheduler + server integration for FireRedTTS3 (P2a-4, P2a-5)

dujing
and
claude
committed
30d9a37
Fix streaming regression: yield scheduler lock after chunk output for true incremental streaming

dujing
and
claude
committed
6354b39

Commits on Sep 2, 2026

fix(firered): 流式末句 2× 时长 + 批处理空行冻结/双输出修复

dujing
and
claude
committed
1ced5f0
fix(firered): 共享 scheduler 并发 double-free 崩溃（epoch 句柄 + owner 延迟归还）

dujing
and
claude
committed
acc3b67

Commits on Sep 3, 2026

fix(firered): 共享 scheduler 加载竞态 + 每 model 共享单一 CUDA context

dujing
and
claude
committed
0490201

Commits on Sep 4, 2026

fix(firered): 重写共享 scheduler 为 round 制真并发 + runtime active_mask 行隔离

dujing
and
claude
committed
e3a406f
fix(server): 并发请求全部绑 session 0 的串音/double-free 根因

dujing
and
claude
committed
5eced4e
perf(firered): flow 跨 slot batch + round 开轮收集窗口

dujing
and
claude
committed
bff5f39