inference-harness

T

Abiba a3bca93d9b fix: buffer SSE chunks for large streaming responses

Mumuni 23K-token responses split the final SSE timings chunk
across HTTP frames. The old per-chunk check missed timings when
split. Now accumulates lines in a buffer before parsing.

Also fixed: store_perf_record accidentally dropped in prior edit.

2026-05-29 09:45:41 +00:00

dashboard

fix: default performance window to 24h so all models appear immediately

2026-05-26 12:37:52 +00:00

nginx

feat: per-request performance tracking + /metrics/performance endpoint

2026-05-25 16:50:45 +00:00

router

fix: buffer SSE chunks for large streaming responses

2026-05-29 09:45:41 +00:00

.gitignore

May 19, 2026: Full harness update

2026-05-19 15:03:47 +00:00

docker-compose.yml

fix: non-blocking GPU health checks + 256K turboquant context upgrade

2026-05-23 05:57:13 +00:00

docker-compose.yml.bak

May 19, 2026: Full harness update

2026-05-19 15:03:47 +00:00

litellm_config.yaml

May 19, 2026: Full harness update

2026-05-19 15:03:47 +00:00

maintenance.sh

May 19, 2026: Full harness update

2026-05-19 15:03:47 +00:00