abiba-bot/inference-harness
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
b7882b2434f2d558acf3fc3906772920089fa3aa
inference-harness/router
T
History
Abiba b7882b2434 fix: reduce 27B Dense context to 192K to free VRAM 
RTX 3090 was at 94.9% VRAM at 262K context. Reduced to 192K (196608),
freeing ~2.4GB. VRAM now at 85% with room for active inference.
2026-05-25 00:31:40 +00:00
..
Dockerfile
May 19, 2026: Full harness update
2026-05-19 15:03:47 +00:00
http_patch.py
May 19, 2026: Full harness update
2026-05-19 15:03:47 +00:00
requirements.txt
May 19, 2026: Full harness update
2026-05-19 15:03:47 +00:00
router.py
fix: reduce 27B Dense context to 192K to free VRAM
2026-05-25 00:31:40 +00:00
router.py.bak.20260518074236
May 19, 2026: Full harness update
2026-05-19 15:03:47 +00:00
ts_patch.py
May 19, 2026: Full harness update
2026-05-19 15:03:47 +00:00