SyslogSolution/prose-contracts
7
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: swap gpu-dense to SmartCode-Fable-5 (ThinkingCap + Fable 5 CoT) #33

Merged
mumuni-bot merged 1 commits from fix/gpu-dense-smartcode-fable5 into master 2026-07-27 16:43:48 +00:00
Conversation 0 Commits 1 Files Changed 2
+14 -12
mumuni-bot commented 2026-07-27 16:43:38 +00:00
Owner
Copy Link
Copy Source

gpu-dense on RTX 3090 swapped from qwen3.6-27B-code to SmartCode-Fable-5-CoT-Reasoning-QKVO-Qwen-3.6-27B-Distilled (UD-Q4_K_XL, ~17.9GB).

Improvements:

  • ~50% fewer thinking tokens via ThinkingCap finetune
  • Fable 5 CoT distillation for improved coding reasoning
  • Same 27B base, fits RTX 3090 at ~73% VRAM
  • Recommended samplers: temp 0.9, top-p 0.95, top-k 60
  • Context: 128K (fleet standard)
gpu-dense on RTX 3090 swapped from qwen3.6-27B-code to SmartCode-Fable-5-CoT-Reasoning-QKVO-Qwen-3.6-27B-Distilled (UD-Q4_K_XL, ~17.9GB). Improvements: - ~50% fewer thinking tokens via ThinkingCap finetune - Fable 5 CoT distillation for improved coding reasoning - Same 27B base, fits RTX 3090 at ~73% VRAM - Recommended samplers: temp 0.9, top-p 0.95, top-k 60 - Context: 128K (fleet standard)
mumuni-bot added 1 commit 2026-07-27 16:43:39 +00:00
fix: swap gpu-dense to SmartCode-Fable-5 (ThinkingCap + Fable 5 CoT)
PR Pipeline — Authorize → Validate → Review → Merge / auth (pull_request) Successful in 6s
Details
PR Pipeline — Authorize → Validate → Review → Merge / validate (pull_request) Successful in 3s
Details
PR Pipeline — Authorize → Validate → Review → Merge / lint (pull_request) Successful in 3s
Details
PR Pipeline — Authorize → Validate → Review → Merge / ai-review (pull_request) Successful in 4s
Details
PR Pipeline — Authorize → Validate → Review → Merge / gate (pull_request) Successful in 0s
Details
179529de71 
gpu-dense on RTX 3090 swapped from qwen3.6-27B-code to SmartCode-Fable-5-CoT-Reasoning-QKVO-Qwen-3.6-27B-Distilled (UD-Q4_K_XL, ~17.9GB).\n\nImprovements:\n- ~50% fewer thinking tokens via ThinkingCap finetune\n- Fable 5 CoT distillation for improved coding reasoning\n- Same 27B base, fits RTX 3090 at ~73% VRAM\n- Recommended samplers: temp 0.9, top-p 0.95, top-k 60\n- Context: 128K (fleet standard)
mumuni-bot merged commit 29e32340a4 into master 2026-07-27 16:43:48 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
No items
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
abiba-bot jerome (Jerome Kwame Tabiri) kagentz-bot kwame (Kwame Tabiri) mumuni-bot (Mumuni 🦅 (Syslog Falcon)) tanko-bot theo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: SyslogSolution/prose-contracts#33