How-To Guides
6 articles
Achieve 3,000 tokens/sec LLM inference on consumer GPUs
New optimization techniques enable real-time large language model inference on standard GPUs, reaching 3,000 tokens per second throughput. A technical deep-dive into performance improvements for consumer-grade hardware.
Using AI to Write Better Code More Slowly
A developer explores how AI coding assistants can improve code quality when used thoughtfully, even if they slow down the writing process initially.
Forge Boosts Local Model Agentic Task Accuracy to 99%
Forge is an open-source reliability layer that adds guardrails to self-hosted LLM tool-calling, improving an 8B model's performance from 53% to 99% on agentic tasks through retry logic, error recovery, and context management.
EvanFlow: TDD Feedback Loop for Claude Code
Open-source tool EvanFlow creates a test-driven development feedback loop optimized for Claude Code, helping developers improve code quality and accelerate iteration cycles.
CodeBurn: Monitor Claude Code Token Spending by Task
New open-source tool gives developers granular visibility into token consumption across Claude Code agents, solving cost tracking problems for teams spending $1400+ weekly on AI-powered coding.
Run Gemma 4 Locally with LM Studio's New CLI
LM Studio's headless CLI now exposes Gemma 4 as an OpenAI-compatible API endpoint, letting you build a local coding agent with zero cloud costs and complete data privacy. Setup takes 10-20 minutes.