Testing Small Local LLMs on Modest Hardware: A Portable Workflow
A repeatable way to download, serve, benchmark, and choose small GGUF models for Hermes and coding-agent work across different CPU and memory budgets.
Tag: local-llm
Local Gemma with Hermes: Cheap Delegation for Rails Maintenance
A practical guide to using Hermes Agent with a local Gemma model for routine coding work, while reserving cloud models for tasks that genuinely need them.
Tightening Hermes Agent Security for Local Sensitive Work
How I tightened my Hermes agent setup after adding a local model for PII and credential-sensitive work: tool limits, manual approvals, and a quiet watchdog.
Tiny Puzzles for Testing and Debugging AI Agents
Small probe tasks for testing local AI agents: function calling, skill awareness, prompt-length pressure, cache behavior, and layer-by-layer debugging.
LM Studio Local Agent Runbook: Pi and OpenCode Step by Step
A step-by-step runbook for wiring LM Studio as a local OpenAI-compatible backend for Pi agents and OpenCode, with config examples and troubleshooting.
Using LM Studio and Gemma as a Local Engine for Coding Agents
Using LM Studio and Gemma as a local OpenAI-compatible backend for coding agents: what broke, which settings mattered, and where it still falls short.
Building a Local Coding Agent (Codex/Claude Code Style) in Gemma
Building a local coding agent around Gemma 4 26B taught me the model wasn't the problem: my agent loop was, and fixing the loop is what made it work.
A Local, Multi-Tenant Graph RAG System with LightRAG
How a local Ollama and LightRAG stack turns Graph RAG into a cheap, multi-tenant retrieval layer that only sends precise context to cloud models.