Agents Are Jobs, Not Services
A resident agent idling at 2GB of RAM is nothing, expensively. Most of the agent work people...
#local-llm
2 posts tagged with local-llm
Lessons from Building an Agent Harness for Local Models
The loop, the context juggling, the per-model prompt formatting, the tool calls. Here is what...