Agents are jobs, not services
A resident agent idling at 2GB of RAM is nothing, expensively. Most of the agent work people...
#local-llm
2 posts tagged with local-llm
Lessons from building an agent harness for local models
The loop, the context juggling, the per-model prompt formatting, the tool calls. Here is what...