Incept5 AI Releases: inferd

incept5.ai ↗

ThursdAI — the weekly AI news podcast hosted by Alex Volkov — has covered one Incept5 release so far: inferd on Nov 5, 2026. John Davies launches inferd, an open source Mac inference engine for 64 to 128 concurrent agents. The entry below has primary-source links, key numbers and the episode where we covered it live.

1 release1 open weight1 episodecovered Nov 5, 2026

November 2026 1

Incept5
Dev ToolsOpen weights

inferd

John Davies launches inferd, an open source Mac inference engine for 64 to 128 concurrent agents

Launched live on ThursdAI by Incept5 CTO John Davies: an Apache 2.0 inference engine for Macs (laptops too) built for many agents at once. It went from 64 concurrent agents to 128 on the day of the show, and on a 32 GB Mac Mini it runs Qwen 3.8 27B with a DFlash 2 drafter at up to 16 agents. In John's chart, other engines flatline around 400 tokens per second at 16 agents while inferd keeps climbing past 1,000 tokens per second in total.

128 concurrent agentsApache 2.0 license
inferd (site) ↗inferd (GitHub) ↗
🎙️ Hear our coverage →
#open-source#on-device#infrastructure