TECHThe Smallest Agent That Works, Part 3: The Three Agents With StateTECHThe Smallest Agent That Works, Part 2: The Three Reach-Out AgentsTECHThe Smallest Agent That Works, Part 1: The Three Cheap AgentsTECHWhat MLX Got to Throw Away (That PyTorch Can't)TECHThe Unified-Memory Bet: Why On-Device Inference Stopped Being a ToyTECHEvery Useful Skill Is One of Five ShapesTECHMCP Gives You the Kitchen. Skills Are the Recipe.TECHThe Three-Level Skill, and Why Yours Is Probably One Level Too ManyTECHThe Smallest Agent That Works, Part 3: The Three Agents With StateTECHThe Smallest Agent That Works, Part 2: The Three Reach-Out AgentsTECHThe Smallest Agent That Works, Part 1: The Three Cheap AgentsTECHWhat MLX Got to Throw Away (That PyTorch Can't)TECHThe Unified-Memory Bet: Why On-Device Inference Stopped Being a ToyTECHEvery Useful Skill Is One of Five ShapesTECHMCP Gives You the Kitchen. Skills Are the Recipe.TECHThe Three-Level Skill, and Why Yours Is Probably One Level Too Many
AI × Forward
Subscribe
// tag

#Apple Silicon

2 posts · page 1/1

Tech· 2026-05-15· 5min

What MLX Got to Throw Away (That PyTorch Can't)

Every mature framework is a museum of decisions you can't take back. MLX is interesting mostly because it started after the decisions that matter for Apple Silicon were already mistakes — and the things it threw away are the things that were quietly costing the rest of us the most.

#ai-engineering#apple-silicon#mlx#ml-frameworks
Tech· 2026-05-15· 5min

The Unified-Memory Bet: Why On-Device Inference Stopped Being a Toy

For two years the industry's default answer to every inference question has been "bigger cluster." A different hardware topology is quietly making that the wrong default for a non-trivial slice of workloads — and the framework layer that earns it is the buzzword most decks haven't caught up with yet.

#hardware#ai-infrastructure#inference#edge-ai