PyTorch AI Releases: PyTorch 2.13

ThursdAI — the weekly AI news podcast hosted by Alex Volkov — has covered one PyTorch release so far: PyTorch 2.13 on Jul 8, 2026. PyTorch 2.13 lands FlexAttention on Apple Silicon and big memory wins. The entry below has primary-source links, key numbers and the episode where we covered it live.

1 release1 open weight1 episodecovered Jul 8, 2026

July 2026 1

PyTorch
Dev ToolsOpen weights

PyTorch 2.13

PyTorch 2.13 lands FlexAttention on Apple Silicon and big memory wins

3,328 commits from 526 contributors: FlexAttention on Apple Silicon at roughly 12x over SDPA for sparse patterns, a deterministic CUDA backward path, nn.LinearCrossEntropyLoss with up to 4x peak-memory reduction, torchcomms for large-cluster training, and expanded ROCm/Arm/XPU support.

~12x FlexAttention on Apple Silicon vs SDPA3,328 Commits from 526 contributors
X announcement ↗
🎙️ Hear our coverage →
#open-source#training#infrastructure