PyTorch 2.5.0 Release, SDPA CuDNN backend, Flex Attention

Imported from official source

Software release

AI Classified by Officially

# PyTorch 2.5 Release Notes - Highlights - Backwards Incompatible Change - Deprecations - New Features - Improvements - Bug fixes - Performance - Documentation - Developers - Security ## Highlights We are excited to announce the release of PyTorch® 2.5! This release features a new CuDNN backend for SDPA, enabling speedups by default for users of SDPA on H100s or newer GPUs. As well, regional compilation of torch.compile offers a way to reduce the cold start up time for torch.compile by allowing users to compile a repeated nn.Module (e.g. a transformer layer in LLM) without recompilations. Finally, TorchInductor CPP backend offers solid performance speedup with numerous enhancements like FP16 support, CPP wrapper, AOT-Inductor mode, and max-autotune mode. This release is composed of 4095 commits from 504 contributors since PyTorch 2.4. We want to sincerely thank our dedicated community for your contributions. As always, we encourage you to try these out and report any issues as we improve 2.5. More information about how to get started with the PyTorch 2-series can be found at our [Getting Started](https://pytorch.org/get-started/pytorch-2.0/) page. As well, please check out our new ecosystem projects releases with [TorchRec](https://github.com/pytorch/torchrec) and [TorchFix](https://github.com/pytorch-labs/torchfix/releases/tag/v0.6.0).

This is an extract. The publication continues at the source.

Read the original at the source: https://github.com/pytorch/pytorch/releases/tag/v2.5.0

Officially imported this from PyTorch’s own source and shows an extract. If you work there, claiming the profile and verifying the domain lets you choose to show the full text here.

This publication has changed since it was first published

2 versions recorded. The original is kept in full — nothing is overwritten.

  1. v2 imported change on current
  2. v1 as first published on

Provenance

Organization
PyTorch — imported from official source
Official source
https://api.github.com/repos/pytorch/pytorch/releases?per_page=25 API
Imported
September 15, 2026 19:08
Versions
2 recorded
Identity
179392892

Officially records where a publication came from, not whether it is true. Imported records are reproduced from an organization's own official source.