← sources

huggingface/transformers v5.20.1: Release v5.20.1

source: github (github:huggingface/transformers)published 2026-10-16 13:02ingested 2026-10-18 02:34

retained text

# Release v5.20.1

Special surprise including the new model Beam from Reflection AI :partying_face: 

<img width="2912" height="1440" alt="Gemini_Generated_Image_ox4hjlox4hjlox4h" src="https://github.com/user-attachments/assets/bfc7ff16-4340-490c-925c-b1512e4ceb32" />

Beam is a token-efficient, frontier-scale model focused on coding and agentic use cases. It is built for teams that want to run a powerful model on their own hardware, infrastructure, or cloud, and customize it to their specific needs.

**Links:** [Documentation](https://huggingface.co/docs/transformers/main/en/model_doc/beam)
* Fix small bug in auto mappings (#49664) by @yonigozlan in [#49664](https://github.com/huggingface/transformers/pull/49664)


## Some real patch fixes

We broke loading models on older torch versions :cry: should be fixed now. But here is the full list of fixes

- Fix HunYuan-VL image assignment during batched generation (#49557) by @Arnav66692
- Fix DeepGEMM Mega MoE under expert parallelism(#49428) by @IlyasMoutawwakil
- Fix from_pretrained on torch 2.7: require torch>=2.8 for distributed checkpointing (#49652) by @naveecode 
- Make DtensorShardOperation work on torch 2.6 and 2.7 (#49657) by @hazelxue

**Full Changelog**: https://github.com/huggingface/transformers/compare/v5.20.0...v5.20.1

document fetched 2026-10-23 02:35