Ai2 expands collaboration with Hugging Face to accelerate open science

Ai2 and Hugging Face are expanding their partnership to make fully open AI easier to access and deploy. Hugging Face serves as a central platform for the AI community, and the expanded collaboration gives us substantially more storage and bandwidth to support our growing portfolio of models, datasets, benchmarks, and applications.

Beginning immediately, Hugging Face is roughly tripling our storage on the Hub to nearly two petabytes. Our traffic will also no longer be subject to the Hub’s standard rate limits, allowing even its largest datasets and multi-checkpoint models to download at full throughput. Since spring 2024, our models and datasets have been downloaded more than 50 million times from the Hugging Face Hub.

The added capacity reflects the scale of our presence on the Hub—according to Hugging Face’s official heatmap, we publish more new artifacts annually than any other organization it tracks.

Releasing model weights is only one part of open research. We also publish training data, intermediate checkpoints, data mixes, evaluations, ablations, demos, and other materials that let researchers reproduce our work and examine how our models were built. The expanded infrastructure will help keep those resources available as our portfolio grows, including forthcoming work on multimodal models, tool-using agents, and open models for scientific communities.

"Ai2 has been showing us what 'fully open' looks like, sharing everything end-to-end from training scripts to intermediate datasets behind impactful models like Olmo and Molmo,” says Clem Delangue, Co-Founder and CEO, Hugging Face. “We are proud to be the infra behind Ai2 to enable their impactful work that varies from MolmoAct VLAs for real robots to OlmoEarth tackling climate and many more: 900+ models, 1,200+ datasets at huge scale."