S1-Omni: A Unified Multimodal Reasoning Model for Scientific Understanding, Prediction, and Generation
Abstract
We present S1-Omni, a unified multimodal reasoning model for scientific understanding, prediction, and generation. AI for Science (AI4S) has advanced significantly through domain-specific models, tool-augmented LLMs, and scientific language models. However, model capabilities remain highly fragmented, limiting the joint modeling of heterogeneous data, scientific laws, and expert knowledge. S1-Omni addresses this gap by consolidating these capabilities into a single, coherent scientific reasoning model. The architecture of S1-Omni is built upon three core components: unified representation of scientific data, natural-world knowledge alignment, and decoding for domain-specific tasks. First, S1-Omni maps natural-language instructions and scientific objects, including CIF, SMILES, protein sequences, spectra, and scientific images, into a shared representation space. Second, it incorporates scientific laws and expert knowledge into data construction and training, enabling the model to reason from scientific evidence. Third, it performs task-specific decoding to support a broad range of applications, including property prediction, spectrum-to-molecular generation, protein site and structure prediction, and scientific image generation and editing. S1-Omni is trained on S1-Omni-Corpus, which covers 200 scientific tasks and contains millions of reasoning samples, and is evaluated on over 60 scientific benchmarks. It outperforms GPT-5.5 and Gemini-3.1-Pro on most benchmarks and matches or surpasses domain-specific models on several benchmarks. Overall, S1-Omni provides a practical path toward unified scientific modeling.
Community
We’re excited to share S1-Omni, a unified multimodal reasoning model for scientific understanding, prediction, and generation.
S1-Omni brings heterogeneous scientific inputs—including text, material CIFs, molecular SMILES, protein sequences, spectra, and scientific images—into a shared reasoning framework, while using specialized decoders to produce verifiable, domain-native outputs.
Highlights:
- One unified model spanning 200+ scientific tasks across nine disciplines
- Evaluated on more than 60 scientific benchmarks
- Supports property prediction, spectrum-to-structure reconstruction, protein analysis and structure prediction, and scientific image generation/editing
- Open model weights, inference code, and a 10K-sample subset of the S1-Omni-Corpus
🔗 Project page
🤗 Model weights
🤗 Dataset
💻 Code
We welcome feedback, questions, and discussions from the AI4Science community!
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- S1-Omni-Image: A Unified Model for Scientific Image Understanding, Generation, and Editing (2026)
- Imaginative Perception Tokens Enhance Spatial Reasoning in Multimodal Language Models (2026)
- World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications (2026)
- Vision as Unified Multimodal Generation (2026)
- BrainJanus: A Unified Model for Understanding and Generation across Brain, Vision, and Language (2026)
- iFLYTEK-Embodied-Omni Technical Report (2026)
- RS-Gen: A Multi-Stage Agentic Framework for Reasoning and Search-Augmented Image Generation (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2607.15686 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 1
Datasets citing this paper 1
ScienceOne-AI/S1-Omni-Corpus-10K
Spaces citing this paper 0
No Space linking this paper