Galactica vs ggml.ai

Five open-weight checkpoints from 125M to 120B parameters give researchers a science-trained language model built from 106 billion curated tokens across 48 million papers, textbooks, encyclopedias, and knowledge bases. Galactica stores, combines, and reasons across modalities including LaTeX, Python code, SMILES formulas, and amino acid sequences inside one decoder-only Transformer architecture. Meta's Papers with Code team open sourced the weights for researchers who want to study how language models organize scientific knowledge.

General-purpose LLMs train on broad web crawls where social chatter can dominate the token budget. Galactica used only curated open-access science sources, which the paper argues lets it train for multiple epochs without overfitting. Meta removed the public web demo three days after launch in November 2022 when critics showed confident but fabricated citations and equations, so today you download checkpoints from Hugging Face rather than chat through a hosted interface.

Machine learning researchers can reproduce benchmark numbers from the arXiv paper, including 77.6% on PubMedQA and 52.9% on MedMCQA dev. Computational biologists and chemists can test protein annotation and molecule tasks through Galactica's specialized tokens for amino sequences and SMILES strings. Graduate students exploring scientific QA, citation prediction, or math word problems can experiment with sizes up to 120 billion parameters without training from scratch.

ggml runs large language and speech models on everyday CPUs and GPUs through a compact C tensor library built for on-device inference. ML engineers and app developers adopt it via llama.cpp and whisper.cpp when they want LLaMA or Whisper workloads without cloud-only dependencies.

Frameworks like PyTorch optimize for training clusters and heavy runtimes. ggml keeps the core library minimal with zero runtime memory allocations, no third-party dependencies, and integer quantization so llama.cpp can serve Meta LLaMA weights on laptops and Apple Silicon.

The ggml.ai company was founded in 2023 by Georgi Gerganov to support the library and was acquired by Hugging Face in 2026. The core ggml project stays MIT licensed with open development on GitHub.