Pythia vs Terracotta

Researchers studying transformer training need checkpoints taken throughout pretraining, not just a finished weight file. Pythia delivers that by training matched LLM families on public data in a fixed order, then releasing weights, checkpoints, training code, and dataloader tools so you can inspect behavior at specific steps.

Where most LLM releases ship one finished checkpoint, Pythia publishes 154 snapshots per model and keeps data order constant across sizes. That control makes it useful for memorization studies, scaling comparisons, and causal training interventions, but it is not aimed at plug-and-play chat deployment the way instruction-tuned assistants are.

The suite targets machine learning researchers, interpretability labs, and alignment teams who need reproducible training trajectories. Typical work includes comparing checkpoints for memorization, testing how term frequency affects few-shot scores, and reproducing published case studies from the repository.

Terracotta is an Infrastructure as Code governance tool that audits every pull request before merge, checking Terraform and OpenTofu changes against live cloud resources, remote state, and your team's governance policies. It installs as a GitHub or GitLab app, posts findings in the PR thread, and builds a tamper-evident audit trail regulators can export. The product targets platform engineering teams that need security, drift, cost, and compliance checks without rewriting CI pipelines.

Static scanners like Checkov or tfsec lint HCL syntax and known misconfigurations, but they never compare a plan to what is actually running in AWS. Terracotta closes that gap by correlating code, Terraform state, and live resources so drift, cross-PR conflicts, and hidden blast radius show up before anyone clicks merge. Its guardrails are written in plain English rather than Rego or Sentinel, which lowers the bar for teams that lack a dedicated policy-as-code engineer.

DevOps leads and platform engineers at regulated shops use Terracotta to block public S3 buckets, open SSH rules, and unapproved cost spikes at review time instead of in production. Security and compliance teams get a fleet-wide dashboard with drift posture, policy compliance rates, and exportable records for SOC 2 or HIPAA audits. Developers keep working inside GitHub or GitLab because findings arrive as PR comments, not another portal to check.

Beacon, Terracotta's in-PR chat assistant, answers questions about specific findings using context from the repo, plan output, and drift reports. The Platform tier adds unlimited drift repos, IAM and blast-radius analysis, Slack notifications, and a command center dashboard for $49 per engineer per month. Enterprise customers can run Terracotta self-hosted with SSO, SAML, and custom integrations for HCP Terraform or CircleCI.