UL2 vs Terracotta

UL2 is a unified framework for pre-training language models that perform well across a wide range of natural language processing tasks. It separates model architecture from training objectives, allowing flexible combinations of self-supervised learning methods. The core innovation is the Mixture-of-Denoisers (MoD) objective, which blends multiple denoising tasks to improve generalization. UL2 introduces mode switching, linking downstream fine-tuning to specific pre-training modes for better task adaptation. Scaled up to 20 billion parameters, UL2 achieves state-of-the-art results on over 50 NLP benchmarks, including language understanding, generation, reasoning, and knowledge grounding. It also excels at in-context learning, outperforming larger models like GPT-3 on zero-shot and one-shot tasks. The framework supports instruction tuning (Flan-UL2), further enhancing performance on complex reasoning and multitask benchmarks. Open-source Flax-based T5X checkpoints for UL2 and Flan-UL2 20B models are publicly available, facilitating research and application development.

Terracotta is an Infrastructure as Code governance tool that audits every pull request before merge, checking Terraform and OpenTofu changes against live cloud resources, remote state, and your team's governance policies. It installs as a GitHub or GitLab app, posts findings in the PR thread, and builds a tamper-evident audit trail regulators can export. The product targets platform engineering teams that need security, drift, cost, and compliance checks without rewriting CI pipelines.

Static scanners like Checkov or tfsec lint HCL syntax and known misconfigurations, but they never compare a plan to what is actually running in AWS. Terracotta closes that gap by correlating code, Terraform state, and live resources so drift, cross-PR conflicts, and hidden blast radius show up before anyone clicks merge. Its guardrails are written in plain English rather than Rego or Sentinel, which lowers the bar for teams that lack a dedicated policy-as-code engineer.

DevOps leads and platform engineers at regulated shops use Terracotta to block public S3 buckets, open SSH rules, and unapproved cost spikes at review time instead of in production. Security and compliance teams get a fleet-wide dashboard with drift posture, policy compliance rates, and exportable records for SOC 2 or HIPAA audits. Developers keep working inside GitHub or GitLab because findings arrive as PR comments, not another portal to check.

Beacon, Terracotta's in-PR chat assistant, answers questions about specific findings using context from the repo, plan output, and drift reports. The Platform tier adds unlimited drift repos, IAM and blast-radius analysis, Slack notifications, and a command center dashboard for $49 per engineer per month. Enterprise customers can run Terracotta self-hosted with SSO, SAML, and custom integrations for HCP Terraform or CircleCI.