Catching Unicorns with GLTR

Catching Unicorns with GLTR

GLTR is a forensic text analysis demo that highlights how predictable each word in a passage looks to a language model and colors the text so you can spot machine-written prose at a glance. Paste a sample into the live demo, and GLTR ranks every next-word prediction from GPT-2 117M, painting likely picks green or yellow and surprising human choices purple.

Unlike black-box AI detectors that return a single score, GLTR shows the forensic footprint word by word, plus histograms for top-k counts, probability ratios, and prediction entropy across the passage. That makes it useful for teaching how generative models stick to safe, high-probability wording while human writers reach for rarer terms that still fit the topic.

Researchers, journalists, and educators use GLTR to compare sample texts, explore model behavior, and sanity-check suspicious copy. The project is free, open source, and backed by an ACL 2019 demo paper from MIT-IBM Watson AI Lab and Harvard NLP, though the maintainers note it was built for GPT-2 era text and may struggle with newer models like ChatGPT.

Top Features:
  1. Colors each word green, yellow, red, or purple based on GPT-2 117M top 10, 100, 1,000, or rarer predictions

  2. Live demo at demo.gltr.io accepts custom text plus bundled real and fake samples

  3. Hover overlays show the top 5 predicted next words with probabilities for any token

  4. Three histograms chart top-k counts, probability ratios, and prediction entropy across a passage

  5. Open-source code lives on GitHub under detecting-fake-text for local deployment

  6. ACL 2019 demo paper reports human fake-text detection rising from 54% to 72% with GLTR overlays

  7. Maintainers link to the newer RADAR demo for testing text from recent large models

Pros:
  1. Word-level color overlays make model behavior visible instead of hiding it behind one probability score.

  2. Free demo and open-source release let classrooms and newsrooms experiment without procurement hurdles.

  3. Bundled real and fake samples, including the famous unicorn GPT-2 passage, teach what generated prose looks like.

  4. Histograms summarize entropy and top-k patterns across an entire document for quicker comparisons.

  5. Published ACL study shows GLTR helped non-experts catch fake text more often during user testing.

Cons:
  1. The underlying model is GPT-2 117M, so results on ChatGPT or other modern generators are unreliable.

  2. GLTR inspects one passage at a time and is not built for large-scale automated moderation pipelines.

  3. Interpreting purple or red words still requires language fluency to judge whether an uncommon term is legitimate.

FAQs:

What does GLTR stand for?

Catching Unicorns with GLTR stands for Giant Language model Test Room. The demo from MIT-IBM Watson AI Lab and Harvard NLP shows how likely each word in a passage would be predicted by a language model.

How does GLTR detect generated text?

Catching Unicorns with GLTR compares each word in your text to GPT-2 117M next-word rankings. Words in the top 10 predictions turn green, top 100 yellow, top 1,000 red, and rarer choices purple because generated prose tends to stay on highly likely tokens.

Is GLTR free to use?

Yes. Catching Unicorns with GLTR is free through the public demo at demo.gltr.io, and the source code is open on GitHub. There is no paid plan or account requirement to analyze sample text.

Can GLTR analyze my own text?

Yes. The Catching Unicorns with GLTR demo lets you paste custom passages or load bundled examples, then click analyze to render the color overlay and histograms. You can hover individual words to inspect the top five model predictions.

Does GLTR work on ChatGPT output?

Catching Unicorns with GLTR was built in 2019 to test GPT-2 era text and may not be reliable on newer models such as ChatGPT. The demo disclaimer points users to the RADAR demo at radar-app.vizhub.ai for a newer detection approach.

Who created GLTR?

Catching Unicorns with GLTR was created by Hendrik Strobelt and Sebastian Gehrmann with review by Alexander Rush as a collaboration between the MIT-IBM Watson AI Lab and Harvard NLP. The ACL 2019 demo track paper is publicly available on arXiv.

Category:

Pricing:

Free

Tags:

Fake Text Detection
GPT-2 Analysis
Forensic Visualization
Language Model Research
Open Source NLP
Entropy Histograms
Academic Demo Tool
GLTR

Tech used:

Google Analytics
Google Tag Manager
Ruby
GitHub

Reviews:

Give your opinion on Catching Unicorns with GLTR :-

Overall rating

Join thousands of AI enthusiasts in the World of AI!

Best Free Catching Unicorns with GLTR Alternatives (and Paid)

By Rishit