GPT-2 (nonfiction)

GPT-2 (Generative Pretrained Transformer 2) is a language model that was trained on 40GB of text scraped from websites that Reddit linked to and that had a Karma score of at least two.

The developers at OpenAI describe GPT-2 as "a large-scale unsupervised language model which generates coherent paragraphs of text, achieves state-of-the-art performance on many language modeling benchmarks, and performs rudimentary reading comprehension, machine translation, question answering, and summarization—all without task-specific training."

Because the model is probabilistic, it returns a different response every time you enter the same input.

Fiction cross-reference

• Forbidden Ratio
• Gnomon algorithm
• Gnomon Chronicles

Nonfiction cross-reference

• Computation (nonfiction)
• Machine learning (nonfiction)

External links:

• Unicorn AI - Computerphile @ YouTube
• Computerphile explains the fascinating AI storyteller, GPT-2 @ Boing Boing
• How to Build OpenAI's GPT-2: "The AI That's Too Dangerous to Release"