We’ve skilled a large-scale unsupervised language type which generates coherent paragraphs of textual content, achieves cutting-edge efficiency on many language modeling benchmarks, and plays rudimentary studying comprehension, system translation, query answering, and summarization—all with out task-specific coaching.

