We discover that, simply as a big transformer style educated on language can generate coherent textual content, the similar actual style educated on pixel sequences can generate coherent symbol completions and samples. By means of organising a correlation between pattern high quality and symbol classification accuracy, we display that our very best generative style additionally comprises options aggressive with best convolutional nets within the unsupervised surroundings.
