We’re freeing an research appearing that since 2012, the quantity of compute used within the greatest AI coaching runs has been expanding exponentially with a three.4-month doubling time (through comparability, Moore’s Regulation had a 2-year doubling length)[^footnote-correction]. Since 2012, this metric has grown through greater than 300,000x (a 2-year doubling length would yield just a 7x building up). Enhancements in compute had been a key part of AI growth, so so long as this development continues, it’s value making ready for the consequences of techniques a long way outdoor these days’s functions.
