Compute - Transformative AI and Compute
The first section discusses the term compute and introduces one conceptual model of a processor — a helpful analogy for analyzing trends in compute. Computation has two obvious roles in AI systems: training and inference. The following section discusses those and presents compute trends.…