Google's ML-optimised TPUv4 cut training energy 13.7-fold against the unoptimised 2017 GPU it replaced. Hardware is one of four factors the authors say combine to cut ML carbon footprints up to 747-fold.
Patterson et al. (Google / UC Berkeley), 2022
Single-source