Transformer Engine
Transformer Accelerator: Nvidia's H100 is Designed to Train Transformers Faster
Is your colossal text generator bogged down in training? Nvidia announced a chip designed to accelerate the transformer architecture, the basis of large language models such as GPT-3.