TransGAN

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.

A recent generative adversarial network (GAN) produced more coherent images using modified transformers that replaced fully connected layers with convolutional layers. A new GAN achieved a similar end using transformers in their original form.