Latent Diffusion

OpenAI’s new video generator raises the bar for detail and realism in generated videos — but the company released few details about how it built the system.

The longer text-to-image models train, the better their output — but the training is costly. Researchers built a system that produced superior images after far less training.

Stability.ai, maker of the Stable Diffusion image generator and StableLM text generator, launched Stable Audio, a system that generates music and sound effects from text. You can play with it and listen to examples here. The service is free for 20 generations per month up to 45 seconds long.

A pretrained text-to-image generator enabled researchers to see — roughly — what other people looked at based on brain scans. Yu Takagi and Shinji Nishimoto developed a method that uses Stable Diffusion to reconstruct images viewed by test subjects...