Generative AI

Last year, we saw an explosion of models that generate either video or audio outputs in high quality. In the coming year, I look forward to models that produce video clips complete with audio soundtracks including speech, music, and sound effects.

Stability AI’s aim is to liberate artists of all trades from the repetitive, mechanical aspects of their work and help them spend the majority of their time on the creative side. So our highest hope for next year is that generative AI will help people to be more creative and productive.

Video generation exploded in an abundance of powerful models.

The gap is narrowing between closed and open models for video generation.

A new model improves on recent progress in generating interactive virtual worlds from still images.

Amazon introduced a range of models that confront competitors head-on.

Rapid progress in generative AI comes with a hidden environmental cost: mountains of obsolete hardware.

A real-time video generator lets you explore an open-ended, interactive virtual world — a video game without a game engine.

Training successive neural networks on the outputs of previous networks gradually degrades performance. Will future models succumb to the curse of recursive training?

Researchers devised a way to cut the cost of training video generators. They used it to build a competitive open source text-to-video model and promised to release the training code.

Once hailed by OpenAI chief Sam Altman as the “best bromance in tech,” the partnership between Microsoft and OpenAI is facing challenges as both companies seek greater independence.

Text embedding models are often used to retrieve text, cluster text, determine similarity between texts, and generate initial embeddings for text classifiers. A new embedding model comes with adapters that specialize it to each of these use cases.

A German court dismissed a copyright lawsuit against LAION, the nonprofit responsible for large-scale image datasets used to train Midjourney, Stable Diffusion, and other image generators.

OpenAI launched a suite of new and updated tools to help AI developers build applications and reduce costs.

Meta upped the ante for text-to-video generation with new systems that produce consistent characters and matching soundtracks.