GPT-3 and GPT-4 API inference costs per 1,000 tokens
Apr 24, 2024

Pop Song Generators, 3D Mesh Generators, Real-World Benchmarks, AI for Manufacturing

The Batch AI News and Insights: Much has been said about many companies’ desire for more compute (as well as data) to train larger foundation models.
Proposed ChatDev architecture, illustrated.
Apr 17, 2024

AI Agents With Low/No Code, Hallucinations Create Security Holes, Tuning for RAG Performance, GPT Store’s Lax Moderation

The Batch AI News and Insights: Multi-agent collaboration is the last of the four key AI agentic design patterns that I’ve described in recent letters. Given a complex task like writing software, a multi-agent approach would break...
Planning: Agentic AI design pattern illustrated by an example
Apr 10, 2024

Autonomous Coding Agents, Instability at Stability AI, Mamba Mania, What Users Do With GenAI

The Batch AI News and Insights: Planning is a key agentic AI design pattern in which we use a large language model (LLM) to autonomously decide on what sequence of steps to execute to accomplish a larger task.
Microsoft Absorbs Inflection, Nvidia’s New GPUs, Managing AI Bio Risk, More Factual LLMs
Apr 03, 2024

Microsoft Absorbs Inflection, Nvidia’s New GPUs, Managing AI Bio Risk, More Factual LLMs

The Batch AI News and Insights: Tool use, in which an LLM is given functions it can request to call for gathering information, taking action, or manipulating data, is a key design pattern of AI agentic workflows.
One Agent For Many Worlds, Cross-Species Cell Embeddings, U.S. Deploys AI Targeting, Robo Football Gets Real
Mar 27, 2024

One Agent For Many Worlds, Cross-Species Cell Embeddings, U.S. Deploys AI Targeting, Robo Football Gets Real

The Batch AI News and Insights: Last week, I described four design patterns for AI agentic workflows that I believe will drive significant progress this year...
Robots Talk Back, AI Security Risks, Political Deepfakes, Pretrained Models on the Cheap
Mar 20, 2024

Robots Talk Back, AI Security Risks, Political Deepfakes, Pretrained Models on the Cheap

The Batch AI News and Insights: I think AI agent workflows will drive massive AI progress this year — perhaps even more than the next generation of foundation models. This is an important trend, and I urge everyone who works in AI to pay attention to it.
Anthropic Ups the Ante, India Warns Developers, Google Tests Generative News, Learning Language Without Language Training
Mar 13, 2024

Anthropic Ups the Ante, India Warns Developers, Google Tests Generative News, Learning Language Without Language Training

The Batch AI News and Insights: I’ve noticed a trend in how generative AI applications are built that might affect both big companies and developers: The gravity of data is decreasing.
Mistral Living Large, Google's Open Source Challenger, Robot Chemist, Schooling Language Models in Math
Mar 06, 2024

Mistral Living Large, Google's Open Source Challenger, Robot Chemist, Schooling Language Models in Math

The Batch AI News and Insights: Progress on LLM-based agents that can autonomously plan out and execute sequences of actions has been rapid, and I continue to see month-over-month improvements.
Illustration of a Python inside a cardboard box
Feb 28, 2024

Google's Troubled Gemini Launch, OpenAI's Next Act, Groq's Blazing Inference Speed, Faster Network Pruning

The Batch AI News and Insights: I think the complexity of Python package management holds down AI application development more than is widely appreciated. AI faces multiple bottlenecks — we need more GPUs, better algorithms, cleaner data in large quantities.
Generated Video Gets Real(er), Nvidia Competitor Emerges, Neural Nets for Gymnastics, Efficient Optimizer
Feb 21, 2024

Generated Video Gets Real(er), Nvidia Competitor Emerges, Neural Nets for Gymnastics, Efficient Optimizer

The Batch AI News and Insights: Earlier this month, my team AI Fund held its annual co-founder and CEO summit, where many of our collaborators gathered in California for two days to discuss how to build AI companies.
AI Recovers Ancient Scrolls, GPUs Strain Power Grid, Government Restricts Fake Voices, Better Image Generation
Feb 14, 2024

AI Recovers Ancient Scrolls, GPUs Strain Power Grid, Government Restricts Fake Voices, Better Image Generation

The Batch AI News and Insights: The rise of cloud-hosted AI software has brought much discussion about the privacy implications of using it. But I find that users, including both consumers and developers...
Taylor Swift Deepfakes, GPT-4 Biothreats, New Leaderboards, LLMs That Get Inside Your Head
Feb 07, 2024

Taylor Swift Deepfakes, GPT-4 Biothreats, New Leaderboards, LLMs That Get Inside Your Head

The Batch AI News and Insights: On the LMSYS Chatbot Arena Leaderboard, which pits chatbots against each other anonymously and prompts users to judge which one generated a better answer, Google’s Bard (Gemini Pro)
Andrew Ng speaking at TED AI, October 17, 2023
Jan 31, 2024

AI Jobs Proliferate, Big Compute Giveaway, Generated Video Upgrade, Higher Yields for Small Farms

The Batch AI News and Insights: Last year, a number of large businesses and individuals went to the media and governments and pushed the message that AI is scary, impossible to control, and might even lead to human extinction.
World Economic Forum, January 16, 2024: "The Expanding Universe of Generative Models" panelists
Jan 24, 2024

Machine Learning Detects Cancer Early, Language Model Learns Geometry, AI Creates Jobs, Nations Invest in Homegrown AI

The Batch AI News and Insights: Last week, I attended the World Economic Forum, an annual meeting of leaders in government, business, and culture at Davos, Switzerland.
AI Invades Consumer Products, OpenAI’s Platform Play, Watermarks for Synthetic Media, Generated Musical Accompaniments
Jan 17, 2024

AI Invades Consumer Products, OpenAI’s Platform Play, Watermarks for Synthetic Media, Generated Musical Accompaniments

The Batch AI News and Insights: As I wrote in an earlier letter, whether AI is sentient or conscious is a philosophical question rather than a scientific one, since there is no widely agreed-upon definition and test for these terms.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox

Select a country