Graphics Processing Unit (GPU)

25 Posts

Pile of discarded green circuit boards from electronic devices.
Graphics Processing Unit (GPU)

Garbage Out: Generative AI and GPU boom spawns growing e-waste problem

Rapid progress in generative AI comes with a hidden environmental cost: mountains of obsolete hardware.
Illustration of a person holding a box with network nodes emerging from it.
Graphics Processing Unit (GPU)

AI Power Couple Recommits: Amazon deepens Anthropic partnership with $4 billion investment

Amazon and Anthropic expanded their partnership, potentially strengthening Amazon Web Services’ AI infrastructure and lengthening the high-flying startup’s runway.
Close-up of a Chinese-made server chip labeled with the logo and text ‘710’ mounted on a motherboard.
Graphics Processing Unit (GPU)

Further Chip Restrictions on China: TSMC stops advanced chip production for China on U.S. orders

The largest manufacturer of AI chips told its Chinese customers it would stop fabricating their most advanced designs, further limiting China’s access to AI hardware.
Comparison of Minecraft terrain with and without player modifications.
Graphics Processing Unit (GPU)

No Game Engine Required: AI creates an interactive Minecraft-like world in real time

A real-time video generator lets you explore an open-ended, interactive virtual world — a video game without a game engine.
24 Hours on an Old Consumer GPU: Optimizing LLMs for low-resource hardware
Graphics Processing Unit (GPU)

24 Hours on an Old Consumer GPU: Optimizing LLMs for low-resource hardware

BERT, a large language model released in 2018 and built upon the then-new transformer architecture, marked a paradigm shift in AI.
Giant golden and black AI chip
Graphics Processing Unit (GPU)

Nvidia Revs AI Engine: All about Nvidia’s new Blackwell architecture and B200 GPU

Nvidia’s latest chip promises to boost AI’s speed and energy efficiency.
Competition Heats Up in AI Chips: Huawei rises as key AI chip supplier amid U.S. export bans.
Graphics Processing Unit (GPU)

Competition Heats Up in AI Chips: Huawei rises as key AI chip supplier amid U.S. export bans.

Huawei is emerging as an important supplier of AI chips. Amid a U.S. ban on exports of advanced chips to China, demand for Huawei’s AI chips is so intense that the company is limiting production of the chip that powers one of its most popular smartphones so it can serve the AI market.
GPU Data Centers Strain Grid Power: AI's electricity demands spur an expansion of power sources.
Graphics Processing Unit (GPU)

GPU Data Centers Strain Grid Power: AI's electricity demands spur an expansion of power sources.

The AI boom is taxing power grids and pushing builders of data centers to rethink their sources of electricity.
More Cloud GPUs on the Way: Voltage Park offers Nvidia GPUs at $1.89/hour for startups and researchers
Graphics Processing Unit (GPU)

More Cloud GPUs on the Way: Voltage Park offers Nvidia GPUs at $1.89/hour for startups and researchers

A new cloud-computing company promises to provide scarce AI processing power to startups and researchers. Voltage Park, a nonprofit north of Silicon Valley, will offer processing power from 24,000 top-of-the-line Nvidia H100 graphics processing units (GPUs)...
AI Chip Challenger Gains Traction: Nvidia's competitor Cerebras secured a contract with a major tech conglomerate.
Graphics Processing Unit (GPU)

AI Chip Challenger Gains Traction: Nvidia's competitor Cerebras secured a contract with a major tech conglomerate.

An upstart supplier of AI chips secured a major customer. Cerebras, which competes with Nvidia in hardware for training large models, signed a $100 million contract with Abu Dhabi tech conglomerate G42. The deal is the first part of a multi-stage plan to build a network of supercomputers.
Series of NVIDIA chips disappearing one by one
Graphics Processing Unit (GPU)

GPU Shortage Intensifies: All about Nvidia's GPU shortage

Nvidia’s top-of-the-line chips are in high demand and short supply. There aren’t enough H100 graphics processing units (GPUs) to meet the crush of demand brought on by the vogue for generative AI, VentureBeat reported.
A person's hand grabbing a handful of AI chips arranged on a table
Graphics Processing Unit (GPU)

Restricted Chips Slip Through: Loopholes help Chinese companies get U.S. chips.

Chinese companies have found loopholes to sidestep United States limits on AI chips. Facing severe limits on U.S. exports of high-performance chips, Chinese AI firms are purchasing them through subsidiaries and using them through cloud services, the Financial Times reported.
Person with a sad face in front of an abandoned Chip's Candies factory
Graphics Processing Unit (GPU)

No More GPUs: Confronting the Fear of a Global Chip Shortage

Advanced AI requires advanced hardware. What if the global supply of high-end AI chips dries up? Most of the world’s advanced AI processors are manufactured in Taiwan, where tension with mainland China is rising.
Shot of Computer Processor Production Line at Advanced Semiconductor Foundry in Bright Environment
Graphics Processing Unit (GPU)

AI Chips Spark International Tension: U.S. Blocks AI Chip Sales to China

New U.S. restrictions on chip sales aim to hamper China’s AI efforts. The U.S. government published sweeping limits on sales of processors that involve U.S. designs and technology to Chinese businesses. U.S. officials stated that the restrictions are meant to prevent China from militarizing AI.
Different Nvidia cloud-computing services
Graphics Processing Unit (GPU)

Chipmaker Boosts AI as a Service: Nvidia Launches Cloud Service for NLP Models

Nvidia, known for chips designed to process AI systems, is providing access to large language models. Nvidia announced early access to NeMo LLM and BioNeMo, cloud-computing services that enable developers to generate text and biological sequences respectively.
Load More

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox