Processors

19 Posts

Charts showing performance scaling of TPU vs GPU on MLPerf-Transformer and Cerebras GPT-3 XL Performance
Processors

Built to Scale: Andromeda Supercomputer from Cerebras Speeds up AI

A new computing cluster delivers more bang per chip. Cerebras unveiled Andromeda, a supercomputer based on its processors. Unlike conventional clusters, the system’s processing speed rises linearly with additional processors.
Person with a sad face in front of an abandoned Chip's Candies factory
Processors

No More GPUs: Confronting the Fear of a Global Chip Shortage

Advanced AI requires advanced hardware. What if the global supply of high-end AI chips dries up? Most of the world’s advanced AI processors are manufactured in Taiwan, where tension with mainland China is rising.
Gif shows closeup images of graphics processing units from Nvidia and AMD.
Processors

The Geopolitics of GPUs: US Bans Nvidia and AMD Chip Sales to China

The ban impacts Nvidia's A100 and H100 chips, and AMD's MI250.
Semiconductor chip
Processors

Chips at Risk: How the chip shortage impacts AI.

The hardware that runs the latest AI systems faces rising uncertainty as models grow larger and more computationally intensive. The U.S. Commerce Department sounded an alarm over bottlenecks in the availability of semiconductor chips.
Illustration of giant Christmas tree in a town plaza
Processors

Trillions of Parameters: Are AI models with trillions of parameters the new normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.
First image showing the Google Tensor chip. Second image showing the Google Pixel 6 phone
Processors

Competition Heats Up in Mobile AI: Google Designed Its Own Tensor AI Chip for Smartphones

Google designed its own AI chip for its new smartphone — a snub to Qualcomm, the dominant chip vendor in Android phones. What’s new: Google debuted the Tensor chip last week
Different Apple products using augmented reality
Processors

Apple Kicks AI Into High Gear: Inside Apple's efforts to make pro-privacy AI

After years of trailing other tech giants in AI, Apple has a new ambition: to become the industry’s leading purveyor of products powered by machine learning. In an interview with Ars Technica, the company’s AI chief argues that its pro-privacy.
On the left, the policy is being trained from scratch, and on the right, a pre-trained policy is being fine-tuned
Processors

Computers Making Computers: How Google used AI to help design its TPU v4 chip.

A neural network wrote the blueprint for upcoming computer chips that will accelerate deep learning itself. Google engineers used a reinforcement learning system to arrange the billions of minuscule transistors in an upcoming version of its Tensor Processing Unit (TPU) chips.
Data related to Nvidia's Pay Attention When Required (Par) approach
Processors

Selective Attention: More efficient NLP training without sacrificing performance

Large transformer networks work wonders with natural language, but they require enormous amounts of computation. New research slashes processor cycles without compromising performance.
AI chip and graphics processing unit
Processors

AI Chip Leaders Join Forces: Nvidia announces intent to purchase Arm.

A major corporate acquisition could reshape the hardware that makes AI tick.What’s new: U.S. processor giant Nvidia, the world’s leading vendor of the graphics processing units (GPUs) that perform calculations for deep learning, struck a deal to purchase UK chip designer Arm for $40 billion.
Graphs and data related to AI chips
Processors

Built for Speed: Nvidia topped MLPerf's training benchmarks in 2020.

Chips specially designed for AI are becoming much faster at training neural networks, judging from recent trials. MLPerf, an organization that’s developing standards for hardware performance in machine learning tasks, released results from its third benchmark competition.
Colossus Mk2, processor by Graphcore
Processors

New Horsepower for Neural Nets: UK startup Graphcore released its Colossus MK2 chip for AI.

A high-profile semiconductor startup made a bid for the future of AI computation. UK startup Graphcore released the Colossus Mk2, a processor intended to perform the matrix math calculations at the heart of deep learning more efficiently than other specialized processors.
Information related to the Once-for-All (OFA) method
Processors

Build Once, Run Anywhere: The Once-For-All technique adapts AI models to edge devices.

From server to smartphone, devices with less processing speed and memory require smaller networks. Instead of building and training separate models to run on a variety of hardware, a new approach trains a single network that can be adapted to any device.
Quantum computing
Processors

Quantum Leap: Researchers build TensorFlow hardware for quantum computing.

Quantum computing has made great strides in recent years, though it still faces significant challenges. If and when it gets here, machine learning may be ready for it.
Some results from CB Insights' annual list of the 100 most promising startups in AI
Processors

Machine Learning Churning: The hottest AI startups of 2020, according to CB Insights

Many of this year’s hottest AI companies are taking the spotlight from last year’s darlings.What’s new: CB Insights, which analyzes early-stage companies, published its annual list of the 100 “most promising” startups in AI.
Load More

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox