Hardware
AI Supercomputer on Your Desk: Nvidia introduced Project Digits, a $3,000 home supercomputer for mid-sized AI models
Nvidia’s new desktop computer is built specifically to run large AI models.
Hardware
38 Posts
Hardware
Smaller Is Beautiful: Compact AI models redefine efficiency, bringing advanced capabilities to everyday devices
For years, the best AI models got bigger and bigger. But in 2024, some popular large language models were small enough to run on a smartphone.
Hardware
Garbage Out: Generative AI and GPU boom spawns growing e-waste problem
Rapid progress in generative AI comes with a hidden environmental cost: mountains of obsolete hardware.
Hardware
Object Detection for Small Devices: Grounding DINO 1.5, an edge device model built for faster, smarter object detection
An open source model is designed to perform sophisticated object detection on edge devices like phones, cars, medical equipment, and smart doorbells.
Hardware
Household Help: π0, a machine learning system for household robotics
A new generation of robots can handle some household chores with unusual skill.
Hardware
Further Chip Restrictions on China: TSMC stops advanced chip production for China on U.S. orders
The largest manufacturer of AI chips told its Chinese customers it would stop fabricating their most advanced designs, further limiting China’s access to AI hardware.
Hardware
No Game Engine Required: AI creates an interactive Minecraft-like world in real time
A real-time video generator lets you explore an open-ended, interactive virtual world — a video game without a game engine.
Hardware
AI Burns All the Energy: Will AI’s growing power demands drain the grid?
The globe’s growing AI infrastructure requires huge amounts of electricity, possibly more than power providers can generate responsibly. Could AI models suck energy resources dry?
Hardware
AI Giants Go Nuclear: Amazon, Google, and Microsoft bet on nuclear power to meet AI energy demands
Major AI companies plan to meet the growing demand with nuclear energy.
Hardware
Malaysia’s Data Center Boom: Malaysia emerges as an AI and cloud computing hub, drawing billions in investment
Malaysia’s location, natural resources, and investor-friendly government are perfect for data centers, turning part of the country into an AI-fueled boomtown.
Hardware
High Gear for Llama 3.1 405B: SambaNova boosts Llama 3.1 performance with fast, free access to largest model
SambaNova raised the speed limit for access to the largest model in the Llama 3.1 family — and it’s free.
Hardware
Nvidia Revs AI Engine: All about Nvidia’s new Blackwell architecture and B200 GPU
Nvidia’s latest chip promises to boost AI’s speed and energy efficiency.
Hardware
Blazing Inference Speed: Groq elevates AI processing speed with advanced chips.
An upstart chip company dramatically accelerates pretrained large language models. Groq offers cloud access to Meta’s Llama 2 and Mistral.ai’s Mixtral at speeds an order of magnitude greater than other AI platforms. Registered users can try it.
Hardware
Competition Heats Up in AI Chips: Huawei rises as key AI chip supplier amid U.S. export bans.
Huawei is emerging as an important supplier of AI chips. Amid a U.S. ban on exports of advanced chips to China, demand for Huawei’s AI chips is so intense that the company is limiting production of the chip that powers one of its most popular smartphones so it can serve the AI market.
Hardware
GPU Data Centers Strain Grid Power: AI's electricity demands spur an expansion of power sources.
The AI boom is taxing power grids and pushing builders of data centers to rethink their sources of electricity.
Subscribe to The Batch
Stay updated with weekly AI News and Insights delivered to your inbox