Hardware
Garbage Out: Generative AI and GPU boom spawns growing e-waste problem
Rapid progress in generative AI comes with a hidden environmental cost: mountains of obsolete hardware.
Hardware
36 Posts
Hardware
Object Detection for Small Devices: Grounding DINO 1.5, an edge device model built for faster, smarter object detection
An open source model is designed to perform sophisticated object detection on edge devices like phones, cars, medical equipment, and smart doorbells.
Hardware
Household Help: π0, a machine learning system for household robotics
A new generation of robots can handle some household chores with unusual skill.
Hardware
Further Chip Restrictions on China: TSMC stops advanced chip production for China on U.S. orders
The largest manufacturer of AI chips told its Chinese customers it would stop fabricating their most advanced designs, further limiting China’s access to AI hardware.
Hardware
No Game Engine Required: AI creates an interactive Minecraft-like world in real time
A real-time video generator lets you explore an open-ended, interactive virtual world — a video game without a game engine.
Hardware
AI Burns All the Energy: Will AI’s growing power demands drain the grid?
The globe’s growing AI infrastructure requires huge amounts of electricity, possibly more than power providers can generate responsibly. Could AI models suck energy resources dry?
Hardware
AI Giants Go Nuclear: Amazon, Google, and Microsoft bet on nuclear power to meet AI energy demands
Major AI companies plan to meet the growing demand with nuclear energy.
Hardware
Malaysia’s Data Center Boom: Malaysia emerges as an AI and cloud computing hub, drawing billions in investment
Malaysia’s location, natural resources, and investor-friendly government are perfect for data centers, turning part of the country into an AI-fueled boomtown.
Hardware
High Gear for Llama 3.1 405B: SambaNova boosts Llama 3.1 performance with fast, free access to largest model
SambaNova raised the speed limit for access to the largest model in the Llama 3.1 family — and it’s free.
Hardware
Nvidia Revs AI Engine: All about Nvidia’s new Blackwell architecture and B200 GPU
Nvidia’s latest chip promises to boost AI’s speed and energy efficiency.
Hardware
Blazing Inference Speed: Groq elevates AI processing speed with advanced chips.
An upstart chip company dramatically accelerates pretrained large language models. Groq offers cloud access to Meta’s Llama 2 and Mistral.ai’s Mixtral at speeds an order of magnitude greater than other AI platforms. Registered users can try it.
Hardware
Competition Heats Up in AI Chips: Huawei rises as key AI chip supplier amid U.S. export bans.
Huawei is emerging as an important supplier of AI chips. Amid a U.S. ban on exports of advanced chips to China, demand for Huawei’s AI chips is so intense that the company is limiting production of the chip that powers one of its most popular smartphones so it can serve the AI market.
Hardware
GPU Data Centers Strain Grid Power: AI's electricity demands spur an expansion of power sources.
The AI boom is taxing power grids and pushing builders of data centers to rethink their sources of electricity.
Hardware
Industrial Strength Language Model: Siemens and Microsoft launch GPT-powered Copilot for manufacturing machinery.
ChatGPT is pitching in on the assembly line. Siemens and Microsoft launched a joint pilot program of a GPT-powered model for controlling manufacturing machinery. German automotive parts manufacturer Schaeffler is testing the system in its factories, as is Siemens itself.
Hardware
More Cloud GPUs on the Way: Voltage Park offers Nvidia GPUs at $1.89/hour for startups and researchers
A new cloud-computing company promises to provide scarce AI processing power to startups and researchers. Voltage Park, a nonprofit north of Silicon Valley, will offer processing power from 24,000 top-of-the-line Nvidia H100 graphics processing units (GPUs)...
Subscribe to The Batch
Stay updated with weekly AI News and Insights delivered to your inbox