Jul 10, 2024
Like LoRA, But for Pretraining: GaLore, a memory-saving method for pretraining and fine-tuning LLMs
Low-rank adaptation (LoRA) reduces memory requirements when fine-tuning large language models, but it isn’t as conducive to pretraining.
Jul 10, 2024
6 Posts
Jul 10, 2024
Amazon Onboards Adept: Amazon adds majority of Adept AI staff to boost agentic AI capabilities
Amazon hired most of the staff of agentic-AI specialist Adept AI in a move that echoes Microsoft’s absorption of Inflection in March.
Jul 10, 2024
AI’s Path to Zero Emissions Is Cloudy: AI and data center boom challenges big tech's emissions targets
The boom in AI is jeopardizing big tech’s efforts to reach its targets for emissions of greenhouse gasses.
Jul 10, 2024
Claude Advances the LLM Interface: Claude 3.5 Sonnet’s Artifacts feature makes it easier to build and code on-site
Claude 3.5 Sonnet lets users work on generated outputs as though they were independent files — a step forward in large language model user interfaces.
Jul 10, 2024
California’s Proposed AI Safety Law Puts Developers at Risk: California SB 1047 is intended to make AI safer, but its unclear requirements put developers, innovation, and open source in jeopardy.
I continue to be alarmed at the progress of proposed California regulation SB 1047 and the attack it represents on open source and more broadly on AI innovation.
Jul 10, 2024
AI’s Cloudy Path to Zero Emissions, Amazon’s Agent Builders, Claude’s UI Advance, Training On Consumer GPUs
The Batch AI News and Insights: I continue to be alarmed at the progress of proposed California regulation SB 1047 and the attack it represents on open source and more broadly on AI innovation.
Subscribe to The Batch
Stay updated with weekly AI News and Insights delivered to your inbox