Jul 10, 2024

6 Posts

Like LoRA, But for Pretraining: GaLore, a memory-saving method for pretraining and fine-tuning LLMs
Jul 10, 2024

Like LoRA, But for Pretraining: GaLore, a memory-saving method for pretraining and fine-tuning LLMs

Low-rank adaptation (LoRA) reduces memory requirements when fine-tuning large language models, but it isn’t as conducive to pretraining.
Amazon Onboards Adept: Amazon adds majority of Adept AI staff to boost agentic AI capabilities
Jul 10, 2024

Amazon Onboards Adept: Amazon adds majority of Adept AI staff to boost agentic AI capabilities

Amazon hired most of the staff of agentic-AI specialist Adept AI in a move that echoes Microsoft’s absorption of Inflection in March.
AI’s Path to Zero Emissions Is Cloudy: AI and data center boom challenges big tech's emissions targets
Jul 10, 2024

AI’s Path to Zero Emissions Is Cloudy: AI and data center boom challenges big tech's emissions targets

The boom in AI is jeopardizing big tech’s efforts to reach its targets for emissions of greenhouse gasses.
Claude Advances the LLM Interface: Claude 3.5 Sonnet’s Artifacts feature makes it easier to build and code on-site
Jul 10, 2024

Claude Advances the LLM Interface: Claude 3.5 Sonnet’s Artifacts feature makes it easier to build and code on-site

Claude 3.5 Sonnet lets users work on generated outputs as though they were independent files — a step forward in large language model user interfaces.
California’s Proposed AI Safety Law Puts Developers at Risk: California SB 1047 is intended to make AI safer, but its unclear requirements put developers, innovation, and open source in jeopardy.
Jul 10, 2024

California’s Proposed AI Safety Law Puts Developers at Risk: California SB 1047 is intended to make AI safer, but its unclear requirements put developers, innovation, and open source in jeopardy.

I continue to be alarmed at the progress of proposed California regulation SB 1047 and the attack it represents on open source and more broadly on AI innovation.
AI’s Cloudy Path to Zero Emissions, Amazon’s Agent Builders, Claude’s UI Advance, Training On Consumer GPUs
Jul 10, 2024

AI’s Cloudy Path to Zero Emissions, Amazon’s Agent Builders, Claude’s UI Advance, Training On Consumer GPUs

The Batch AI News and Insights: I continue to be alarmed at the progress of proposed California regulation SB 1047 and the attack it represents on open source and more broadly on AI innovation.

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox