Responsible AI

Large language models that remember more hallucinate less.

Jailbreak prompts can prod a large language model (LLM) to overstep built-in boundaries, leading it to do things like respond to queries it was trained to refuse to answer. Researchers devised a way to further boost the probability that LLMs will respond in ways that respect such limits.

Two top AI companies changed their stances on military and intelligence applications.

A new study suggests that leading AI models may meet the requirements of the European Union’s AI Act in some areas, but probably not in others.

Major AI companies plan to meet the growing demand with nuclear energy.

Seemingly an innocuous form of expression, ASCII art opens a new vector for jailbreak attacks on large language models (LLMs), enabling them to generate outputs that their developers tuned them to avoid producing.

Large language models can produce output that’s convincing but false. Researchers proposed a way to identify such hallucinations. 

At meetings in Seoul, government and corporate officials from dozens of countries agreed to take action on AI safety.

The United States and China opened a dialogue to avert hypothetical AI catastrophes.

OpenAI models were used in five disinformation campaigns, the company said.

OpenAI pulled back the curtain on revised rules that will guide its models. 

An alliance of major tech and media companies introduced a watermark designed to distinguish real from fake media starting with images. The Coalition for Content Provenance and Authenticity (C2PA) offers an open standard that marks media files with information about their creation and editing.

Retrenching after its November leadership shakeup, OpenAI unveiled a new framework for evaluating risks posed by its models and deciding whether to limit their use. 

It’s well known that large language models can make assertions that are blatantly false. But can they concoct outright lies? In a proof-of-concept demonstration, Jérémy Scheurer, Mikita Balesni, and Marius Hobbhahn at Apollo Research...

Angst at the prospect of intelligent machines boiled over in moves to block or limit the technology. Fear of AI-related doomsday scenarios prompted proposals to delay research and soul searching by prominent researchers. Amid the doomsaying, lawmakers took dramatic regulatory steps.