Recurrent Neural Network (RNN)

16 Posts

Illustration of a laughing robot
Recurrent Neural Network (RNN)

Toward Machines That LOL: Scientists Teach a Speech Recognition Robot to Laugh

Even if we manage to stop robots from taking over the world, they may still have the last laugh. Researchers at Kyoto University developed a series of neural networks that enable a robot engaged in spoken conversation to chortle along with its human interlocutor.
Illustration of a robot with a captain costume
Recurrent Neural Network (RNN)

Neural Networks: Find the Function — A Basic Introduction to Neural Networks

Let’s get this out of the way: A brain is not a cluster of graphics processing units, and if it were, it would run software far more complex than the typical artificial neural network. Yet neural networks were inspired by the brain’s architecture.
Animated graphics from Google demonstrate Project Relate, a tool for recognizing impaired speech. .
Recurrent Neural Network (RNN)

Everyone Has a Voice: Project Relate Offers Synthesized Speech that Works in Real Time

An Android app offers speech recognition model for speech impaired by cerebral palsy, Down syndrome, Parkinson’s disease, stroke, or traumatic brain injury.
Animated charts showing how AI can learn from simple tasks to harder versions of the same task
Recurrent Neural Network (RNN)

More Thinking Solves Harder Problems: AI Can Learn From Simple Tasks to Solve Hard Problems

In machine learning, an easy task and a more difficult version of the same task — say, a maze that covers a smaller or larger area — often are learned separately.
Animated video showing a system to interpret electrical impulses from the brain as words
Recurrent Neural Network (RNN)

Listening to the Brain: NLP System Translates a Man's Brain Activity Into Words

Neural networks translated a paralyzed man’s brainwaves into conversational phrases. Researchers trained a system to interpret electrical impulses from the brain of a man who had lost the ability to speak 15 years ago, and displayed them as words on a video screen.
Diagram showing how Project Debater works
Recurrent Neural Network (RNN)

Up for Debate: IBM's NLP-powered debate bot mines LexisNexis.

IBM’s Watson question-answering system stunned the world in 2011 when it bested human champions of the TV trivia game show Jeopardy! Although the Watson brand has fallen on hard times, the company’s language-processing prowess continues to develop.
Graphs and data related to recurrent neural nets (RNNs)
Recurrent Neural Network (RNN)

Performance Guaranteed: How deep learning networks can become Bayes-optimal.

Bayes-optimal algorithms always make the best decisions given their training and input, if certain assumptions hold true. New work shows that some neural networks can approach this kind of performance.
Graphs and data related to transformer networks
Recurrent Neural Network (RNN)

The Transformation Continues: Technique boosts transformer performance on long sequences.

Transformer networks are gaining popularity as a high-accuracy alternative to recurrent neural networks. But they can run slowly when they’re applied to long sequences.
Brains and neural signals reading
Recurrent Neural Network (RNN)

Listening to the Brain: NLP researchers used RNNs to translate brain waves into text.

AI has added an unlikely language to its catalog of translation capabilities: brain waves. Joseph Makin led a group from the University of California San Francisco to render a person’s neural signals as English text while the person while the person read a sentence aloud.
Schematic of a typical deep learning workflow
Recurrent Neural Network (RNN)

(Science) Community Outreach: A survey of machine learning from Eric Schmidt

Are your scientist friends intimidated by machine learning? They might be inspired by a primer from one of the world’s premier tech titans. Former Google CEO Eric Schmidt and Cornell PhD candidate Maithra Raghu school scientists in machine learning in a sprawling overview.
Conference on Microsoft Teams with a person eating a chip bag
Recurrent Neural Network (RNN)

Silent Snacking: AI removes background noise from video conferencing.

As working from home becomes the new normal, AI may protect you from the sound of coworkers munching while they chat. No more smacking lips and rustling chip bags! Microsoft’s online collaboration platform Teams announced a feature that removes extraneous sounds from videoconferences.
Single Headed Attention RNN (SHA-RNN)
Recurrent Neural Network (RNN)

Language Modeling on One GPU: Single-headed attention competes with transformers.

The latest large, pretrained language models rely on trendy layers based on transformer networks. New research shows that these newfangled layers may not be necessary.
Illustration of a crystal snowball
Recurrent Neural Network (RNN)

Simulation Substitutes for Data: When simulation works wonders with deep learning

The future of machine learning may depend less on amassing ground-truth data than simulating the environment in which a model will operate. Deep learning works like magic with enough high-quality data. When examples are scarce, though, researchers are using simulation to fill the gap.
Information related to Implicit Reinforcement without Interaction at Scale (IRIS)
Recurrent Neural Network (RNN)

Different Skills From Different Demos: Implicit reinforcement without interaction at scale, explained

Reinforcement learning trains models by trial and error. In batch reinforcement learning (BRL), models learn by observing many demonstrations by a variety of actors. But what if one doctor is handier with a scalpel while another excels at suturing?
Booksby.ai book covers created by AI
Recurrent Neural Network (RNN)

Who’s Minding the Store?

Amazon, watch your back. There’s a new player in the book business and, unlike Jeff Bezos, it doesn’t need eight hours of sleep a night. The online bookstore Booksby.ai is run entirely by AI. Neural networks write the books, create the cover art, price the merchandise, even write the reviews.
Load More

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox