neural networks

23 Oct

Liquid AI Is Redesigning the Neural Network

stp2y0 CommentsGenAIai lab, artificial intelligence, energy, mit, neural networks

Artificial intelligence might now be solving advanced math, performing complex reasoning, and even using personal computers, but today’s algorithms could still learn a thing or two from microscopic worms.Liquid AI, a startup spun out of MIT, will today reveal several new AI models based on a novel type of “liquid” neural network that has the potential to be more efficient, less power-hungry, and more transparent than the ones that underpin everything from chatbots to image generators to facial recognition systems.Liquid AI’s new models include one for detecting fraud in financial transactions, another for controlling self-driving cars, and a third for…

23 May

AI Is a Black Box. Anthropic Figured Out a Way to Look Inside

stp2y0 CommentsAIalgorithms, artificial intelligence, deep learning, neural networks, research

Last year, the team began experimenting with a tiny model that uses only a single layer of neurons. (Sophisticated LLMs have dozens of layers.) The hope was that in the simplest possible setting they could discover patterns that designate features. They ran countless experiments with no success. “We tried a whole bunch of stuff, and nothing was working. It looked like a bunch of random garbage,” says Tom Henighan, a member of Anthropic’s technical staff. Then a run dubbed “Johnny”—each experiment was assigned a random name—began associating neural patterns with concepts that appeared in its outputs.“Chris looked at it, and…