GenAI

Robot identifies plants by ‘touching’ their leaves

Robot identifies plants by ‘touching’ their leaves

Researchers in China have developed a robot that identifies different plant species at various stages of growth by "touching" their leaves with an electrode. The robot can measure properties such as surface texture and water content that cannot be determined using existing visual approaches, according to the study, published November 13 in the journal Device. The robot identified ten different plant species with an average accuracy of 97.7% and identified leaves of the flowering bauhinia plant with 100% accuracy at various growth stages. Eventually, large-scale farmers and agricultural researchers could use the robot to monitor the health and growth of…
Read More
Chip Design Program Empowers the Apple Workforce of Tomorrow

Chip Design Program Empowers the Apple Workforce of Tomorrow

The U.S. has struggled with a worker shortage in semiconductor chip making, and even educating people about the field’s existence has proved challenging. In response, Apple and other companies have dedicated considerable money and time to addressing the skills gap and broken pipeline. Apple began the New Silicon Initiative, a series of grants to tech-focused universities nationwide, to develop more skilled workers in designing and manufacturing chips. The initiative funds education and training in microelectronic circuits and hardware design. Eight universities participate, chosen for their engineering savvy and commitment to scaling up courses in creating integrated circuits. One participant is…
Read More
The First Entirely AI-Generated Video Game Is Insanely Weird and Fun

The First Entirely AI-Generated Video Game Is Insanely Weird and Fun

Minecraft remains remarkably popular a decade or so after it was first released, thanks to a unique mix of quirky gameplay and open world building possibilities.A knock-off called Oasis, released last month, captures much of the original game’s flavor with a remarkable and weird twist. The entire game is generated not by a game engine and hand-coded rules, but by an AI model that dreams up each frame.Oasis was built by an Israeli AI startup called Decart in collaboration with Etched, a company that designs custom silicon, to demonstrate the potential of hardware optimized to power transformer-based AI algorithms.Oasis uses…
Read More
Partially rewriting an LLM in natural language

Partially rewriting an LLM in natural language

Our most recent work on using sparse autoencoders (SAEs) focused on automatically generating natural language interpretations for their latents and evaluating how good they are. If all the latents were interpretable, we could use the interpretations to simulate the latent activations, replacing the SAE encoder with an LLM and a natural language prompt. We should then be able to patch the activations generated by this natural language simulation back into the model and get nearly identical behavior to the original. In the limit, we could effectively "rewrite" the entire model in terms of interpretable features and interpretable operations on those…
Read More
Slack Report: Is AI Adoption Heading for a Plateau?

Slack Report: Is AI Adoption Heading for a Plateau?

The hype around generative AI may be starting to cool, according to a new Slack report. The survey of more than 17,000 desk workers worldwide, published on Nov. 12, revealed a disconnect between AI aspirations and adoption rates. The report focused on barriers to AI adoption at work and how leaders can clarify questions about it. The slight dip in global interest is notable after nearly a year of increased excitement around AI. “AI adoption isn’t just about enterprises, it’s also about employees,” said Christina Janzer, head of Slack’s Workforce Lab, in a press release. “With sentiment around AI dropping,…
Read More
Giving robots superhuman vision using radio signals

Giving robots superhuman vision using radio signals

In the race to develop robust perception systems for robots, one persistent challenge has been operating in bad weather and harsh conditions. For example, traditional, light-based vision sensors such as cameras or LiDAR (Light Detection And Ranging) fail in heavy smoke and fog. However, nature has shown that vision doesn't have to be constrained by light's limitations -- many organisms have evolved ways to perceive their environment without relying on light. Bats navigate using the echoes of sound waves, while sharks hunt by sensing electrical fields from their prey's movements. Radio waves, whose wavelengths are orders of magnitude longer than…
Read More
Open-Sourcing Relabeled MedQA and Dermatology DDx Datasets • David Stutz

Open-Sourcing Relabeled MedQA and Dermatology DDx Datasets • David Stutz

Dealing with rater disagreement is becoming more important in AI, especially for LLMs and in specialized domains such as health. In the past year, I helped open source two datasets allowing to study rater disagreement in the health domain: a relabeling of MedQA, a key benchmark for evaluating medical LLMs, and a dataset including differential diagnosis ratings for skin condition classification. Both are available on GitHub. Handling rater disagreement is becoming more important, especially for evaluating large language models (LLMs) but also in domains such as health. In the past few years, I was involved in various projects that had…
Read More
AI can detect serious neurologic changes in babies in the NICU using video data alone

AI can detect serious neurologic changes in babies in the NICU using video data alone

A team of clinicians, scientists, and engineers at Mount Sinai trained a deep learning pose-recognition algorithm on video feeds of infants in the neonatal intensive care unit (NICU) to accurately track their movements and identify key neurologic metrics. Findings from this new artificial intelligence (AI)-based tool, published November 11 in Lancet's eClinicalMedicine, could lead to a minimally invasive, scalable method for continuous neurologic monitoring in NICUs, providing critical real-time insights into infant health that have not been possible before. Every year, more than 300,000 newborns are admitted to NICUs across the United States. Infant alertness is considered the most sensitive…
Read More
Robot that watched surgery videos performs with skill of human doctor, researchers report

Robot that watched surgery videos performs with skill of human doctor, researchers report

A robot, trained for the first time by watching videos of seasoned surgeons, executed the same surgical procedures as skillfully as the human doctors. The successful use of imitation learning to train surgical robots eliminates the need to program robots with each individual move required during a medical procedure and brings the field of robotic surgery closer to true autonomy, where robots could perform complex surgeries without human help. "It's really magical to have this model and all we do is feed it camera input and it can predict the robotic movements needed for surgery," said senior author Axel Krieger.…
Read More
No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.