If Scarlett Johansson can’t bring the AI firms to heel, what hope for the rest of us? | John Naughton

On Monday 13 May, OpenAI livestreamed an event to launch a fancy new product – a large language model (LLM) dubbed GPT-4o – that the company’s chief technology officer, Mira Murati, claimed to be more user-friendly and faster than boring ol’ ChatGPT. It was also more versatile, and multimodal, which is tech-speak for being able to interact in voice, text and vision. Key features of the new model, we were told, were that you could interrupt it in mid-sentence, that it had very low latency (delay in responding) and that it was sensitive to the user’s emotions.Viewers were then treated…
Read More

ArXiv Pre-Print “Evaluating AI Systems under Uncertain Ground Truth: a Case Study in Dermatology” • David Stutz

ArXiv Pre-Print “Evaluating AI Systems under Uncertain Ground Truth: a Case Study in Dermatology” In supervised machine learning, we usually assume access to ground truth label for evaluation. In many applications, however, these ground truth labels are derived from expert opinions. Disagreement among these experts is typically ignored using simple majority voting or averaging. Unfortunately, this can have severe consequences by over-estimating performance or mis-guiding model selection. In our work presented in this article, we tackle this problem by introducing a statistical framework for aggregating expert opinions. Abstract For safety, AI systems in health undergo thorough evaluations before deployment, validating…
Read More
Data Machina #246

Data Machina #246

New Trends in Vision-Language Models (VLMs.) The evolution of VLMs in recent months has been pretty impressive. Today VLMs exhibit some amazing capabilities. See the two links below on what VLMs can do and how they work:But still VLMs are facing some challenges for example in terms of: multimodal training datasets, resolution, long-form modality, vision-language integration, and concept understanding. Somewhat along those lines, I see 5 trends happening in VLMs: 1) VLMs run on local environment 2) Emerging VLM videoagents 3) Unified structure learning for VLMs 4) Personalisation of VLMs and 5) Fixing the VLM resolution curse. Let’s see…VLMs on…
Read More
The AI Revolution Will Not Be Monopolized: Behind the scenes

The AI Revolution Will Not Be Monopolized: Behind the scenes

FabNER Claude 2 accuracy on # of examples 10 20 30 40 50 60 70 80 90 100 0 100 200 300 400 500 20 examples F-Score Speed (words/s) GPT-3.5 1 78.6 < 100 GPT-4 1 83.5 < 100 spaCy 91.6 4,000 Flair 93.1 1,000 SOTA 2023 2 94.6 1,000 SOTA 2003 3 88.8 > 20,000 1. Ashok and Lipton (2023), 2. Wang et al. (2021), 3. Florian et al. (2003) SOTA on few- shot prompting RoBERTa-base * * EXPERIMENTS * * * EXPERIMENTS * * * EXPERIMENTS * * * CoNLL 2003: Named Entity Recognition Source link lol
Read More
Viruses are doing mysterious things everywhere – AI can help researchers understand what they’re up to in the oceans and in your gut

Viruses are doing mysterious things everywhere – AI can help researchers understand what they’re up to in the oceans and in your gut

Viruses are a mysterious and poorly understood force in microbial ecosystems. Researchers know they can infect, kill and manipulate human and bacterial cells in nearly every environment, from the oceans to your gut. But scientists don’t yet have a full picture of how viruses affect their surrounding environments in large part because of their extraordinary diversity and ability to rapidly evolve. Communities of microbes are difficult to study in a laboratory setting. Many microbes are challenging to cultivate, and their natural environment has many more features influencing their success or failure than scientists can replicate in a lab. So systems…
Read More
PeerDB raises $3.6M to accelerate PostgreSQL data movement – SiliconANGLE

PeerDB raises $3.6M to accelerate PostgreSQL data movement – SiliconANGLE

Startup PeerDB Inc., which has built a data movement platform specifically for open-source PostgreSQL database management systems, said today it has closed on a seed funding round worth $3.6 million. Leading the investment was 8VC, and it was joined by Y Combinator, Wayfinder Ventures, Webb Investment Network, Flex Capital, Rogue Capital, Pioneer Fund, Orange Collective and several angel investors. PeerDB says its data movement platform is designed to improve on the capabilities of existing data pipelines that were never designed for Postgres databases. Existing data movement and extract, transform and load or ETL tools often prioritize the sheer number of connectors…
Read More
Coding With Devin: My New AI Programming Agent

Coding With Devin: My New AI Programming Agent

Sponsored By: Reflect This essay is brought to you by Reflect, an ultra-fast notes app with an AI assistant built in directly. Simplify your note-taking with Reflect's advanced features, like custom prompts, voice transcription, and the ability to chat with your notes effortlessly. Elevate your productivity and organization with Reflect. Was this newsletter forwarded to you? Sign up to get it in your inbox.We onboarded four new engineers at Every this week. The onboarding process was what you'd expect. I gave them access to our GitHub account so they could download our main code repos. I was peppered with the usual…
Read More
AI vs. Humanity: Who Will Come Out on Top?

AI vs. Humanity: Who Will Come Out on Top?

The below is a summary of my recent article on superintelligence. Elon Musk predicts that Artificial Superintelligence (ASI) will emerge by 2025, much earlier than his previous estimates. While Musk's track record with predictions is mixed, this one sparks serious contemplation about the future. The moment AI surpasses human cognitive abilities, known as the singularity, will usher in a new era with both unprecedented possibilities and profound perils. As we edge closer to this event horizon, it's essential to ask if we are prepared to navigate the uncertainties and harness the potential of AI responsibly. The journey towards ASI has…
Read More
Generating 3D Molecular Conformers via Equivariant Coarse-Graining and Aggregated Attention

Generating 3D Molecular Conformers via Equivariant Coarse-Graining and Aggregated Attention

Figure 1: CoarsenConf architecture. Molecular conformer generation is a fundamental task in computational chemistry. The objective is to predict stable low-energy 3D molecular structures, known as conformers, given the 2D molecule. Accurate molecular conformations are crucial for various applications that depend on precise spatial and geometric qualities, including drug discovery and protein docking. We introduce CoarsenConf, an SE(3)-equivariant hierarchical variational autoencoder (VAE) that pools information from fine-grain atomic coordinates to a coarse-grain subgraph level representation for efficient autoregressive conformer generation. (more…)
Read More
Are open foundation models more risky than closed ones?

Are open foundation models more risky than closed ones?

Some of the most pressing questions in artificial intelligence concern the future of open foundation models (FMs). Do these models pose risks so large that we must attempt to stop their proliferation? Or are the risks overstated and the benefits under emphasized? Earlier this week, in collaboration with Stanford HAI, CRFM, and RegLab, we released a policy brief addressing these questions. The brief is based on lessons from a workshop we organized this September and our work since. It outlines the current evidence on the risk of open FMs and some recommendations for policymakers on how to reason about the risks…
Read More
No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.