Language Modeling Reading List (to Start Your Paper Club)
24 May

Language Modeling Reading List (to Start Your Paper Club)

stp2y0 CommentsNews
Some friends and I started a weekly paper club to read and discuss fundamental papers in language modeling. By pooling together our shared knowledge, experience, and questions, we learned more as a group than we could have individually. To encourage others to do the same, here’s the list of papers we covered, and a one-sentence summary for each. I’ll update this list with new papers as we discuss them. (Also, why and how to read papers .) Attention Is All You Need: Query, Key, and Value are all you need* (*Also position embeddings, multiple heads, feed-forward layers, skip-connections, etc.) GPT:…
Read More
Scarlett Johansson’s OpenAI Feud Makes Her an Uncanny Folk Hero
24 May

Scarlett Johansson’s OpenAI Feud Makes Her an Uncanny Folk Hero

stp2y0 CommentsAI, , , , ,
There is a distinct moment in the Marvel Cinematic Universe when Black Widow became a hero for the everyfan. It happens early in 2012’s The Avengers: She’s tied to a chair. Agent Coulson calls. A nondescript military leader who has been interrogating her hands her the phone. Coulson explains that S.H.I.E.L.D. needs to pull her out of the field. She kicks her questioner in the shin, smashes the chair she’s tied to, takes out three dudes, grabs her heels, and leaves.The Avengers went on to make $1.5 billion globally and catapulted nearly everyone in it to superstardom, even the actors…
Read More
AI at the crossroads of cybersecurity, space and national security in the digital age
24 May

AI at the crossroads of cybersecurity, space and national security in the digital age

stp2y0 CommentsChat-GPT
Technological prowess, especially regarding humanity’s increased presence in space, is increasingly becoming the linchpin of global competitiveness and national security. There, new opportunities to integrate AI are accompanied by a new generation of risks. Artificial intelligence in particular plays a crucial role in democratizing access to space exploration and research, opening it to many beyond just governmental space agencies, as evidenced by the large number of commercially financed and operated space launches over the last five years. As launch companies adopt AI-enabled autonomous flight safety systems, Space Launch Delta 45 is saving on mission control chairs and looping out about…
Read More
Enterprises Have Just Two Years to Harness the Full Potential of GenAI: Genpact and HFS Report
24 May

Enterprises Have Just Two Years to Harness the Full Potential of GenAI: Genpact and HFS Report

stp2y0 CommentsViral News
(Berit Kessler/Shutterstock) The advent of GenAI has proven to be the first real innovation to disrupt industry since the advent of the internet. While GenAI is only over a year old, it has left enterprises scrambling to gain a competitive advantage. However, the window of opportunity for these enterprises may be shorter than anticipated. Enterprises have only two years to adopt GenAI before competitive disadvantages emerge, according to a new report by Genpact and HFS Research. The report also highlights that only 5% of enterprises have mature GenAI initiatives, signaling an urgent need for acceleration of GenAI adoption.  Genpact is…
Read More
Training Diffusion Models with Reinforcement Learning
24 May

Training Diffusion Models with Reinforcement Learning

stp2y0 CommentsAI, , , , ,
Training Diffusion Models with Reinforcement Learning replay Diffusion models have recently emerged as the de facto standard for generating complex, high-dimensional outputs. You may know them for their ability to produce stunning AI art and hyper-realistic synthetic images, but they have also found success in other applications such as drug design and continuous control. The key idea behind diffusion models is to iteratively transform random noise into a sample, such as an image or protein structure. This is typically motivated as a maximum likelihood estimation problem, where the model is trained to generate samples that match the training data as closely as…
Read More
24 May

PRECISE Seminar Talk “Evaluating and Calibrating AI Models with Uncertain Ground Truth” • David Stutz

stp2y0 CommentsGenAI
PRECISE Seminar Talk “Evaluating and Calibrating AI Models with Uncertain Ground Truth” I had the pleasure to present our work on evaluating and calibrating with uncertain ground truth at the seminar series of the PRECISE center at the University of Pennsylvania. Besides talking about our recent papers on evaluating AI models in health with uncertain ground truth and conformal prediction with uncertain ground truth, I also got to learn more about the research at PRECISE through post-doc and student presentations. In this article, I want to share the corresponding slides. Abstract For safety, AI systems in health undergo thorough evaluations…
Read More
We Stood on Both Sides of the New York–Dublin Portal and It Was Glorious
24 May

We Stood on Both Sides of the New York–Dublin Portal and It Was Glorious

stp2y0 CommentsRAG models, , , ,
Amanda: I got to the Portal in Manhattan’s Flatiron District a little before 11 am New York time, and found that there’s now a fence keeping people several feet away from it (but the same isn’t happening in Dublin). This is part of the new security the organizers have implemented: If someone steps on the Portal or blocks the camera, the livestream will blur for both sides, organizers say. For the next hour, a steady stream of people stopped by the Portal, with usually about 30 there at any time. They waved, they smiled, they danced YMCA and the Macarena…
Read More
Data Machina #248
24 May

Data Machina #248

stp2y0 CommentsViral News
Jailbreaking AI Models: It’s easy. Hundreds of millions of dollars have been thrown at AI Safety & Alignment over the years. Despite that, jailbreaking LLMs in April 2024 is easy. Oddly enough, as the LLM models become more capable and sophisticated, the jailbreaking attacks are becoming easier to perform, more effective, and frequent. Gary Marcus - who is hypercritical about LLMs and current AI trends- just published this very opinionated post: An unending array of jailbreaking attacks could be the death of LLMs.I often speak to colleagues and clients about the “LLM jailbreaking elephant in the room.” And they all…
Read More
Documentation enhancements for Deephaven Community | Deephaven
24 May

Documentation enhancements for Deephaven Community | Deephaven

stp2y0 CommentsNews
Deephaven's API continues to grow with each release, as does the base of documentation supporting it. In addition to documenting brand-new features, we continue to revise and expand existing documentation. Read on to learn about some of the most significant recent changes to the Deephaven documentation.Documentation of brand-new features includes:We've added a new section for Community Questions. Here, you'll find answers from the Deephaven team to frequently asked user questions. If you have a question, feel free to ask us on Slack.New additions to the Deephaven user guide include:New reference documents include:Deephaven's documentation team has been working hard on a…
Read More
No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.