stp2y - CybAI news

21 May

The Shift from Models to Compound AI Systems

stp2y0 CommentsAIai routers, compound ai systems, dspy, frugalgpt

AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to perform general tasks, such as translation or coding, just by prompting. This naturally led to an intense focus on models as the primary ingredient in AI application development, with everyone wondering what capabilities new LLMs will bring. As more developers begin to build using LLMs, however, we believe that this focus is rapidly changing: state-of-the-art AI results are increasingly obtained by compound systems with multiple components, not just monolithic models. For example, Google’s AlphaCode 2 set state-of-the-art results in programming through a carefully engineered…

21 May

‘People are going to try to steal your secrets’ Dixon warns

stp2y0 CommentsChat-GPT

Kissimmee, Fla. – As U.S. intelligence agencies increase their reliance on commercial geospatial products and services, cybersecurity becomes a growing concern. “We create so many innovative solutions here in this country,” Stacey Dixon, U.S. deputy director of national intelligence, said May 6 at the 2024 GEOINT Symposium here. “Yet we lose a lot of that innovation to adversaries because we aren’t properly protecting it. Invest in your cybersecurity. Understand that people are going to try to steal your secrets.” Potential adversaries will seek access to commercial products directly as well as through intermediaries. Figure out how to prevent that, “because…

21 May

Scaling ML Experiments With neptune.ai and Kubernetes

stp2y0 CommentsGenAI

Scaling machine learning (ML) experiments is a challenging process that requires efficient resource management, experiment tracking, and infrastructure scalability. neptune.ai offers a centralized platform to manage ML experiments, track real-time model performance, and store metadata. Kubernetes automates container orchestration, improves resource utilization, and enables horizontal and vertical scalability. Combining neptune.ai and Kubernetes provides a robust solution for scaling ML experiments, making it easier to manage and scale experiments across multiple environments and team members. Scaling machine-learning experiments efficiently is a challenge for ML teams. The complexity lies in managing configurations, launching experiment runs, tracking their outcomes, and optimizing resource allocation.…

21 May

Measuring personal growth

stp2y0 CommentsRAG models

My founder friends constantly think about growth. They think about how to measure their business growth and how to get to the next order of magnitude scale. If they’re making $1M ARR today, they think about how to get to $10M ARR. If they have 1,000 users today, they think about how to get to 10,000 users. This made me wonder if/how people are measuring personal growth. I don’t want to use metrics like net worth or the number of followers, because that’s not what I live for. After talking with a lot of friends, I found three interesting metrics:…

21 May

Unveiling the Criticality of Red Teaming for Generative AI Governance

stp2y0 CommentsViral News

As generative artificial intelligence (AI) systems become increasingly ubiquitous, their potential impact on society amplifies. These advanced language models possess remarkable capabilities, yet their inherent complexities raise concerns about unintended consequences and potential misuse. Consequently, the evolution of generative AI necessitates robust governance mechanisms to ensure responsible development and deployment. One crucial component of this governance framework is red teaming – a proactive approach to identifying and mitigating vulnerabilities and risks associated with these powerful technologies. Demystifying Red Teaming Red teaming is a cybersecurity practice that simulates real-world adversarial tactics, techniques, and procedures (TTPs) to evaluate an organization's defenses and…

21 May

Databricks

stp2y0 CommentsNews

Databricks is the second company in Generational’s late-stage company series. This was fun to write. As part of the research, I got the Lakehouse and Generative AI Fundamentals badges from Databricks Academy. Disclaimer: I have a financial interest in Databricks. Don’t take this as investment advice.In this deep dive, you’ll learn insights from conversations with many of Databricks’ customers and ex-employees. I want to thank Tegus for giving me access to their centralized expert call transcripts. With a platform as broad as Databricks, it is almost impossible to parse signal from the noise without primary research. If you’re curious about…

21 May

How LotteON built a personalized recommendation system using Amazon SageMaker and MLOps | Amazon Web Services

stp2y0 CommentsAI

This post is co-written with HyeKyung Yang, Jieun Lim, and SeungBum Shim from LotteON. LotteON aims to be a platform that not only sells products, but also provides a personalized recommendation experience tailored to your preferred lifestyle. LotteON operates various specialty stores, including fashion, beauty, luxury, and kids, and strives to provide a personalized shopping experience across all aspects of customers’ lifestyles. To enhance the shopping experience of LotteON’s customers, the recommendation service development team is continuously improving the recommendation service to provide customers with the products they are looking for or may be interested in at the right time.…

21 May

ChatGPT suspends Scarlett Johansson-like voice as actor speaks out against OpenAI

stp2y0 CommentsChat-GPT

Scarlett Johansson has spoken out against OpenAI after the company used a voice eerily resembling her own in its new ChatGPT product.The actor said in a statement she was approached by OpenAI nine months ago to voice its AI system but declined for “personal reasons”. Johansson was “shocked” and “angered” when she heard the voice option, which “sounded so eerily similar to mine that my closest friends and news outlets could not tell the difference,” she said.OpenAI removed a heavily promoted voice option from ChatGPT on Monday, following a widespread reaction and comparisons to Johansson to the flirtatious, feminine voice…

21 May

FAQ for our Monte Carlo Conformal Prediction • David Stutz

stp2y0 CommentsGenAI

Over the past months, I have given several talks about Monte Carlo conformal prediction and the problem of calibrating with uncertain ground truth, for example, stemming from annotator disagreement. Each time, the audience had great questions and ideas for extensions and interesting applications. In this article, I want to provide a sort of FAQ for our work. Are code and data available? Yes, code and data are on GitHub. Code includes both Monte Carlo conformal prediction as well as the plausibility regions from v1 of the paper. Can you derive the conformal $p$-values used in the paper? The connection of…

21 May

Transcript: Kevin Roose Has 18 New Best Friends—And They’re All AIs

stp2y0 CommentsRAG models

The transcript of How Do You Use ChatGPT? with Kevin Roose is below for paying subscribers. Subscribe now Timestamps Introduction: 00:01:11 The surprising allure of relationships with AI personas: 00:03:47 The icks of AI dating and intimacy: 00:09:50 Risks of young people relying on AI for friendship: 00:14:05 Kevin screenshares a historical chat with an AI friend: 00:17:39 Why an AI persona makes for a better friend than ChatGPT: 00:21:46 Why Kevin thinks AI personas won’t substitute real friends just yet: 00:31:14 Kevin’s AI toolkit: 00:33:11 How Kevin thinks about using AI as part of his writing process: 00:41:15 Comparing…