Reflections On Qualtrics X4: AI-Powered Research Is Promising If We Stick To The Research Basics

Reflections On Qualtrics X4: AI-Powered Research Is Promising If We Stick To The Research Basics

Qualtrics introduced its AI-powered Strategy & Research suite at its summit, X4, and launched its “Strategic UX” product — officially entering the experience research space. The new product supports various UX research methods like video feedback, unmoderated usability testing, card sorting, and tree testing, and it leverages AI to generate insights and recommended actions. Adding UX research to its experience management solutions, Qualtrics aims to support organizations’ research efforts at scale with a single platform.  Qualtrics AI was the highlight of the event as it aims to help users get deeper insights through interactive dashboards, data analysis, and recommendations on…
Read More
The Shift from Models to Compound AI Systems

The Shift from Models to Compound AI Systems

AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to perform general tasks, such as translation or coding, just by prompting. This naturally led to an intense focus on models as the primary ingredient in AI application development, with everyone wondering what capabilities new LLMs will bring. As more developers begin to build using LLMs, however, we believe that this focus is rapidly changing: state-of-the-art AI results are increasingly obtained by compound systems with multiple components, not just monolithic models. For example, Google’s AlphaCode 2 set state-of-the-art results in programming through a carefully engineered…
Read More
‘People are going to try to steal your secrets’ Dixon warns

‘People are going to try to steal your secrets’ Dixon warns

Kissimmee, Fla. – As U.S. intelligence agencies increase their reliance on commercial geospatial products and services, cybersecurity becomes a growing concern. “We create so many innovative solutions here in this country,” Stacey Dixon, U.S. deputy director of national intelligence, said May 6 at the 2024 GEOINT Symposium here. “Yet we lose a lot of that innovation to adversaries because we aren’t properly protecting it. Invest in your cybersecurity. Understand that people are going to try to steal your secrets.” Potential adversaries will seek access to commercial products directly as well as through intermediaries. Figure out how to prevent that, “because…
Read More
Scaling ML Experiments With neptune.ai and Kubernetes

Scaling ML Experiments With neptune.ai and Kubernetes

Scaling machine learning (ML) experiments is a challenging process that requires efficient resource management, experiment tracking, and infrastructure scalability. neptune.ai offers a centralized platform to manage ML experiments, track real-time model performance, and store metadata. Kubernetes automates container orchestration, improves resource utilization, and enables horizontal and vertical scalability. Combining neptune.ai and Kubernetes provides a robust solution for scaling ML experiments, making it easier to manage and scale experiments across multiple environments and team members. Scaling machine-learning experiments efficiently is a challenge for ML teams. The complexity lies in managing configurations, launching experiment runs, tracking their outcomes, and optimizing resource allocation.…
Read More
Measuring personal growth

Measuring personal growth

My founder friends constantly think about growth. They think about how to measure their business growth and how to get to the next order of magnitude scale. If they’re making $1M ARR today, they think about how to get to $10M ARR. If they have 1,000 users today, they think about how to get to 10,000 users. This made me wonder if/how people are measuring personal growth. I don’t want to use metrics like net worth or the number of followers, because that’s not what I live for. After talking with a lot of friends, I found three interesting metrics:…
Read More
Unveiling the Criticality of Red Teaming for Generative AI Governance

Unveiling the Criticality of Red Teaming for Generative AI Governance

As generative artificial intelligence (AI) systems become increasingly ubiquitous, their potential impact on society amplifies. These advanced language models possess remarkable capabilities, yet their inherent complexities raise concerns about unintended consequences and potential misuse. Consequently, the evolution of generative AI necessitates robust governance mechanisms to ensure responsible development and deployment. One crucial component of this governance framework is red teaming – a proactive approach to identifying and mitigating vulnerabilities and risks associated with these powerful technologies. Demystifying Red Teaming Red teaming is a cybersecurity practice that simulates real-world adversarial tactics, techniques, and procedures (TTPs) to evaluate an organization's defenses and…
Read More
Databricks

Databricks

Databricks is the second company in Generational’s late-stage company series. This was fun to write. As part of the research, I got the Lakehouse and Generative AI Fundamentals badges from Databricks Academy. Disclaimer: I have a financial interest in Databricks. Don’t take this as investment advice.In this deep dive, you’ll learn insights from conversations with many of Databricks’ customers and ex-employees. I want to thank Tegus for giving me access to their centralized expert call transcripts. With a platform as broad as Databricks, it is almost impossible to parse signal from the noise without primary research. If you’re curious about…
Read More
How LotteON built a personalized recommendation system using Amazon SageMaker and MLOps | Amazon Web Services

How LotteON built a personalized recommendation system using Amazon SageMaker and MLOps | Amazon Web Services

This post is co-written with HyeKyung Yang, Jieun Lim, and SeungBum Shim from LotteON. LotteON aims to be a platform that not only sells products, but also provides a personalized recommendation experience tailored to your preferred lifestyle. LotteON operates various specialty stores, including fashion, beauty, luxury, and kids, and strives to provide a personalized shopping experience across all aspects of customers’ lifestyles. To enhance the shopping experience of LotteON’s customers, the recommendation service development team is continuously improving the recommendation service to provide customers with the products they are looking for or may be interested in at the right time.…
Read More

ChatGPT suspends Scarlett Johansson-like voice as actor speaks out against OpenAI

Scarlett Johansson has spoken out against OpenAI after the company used a voice eerily resembling her own in its new ChatGPT product.The actor said in a statement she was approached by OpenAI nine months ago to voice its AI system but declined for “personal reasons”. Johansson was “shocked” and “angered” when she heard the voice option, which “sounded so eerily similar to mine that my closest friends and news outlets could not tell the difference,” she said.OpenAI removed a heavily promoted voice option from ChatGPT on Monday, following a widespread reaction and comparisons to Johansson to the flirtatious, feminine voice…
Read More

FAQ for our Monte Carlo Conformal Prediction • David Stutz

Over the past months, I have given several talks about Monte Carlo conformal prediction and the problem of calibrating with uncertain ground truth, for example, stemming from annotator disagreement. Each time, the audience had great questions and ideas for extensions and interesting applications. In this article, I want to provide a sort of FAQ for our work. Are code and data available? Yes, code and data are on GitHub. Code includes both Monte Carlo conformal prediction as well as the plausibility regions from v1 of the paper. Can you derive the conformal $p$-values used in the paper? The connection of…
Read More
No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.