Viral News - CybAI news

27 May

Research Survey: Productivity benefits from Databricks Assistant

stp2y0 CommentsViral News

In the fast-paced landscape of data science and engineering, integrating Artificial Intelligence (AI) has become integral for enhancing productivity. We’ve seen many tools emerge and transform the lives of data practitioners, making complex tasks easier and encouraging innovation. When we launched Databricks Assistant in Public Preview in July of 2023, we designed it exclusively for streamlining efficiency amongst data scientists, analysts, and engineers. To better understand how well we’re achieving this goal, we decided to survey some of our top users across multiple organizations, varying in experience. Purpose of the SurveyTo better understand Databricks Assistant’s impact on data professionals, we meticulously…

26 May

Data Machina #241

stp2y0 CommentsViral News

AI World Models and Video. My world vision model for waking up at 4am to travel overseas is frankly a bit fuzzy and unreliable. But What’s an AI world model? My 2 cents explainer: It’s a model that builds an internal representation of a real-world, physical, [human] environment, and uses that to predict or simulate future events within that environment.Until recently, research in AI world models has been very much focused on video games and Reinforcement Learning. But now, the boom of GenAI and large multi-modal models have triggered a new trend in AI world models based on large scale…

26 May

How a Leading Venture Capital Firm is Building GenAI with Databricks

stp2y0 CommentsViral News

Successfully building GenAI applications means going beyond just leveraging the latest cutting-edge models. It requires the development of compound AI systems that integrate data, models, and infrastructure in a flexible, scalable, and production-ready way. This entails access to both open source and proprietary models, vector databases, the ability to fine-tune models and query structured data, create endpoints, prepare data, manage costs, and monitor solutions.In this blog, we’ll walk through the GenAI transformation for a leading venture capital firm (referred to as "VC" throughout the blog) that is also an investor in Databricks. In addition to driving innovation internally, this VC…

26 May

Data Machina #242

stp2y0 CommentsViral News

AI and Causality. The introduction of OpenAI Sora (simulate real worlds from video understanding) has sparked a bit of a debate among some prominent AI researchers. First, What do AI researchers mean by “causal”?Secondly: Do LLMs have causal reasoning capabilities? Can LLMs learn causality from just real world training data? Can LLMs learn, represent, and understand world models and physics? Judea Pearl - a world’s top researchers in Probabilistic AI, Bayesian Networks, and Causal Inference- once famously said in an interview:Deep Learning -albeit complex and non-trivial- it’s a curve fitting exercise. To build truly Intelligent Machines, teach them cause and…

26 May

Databricks Is a Glassdoor Best-Led Company in 2024

stp2y0 CommentsViral News

Databricks is pleased to announce we are ranked #2 in the inaugural annual Glassdoor Award List of Best-Led Companies in 2024! At Databricks, we're not just building cutting-edge technology; we're cultivating a culture of transparency. Our leadership mirrors our internal commitment to collaborative and transparent work practices. Databricks, a Glassdoor Best-Led CompanyOur CEO and Co-founder Ali Ghodsi’s leadership is rooted in truth-seeking and first principles thinking, two of Databricks’ core values that stay true to our origins in academia. As Databricks has grown, we’ve strived to maintain the open and transparent culture we had in our early days at the AMP research lab in UC Berkeley.…

26 May

Data Machina #254

stp2y0 CommentsViral News

On the State of AI Coding Agents. “How could we start using AI to migrate years of messy, flimsy legacy code to a modern stack? ... Perhaps an AI Code Migration Agent ???” We’re doing AI chat & espresso at Level 39, One Canada Square. James -a veteran CTO with all the scars- is asking these rather funny, rhetorical questions. There is a deep silence in the room, pensive faces around. Everyone is staring through the massive windows overlooking The City skyline as the sunset strikes. We wonder in perplexity -in the very philosophical and information theory sense- whether AI…

26 May

Semiconductors on the Data Intelligence Platform

stp2y0 CommentsViral News

In the semiconductor industry, research and development tasks, manufacturing processes, and enterprise planning systems produce an array of data artifacts that can be fused to create an intelligent semiconductor enterprise. Through intelligent data use, an intelligent semiconductor enterprise accelerates time to market, increases manufacturing yield, and enhances product reliability.The Databricks Intelligence Platform suits semiconductor enterprises’ unique needs for performance, collaboration, and self-service access. Built on a lakehouse architecture with leading technologies of Delta Lake, Apache Spark™, MLflow, Mosaic AI, and Unity Catalog, the Data Intelligence Platform is the substrate for semiconductor companies to connect engineering technology (ET), operational technology (OT),…

26 May

Data Machina #243

stp2y0 CommentsViral News

Beyond GenAI & LLMs. GenAI & LLMs have literally kidnapped the DL/ML space, and pretty much sucked all the investment and top AI minds, as if there is nothing else under the sun. There are literally hundreds of GenAI models out there. Many of these GenAI models have questionable value or are a repeat-rinse-recycle of the same. Checkout this mega spreadsheet: An Annotated and Updated Directory of GenAI Models. So: Many DL/ML researchers are starting to question the LLM status quo: Shouldn’t we focus $ and brains in new, alt AI/DL paradigms beyond LLMs? And: Do we need so many…

26 May

Unlocking the Potential of Private Data Sharing using Databricks Private Exchanges

stp2y0 CommentsViral News

We are thrilled to announce an exciting new feature on the Databricks Marketplace that simplifies the process of setting up private exchanges for all Databricks customers. With this feature, becoming a Private Exchange provider is easier than ever.In this blog post, we will delve deeply into the private exchange features of the Databricks Marketplace. We'll compare various exchange mechanisms—public marketplace and private exchanges—and examine the newly introduced feature that simplifies becoming a private exchange provider.Comparing Private Exchange and Public MarketplaceIn the evolving data sharing and monetization landscape, companies have multiple avenues to distribute their data and AI models. Each method…

26 May

Data Machina #244

stp2y0 CommentsViral News

AI Reasoning Like Humans. The storm has been battering the airport viciously. Three hours later we departed enduring some massive turbulences. Then this: “Captain speaking. This is to inform you that we’ll be performing an auto-pilot landing [watch this] upon arriving to Heathrow.” We should trust the AI-copilot reasoning in harsh situations. Shouldn’t we?… Five days ago, Anthropic introduced next-gen Claude 3 model family. I’ve tried Claude 3: It’s very good at certain language tasks, it pars or beats GPT-4 Turbo in several areas, has a huge context window, and it’s quite cheaper. Funnily enough, it miserably failed at a…