Viral News

Data Machina #240
27 May

Data Machina #240

stp2y0 CommentsViral News
Foundation Models, Transformers and Time-Series. Statisticians and econometricians have been searching for the Holy Grail of time-series forecasting (TSF) for more than 40 years. “Classical” models like ARIMA still work remarkably well in some TSF scenarios. But today, the cool stuff is all about transformer-based, DL & foundation models for TSF. How “good” are these new DL models for TSF? How do we evaluate these models? Do these new models really achieve SOTA performance as some papers claim? Are DL researchers cherrypicking ts datasets to easily fit a SOTA TSF DL model?...Real world time-series data is complex, messy, and it…
Read More
Research Survey: Productivity benefits from Databricks Assistant
27 May

Research Survey: Productivity benefits from Databricks Assistant

stp2y0 CommentsViral News
In the fast-paced landscape of data science and engineering, integrating Artificial Intelligence (AI) has become integral for enhancing productivity. We’ve seen many tools emerge and transform the lives of data practitioners, making complex tasks easier and encouraging innovation. When we launched Databricks Assistant in Public Preview in July of 2023, we designed it exclusively for streamlining efficiency amongst data scientists, analysts, and engineers. To better understand how well we’re achieving this goal, we decided to survey some of our top users across multiple organizations, varying in experience. Purpose of the SurveyTo better understand Databricks Assistant’s impact on data professionals, we meticulously…
Read More
Data Machina #241
26 May

Data Machina #241

stp2y0 CommentsViral News
AI World Models and Video. My world vision model for waking up at 4am to travel overseas is frankly a bit fuzzy and unreliable. But What’s an AI world model? My 2 cents explainer: It’s a model that builds an internal representation of a real-world, physical, [human] environment, and uses that to predict or simulate future events within that environment.Until recently, research in AI world models has been very much focused on video games and Reinforcement Learning. But now, the boom of GenAI and large multi-modal models have triggered a new trend in AI world models based on large scale…
Read More
How a Leading Venture Capital Firm is Building GenAI with Databricks
26 May

How a Leading Venture Capital Firm is Building GenAI with Databricks

stp2y0 CommentsViral News
Successfully building GenAI applications means going beyond just leveraging the latest cutting-edge models. It requires the development of compound AI systems that integrate data, models, and infrastructure in a flexible, scalable, and production-ready way. This entails access to both open source and proprietary models, vector databases, the ability to fine-tune models and query structured data, create endpoints, prepare data, manage costs, and monitor solutions.In this blog, we’ll walk through the GenAI transformation for a leading venture capital firm (referred to as "VC" throughout the blog) that is also an investor in Databricks. In addition to driving innovation internally, this VC…
Read More
Data Machina #242
26 May

Data Machina #242

stp2y0 CommentsViral News
AI and Causality. The introduction of OpenAI Sora (simulate real worlds from video understanding) has sparked a bit of a debate among some prominent AI researchers. First, What do AI researchers mean by “causal”?Secondly: Do LLMs have causal reasoning capabilities? Can LLMs learn causality from just real world training data? Can LLMs learn, represent, and understand world models and physics? Judea Pearl - a world’s top researchers in Probabilistic AI, Bayesian Networks, and Causal Inference- once famously said in an interview:Deep Learning -albeit complex and non-trivial- it’s a curve fitting exercise. To build truly Intelligent Machines, teach them cause and…
Read More
Databricks Is a Glassdoor Best-Led Company in 2024
26 May

Databricks Is a Glassdoor Best-Led Company in 2024

stp2y0 CommentsViral News
Databricks is pleased to announce we are ranked #2 in the inaugural annual Glassdoor Award List of  Best-Led Companies in 2024! At Databricks, we're not just building cutting-edge technology; we're cultivating a culture of transparency. Our leadership mirrors our internal commitment to collaborative and transparent work practices. Databricks, a Glassdoor Best-Led CompanyOur CEO and Co-founder Ali Ghodsi’s leadership is rooted in truth-seeking and first principles thinking, two of Databricks’ core values that stay true to our origins in academia. As Databricks has grown, we’ve strived to maintain the open and transparent culture we had in our early days at the AMP research lab in UC Berkeley.…
Read More
Data Machina #254
26 May

Data Machina #254

stp2y0 CommentsViral News
On the State of AI Coding Agents. “How could we start using AI to migrate years of messy, flimsy legacy code to a modern stack? ... Perhaps an AI Code Migration Agent ???” We’re doing AI chat & espresso at Level 39, One Canada Square. James -a veteran CTO with all the scars- is asking these rather funny, rhetorical questions. There is a deep silence in the room, pensive faces around. Everyone is staring through the massive windows overlooking The City skyline as the sunset strikes. We wonder in perplexity -in the very philosophical and information theory sense- whether AI…
Read More
Semiconductors on the Data Intelligence Platform
26 May

Semiconductors on the Data Intelligence Platform

stp2y0 CommentsViral News
In the semiconductor industry, research and development tasks, manufacturing processes, and enterprise planning systems produce an array of data artifacts that can be fused to create an intelligent semiconductor enterprise. Through intelligent data use, an intelligent semiconductor enterprise accelerates time to market, increases manufacturing yield, and enhances product reliability.The Databricks Intelligence Platform suits semiconductor enterprises’ unique needs for performance, collaboration, and self-service access. Built on a lakehouse architecture with leading technologies of Delta Lake, Apache Spark™, MLflow, Mosaic AI, and Unity Catalog, the Data Intelligence Platform is the substrate for semiconductor companies to connect engineering technology (ET), operational technology (OT),…
Read More
Data Machina #243
26 May

Data Machina #243

stp2y0 CommentsViral News
Beyond GenAI & LLMs. GenAI & LLMs have literally kidnapped the DL/ML space, and pretty much sucked all the investment and top AI minds, as if there is nothing else under the sun. There are literally hundreds of GenAI models out there. Many of these GenAI models have questionable value or are a repeat-rinse-recycle of the same. Checkout this mega spreadsheet: An Annotated and Updated Directory of GenAI Models. So: Many DL/ML researchers are starting to question the LLM status quo: Shouldn’t we focus $ and brains in new, alt AI/DL paradigms beyond LLMs? And: Do we need so many…
Read More
Unlocking the Potential of Private Data Sharing using Databricks Private Exchanges
26 May

Unlocking the Potential of Private Data Sharing using Databricks Private Exchanges

stp2y0 CommentsViral News
We are thrilled to announce an exciting new feature on the Databricks Marketplace that simplifies the process of setting up private exchanges for all Databricks customers. With this feature, becoming a Private Exchange provider is easier than ever.In this blog post, we will delve deeply into the private exchange features of the Databricks Marketplace. We'll compare various exchange mechanisms—public marketplace and private exchanges—and examine the newly introduced feature that simplifies becoming a private exchange provider.Comparing Private Exchange and Public MarketplaceIn the evolving data sharing and monetization landscape, companies have multiple avenues to distribute their data and AI models. Each method…
Read More
No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.