Viral News

Unlocking the Potential of Private Data Sharing using Databricks Private Exchanges

Unlocking the Potential of Private Data Sharing using Databricks Private Exchanges

We are thrilled to announce an exciting new feature on the Databricks Marketplace that simplifies the process of setting up private exchanges for all Databricks customers. With this feature, becoming a Private Exchange provider is easier than ever.In this blog post, we will delve deeply into the private exchange features of the Databricks Marketplace. We'll compare various exchange mechanisms—public marketplace and private exchanges—and examine the newly introduced feature that simplifies becoming a private exchange provider.Comparing Private Exchange and Public MarketplaceIn the evolving data sharing and monetization landscape, companies have multiple avenues to distribute their data and AI models. Each method…
Read More
Data Machina #244

Data Machina #244

AI Reasoning Like Humans. The storm has been battering the airport viciously. Three hours later we departed enduring some massive turbulences. Then this: “Captain speaking. This is to inform you that we’ll be performing an auto-pilot landing [watch this] upon arriving to Heathrow.” We should trust the AI-copilot reasoning in harsh situations. Shouldn’t we?… Five days ago, Anthropic introduced next-gen Claude 3 model family. I’ve tried Claude 3: It’s very good at certain language tasks, it pars or beats GPT-4 Turbo in several areas, has a huge context window, and it’s quite cheaper. Funnily enough, it miserably failed at a…
Read More
Announcing Mosaic AI Vector Search General Availability in Databricks

Announcing Mosaic AI Vector Search General Availability in Databricks

Following the announcement we made around a suite of tools for Retrieval Augmented Generation, today we are thrilled to announce the general availability of Mosaic AI Vector Search in Databricks.What is Mosaic AI Vector Search?Vector Search enables developers to improve the accuracy of their Retrieval Augmented Generation (RAG) and generative AI applications through similarity search over unstructured documents such as PDFs, Office Documents, Wikis, and more. This enriches the LLM queries with context and domain knowledge, improving accuracy, and quality of results.Vector Search is part of the Databricks Data Intelligence Platform, making it easy for your RAG and Generative AI applications…
Read More
Introduction to GPT-1 and GPT-2

Introduction to GPT-1 and GPT-2

GPT (Generative Pretrained Transformer) models have changed the landscape of the NLP in the last few years. In 2024, we are seeing complex and close-sourced models like OpenAI’s ChatGPT-3.5 & ChatGPT-4, Anthropic’s Claude, and Google’s Bard. However, the beginnings of these Transformer models were simpler and open-source. Vaswani et al. introduced the Transformer architecture. After that, two more seminal papers by OpenAI, GPT-1 and GPT-2 laid the foundation of almost all the NLP innovations to date. In this article, we will discuss the GPT-1 and GPT-2 models in detail along with their contributions and results. Figure 1. Architecture of the…
Read More
Has Codeium Cracked the Code for AI Assistants?

Has Codeium Cracked the Code for AI Assistants?

(AI generated/Shutterstock) When it comes to AI-powered coding assistants, Microsoft’s Copilot has the name and the numbers. But a competitor called Codeium is growing quickly, and according to its co-founder and CEO Varun Mohan, the sky is the limit for AI assistants. Codeium started life in 2021 as Exafunction, an infrastructure startup that provided big compute for other companies developing deep learning systems. Mohan and his business partner, Douglas Chen, managed 10,000 GPUs on behalf of autonomous vehicle development companies, an industry they previously worked in. But by late 2022, ChatGPT had exploded onto the scene, and Mohan and Chen…
Read More
Data Machina #245

Data Machina #245

The GenAI RAG House Revisited. Since Facebook AI introduced RAG three years ago, RAG systems have evolved from Naive to Advanced, and then to Modular RAG. But Modular RAG also added more complexity, components, interfaces, etc. to the LLMOps pipeline. Many naive RAG and advanced RAG projects never made it to prod. I know many companies that have spent a lot effort and money in building enterprise RAG apps, only to realise they couldn’t produce accurate, reliable results at a manageable cost. Building a RAG system that is scalable, cost-efficient, accurate, and modular requires deep expertise. Here are a few…
Read More
5 Transformative Ways AI is Driving the Open Finance Revolution

5 Transformative Ways AI is Driving the Open Finance Revolution

The finance sector has often struggled in the 21st Century to fully embrace digital transformation. However, the ongoing generative AI boom has all the necessary components to deliver an Open Finance revolution that can bring widespread modernization to industry processes. Although it's been relatively slow in the uptake of digital transformation, the impressive growth of Open Banking has shown that there's plenty of room for innovation throughout finance. While Open Banking refers to the exchange of services and data across financial institutions, Open Finance represents the next step in digital transformation and empowers trusted third parties to utilize customer data…
Read More
Introducing the Databricks AI Fund

Introducing the Databricks AI Fund

We launched Databricks Ventures in December 2021 as our strategic investment arm for funding innovative startups across the data, analytics and AI landscape — companies that shared our view on the importance of open platforms and ecosystems. Since then, via the inaugural Lakehouse Fund, we’ve invested in more than 25 amazing companies that are building on or extending the Databricks Data Intelligence Platform. The result has been a stronger ecosystem, with our portfolio companies delivering best-in-class product experiences for our joint customers.Today, we’re excited to announce the Databricks AI Fund, the second fund at Databricks Ventures. Just as software ate…
Read More
Improving Face Keypoint Detection

Improving Face Keypoint Detection

In this article, we will make additional improvements to our previous custom robust keypoint detection model. In addition to a faster face detection model, we will optimize the face keypoint regressor model, as well as the inference pipeline. All in all, this article is all about improving the face keypoint detection model and pipeline. Figure 1. Improved face keypoint detection pipeline output. We will cover the following topics in this article We will start with a discussion of the issues with our previous approach to face keypoint detection.Then we will move to the discussion of the changes that we will…
Read More
Onehouse Breaks Data Catalog Lock-In with More Openness

Onehouse Breaks Data Catalog Lock-In with More Openness

(Majcot/Shutterstock) Onehouse, the Apache Hudi-backer that bills itself as the most open data platform in the world, further opened up its platform today with the launch of a data catalog synchronization feature that streamlines user access to data residing in major cloud platforms. The feature complements the company’s investment in developing XTable, an open-source offering that delivers read-write interoperability among Hudi, Delta, and Apache Iceberg table formats. The advent of open table formats like Hudi, Delta, and Iceberg revolutionized data openness by enabling multiple query engines access the same piece of data without fear of data corruption. As the key…
Read More
No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.