Viral News

Announcing Mosaic AI Vector Search General Availability in Databricks

Announcing Mosaic AI Vector Search General Availability in Databricks

Following the announcement we made around a suite of tools for Retrieval Augmented Generation, today we are thrilled to announce the general availability of Mosaic AI Vector Search in Databricks.What is Mosaic AI Vector Search?Vector Search enables developers to improve the accuracy of their Retrieval Augmented Generation (RAG) and generative AI applications through similarity search over unstructured documents such as PDFs, Office Documents, Wikis, and more. This enriches the LLM queries with context and domain knowledge, improving accuracy, and quality of results.Vector Search is part of the Databricks Data Intelligence Platform, making it easy for your RAG and Generative AI applications…
Read More
Introduction to GPT-1 and GPT-2

Introduction to GPT-1 and GPT-2

GPT (Generative Pretrained Transformer) models have changed the landscape of the NLP in the last few years. In 2024, we are seeing complex and close-sourced models like OpenAI’s ChatGPT-3.5 & ChatGPT-4, Anthropic’s Claude, and Google’s Bard. However, the beginnings of these Transformer models were simpler and open-source. Vaswani et al. introduced the Transformer architecture. After that, two more seminal papers by OpenAI, GPT-1 and GPT-2 laid the foundation of almost all the NLP innovations to date. In this article, we will discuss the GPT-1 and GPT-2 models in detail along with their contributions and results. Figure 1. Architecture of the…
Read More
Has Codeium Cracked the Code for AI Assistants?

Has Codeium Cracked the Code for AI Assistants?

(AI generated/Shutterstock) When it comes to AI-powered coding assistants, Microsoft’s Copilot has the name and the numbers. But a competitor called Codeium is growing quickly, and according to its co-founder and CEO Varun Mohan, the sky is the limit for AI assistants. Codeium started life in 2021 as Exafunction, an infrastructure startup that provided big compute for other companies developing deep learning systems. Mohan and his business partner, Douglas Chen, managed 10,000 GPUs on behalf of autonomous vehicle development companies, an industry they previously worked in. But by late 2022, ChatGPT had exploded onto the scene, and Mohan and Chen…
Read More
Data Machina #245

Data Machina #245

The GenAI RAG House Revisited. Since Facebook AI introduced RAG three years ago, RAG systems have evolved from Naive to Advanced, and then to Modular RAG. But Modular RAG also added more complexity, components, interfaces, etc. to the LLMOps pipeline. Many naive RAG and advanced RAG projects never made it to prod. I know many companies that have spent a lot effort and money in building enterprise RAG apps, only to realise they couldn’t produce accurate, reliable results at a manageable cost. Building a RAG system that is scalable, cost-efficient, accurate, and modular requires deep expertise. Here are a few…
Read More
5 Transformative Ways AI is Driving the Open Finance Revolution

5 Transformative Ways AI is Driving the Open Finance Revolution

The finance sector has often struggled in the 21st Century to fully embrace digital transformation. However, the ongoing generative AI boom has all the necessary components to deliver an Open Finance revolution that can bring widespread modernization to industry processes. Although it's been relatively slow in the uptake of digital transformation, the impressive growth of Open Banking has shown that there's plenty of room for innovation throughout finance. While Open Banking refers to the exchange of services and data across financial institutions, Open Finance represents the next step in digital transformation and empowers trusted third parties to utilize customer data…
Read More
Introducing the Databricks AI Fund

Introducing the Databricks AI Fund

We launched Databricks Ventures in December 2021 as our strategic investment arm for funding innovative startups across the data, analytics and AI landscape — companies that shared our view on the importance of open platforms and ecosystems. Since then, via the inaugural Lakehouse Fund, we’ve invested in more than 25 amazing companies that are building on or extending the Databricks Data Intelligence Platform. The result has been a stronger ecosystem, with our portfolio companies delivering best-in-class product experiences for our joint customers.Today, we’re excited to announce the Databricks AI Fund, the second fund at Databricks Ventures. Just as software ate…
Read More
Improving Face Keypoint Detection

Improving Face Keypoint Detection

In this article, we will make additional improvements to our previous custom robust keypoint detection model. In addition to a faster face detection model, we will optimize the face keypoint regressor model, as well as the inference pipeline. All in all, this article is all about improving the face keypoint detection model and pipeline. Figure 1. Improved face keypoint detection pipeline output. We will cover the following topics in this article We will start with a discussion of the issues with our previous approach to face keypoint detection.Then we will move to the discussion of the changes that we will…
Read More
Onehouse Breaks Data Catalog Lock-In with More Openness

Onehouse Breaks Data Catalog Lock-In with More Openness

(Majcot/Shutterstock) Onehouse, the Apache Hudi-backer that bills itself as the most open data platform in the world, further opened up its platform today with the launch of a data catalog synchronization feature that streamlines user access to data residing in major cloud platforms. The feature complements the company’s investment in developing XTable, an open-source offering that delivers read-write interoperability among Hudi, Delta, and Apache Iceberg table formats. The advent of open table formats like Hudi, Delta, and Iceberg revolutionized data openness by enabling multiple query engines access the same piece of data without fear of data corruption. As the key…
Read More
Data Machina #246

Data Machina #246

New Trends in Vision-Language Models (VLMs.) The evolution of VLMs in recent months has been pretty impressive. Today VLMs exhibit some amazing capabilities. See the two links below on what VLMs can do and how they work:But still VLMs are facing some challenges for example in terms of: multimodal training datasets, resolution, long-form modality, vision-language integration, and concept understanding. Somewhat along those lines, I see 5 trends happening in VLMs: 1) VLMs run on local environment 2) Emerging VLM videoagents 3) Unified structure learning for VLMs 4) Personalisation of VLMs and 5) Fixing the VLM resolution curse. Let’s see…VLMs on…
Read More
AI vs. Humanity: Who Will Come Out on Top?

AI vs. Humanity: Who Will Come Out on Top?

The below is a summary of my recent article on superintelligence. Elon Musk predicts that Artificial Superintelligence (ASI) will emerge by 2025, much earlier than his previous estimates. While Musk's track record with predictions is mixed, this one sparks serious contemplation about the future. The moment AI surpasses human cognitive abilities, known as the singularity, will usher in a new era with both unprecedented possibilities and profound perils. As we edge closer to this event horizon, it's essential to ask if we are prepared to navigate the uncertainties and harness the potential of AI responsibly. The journey towards ASI has…
Read More
No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.