GenAI

AI Agent Systems: Modular Engineering for Reliable Enterprise AI Applications

AI Agent Systems: Modular Engineering for Reliable Enterprise AI Applications

Monolithic to ModularThe proof of concept (POC) of any new technology often starts with large, monolithic units that are difficult to characterize. By definition, POCs are designed to show that a technology works without considering issues around extensibility, maintenance, and quality. However, once technologies achieve maturity and are deployed widely, these needs drive product development to be broken down into smaller, more manageable units. This is the fundamental concept behind systems thinking and why we are seeing AI implementation move from models to AI agent systems. The concept of modular design has been applied to:Cars: seats, tires, lights, and engines can…
Read More
Fine-tuning Llama 3.1 with Long Sequences

Fine-tuning Llama 3.1 with Long Sequences

We are excited to announce that Mosaic AI Model Training now supports the full context length of 131K tokens when fine-tuning the Meta Llama 3.1 model family. With this new capability, Databricks customers can build even higher-quality Retrieval Augmented Generation (RAG) or tool use systems by using long context length enterprise data to create specialized models.The size of an LLM’s input prompt is determined by its context length. Our customers are often limited by short context lengths, especially in use cases like RAG and multi-document analysis. Meta Llama 3.1 models have a long context length of 131K tokens. For comparison,…
Read More
Key differences in GPT3.5 VS GPT4.0

Key differences in GPT3.5 VS GPT4.0

GPT-3.5 and GPT-4 are both large language models developed by OpenAI, but they differ in several key areas: Size and Architecture: GPT-3.5: Has 175 billion parameters and a transformer architecture. GPT-4: Is significantly larger and more complex, with an estimated 1 trillion parameters and a more advanced transformer architecture. Capabilities: Text Generation: Both models are excellent at generating human-quality text, but GPT-4 is generally more creative and able to produce more diverse and nuanced responses. According to OpenAI, ChatGPT-4 is “82 percent less likely to respond to requests for disallowed content and 40 percent more likely to produce factual responses…
Read More
Build generative AI applications in Go using Amazon Titan Text Premier model

Build generative AI applications in Go using Amazon Titan Text Premier model

Use Amazon Titan Text Premier model with the langchaingo package In this blog I will walk you through how to use the Amazon Titan Text Premier model in your Go applications with langchaingo which is a Go port of langchain (originally written for Python and JS/TS). Amazon Titan Text Premier is an advanced LLM within the Amazon Titan Text family. It is useful for a wide range of tasks including RAG, agents, chat, chain of thought, open-ended text generation, brainstorming, summarization, code generation, table creation, data formatting, paraphrasing, rewriting, extraction, and Q&A. Titan Text Premier is also optimized for integration…
Read More
Milvus Adventures August 7, 2024

Milvus Adventures August 7, 2024

COMMUNITY I can't believe that we just had another full house at the Unstructured Data meetup in San Francisco, with our lovely hosts, Github! Palo Alto and NYC are next week so there is plenty of time to register and join us in person. Or, if you would like to give a talk, let us know! Unstructured Data SF Meetup video Unstructured Data Palo Alto Meetup register Unstructured Data NYCMeetup register Learn About Gen AI Explore the cutting edge of Generative AI (GenAI) and its impact on software development. From code generation to automated testing, GenAI is transforming how we…
Read More
Exploring General Artificial Intelligence (GenAI)

Exploring General Artificial Intelligence (GenAI)

General Artificial Intelligence (GenAI) is an interesting and ambitious AI concept. General AI seeks to mimic human cognitive abilities across multiple domains, unlike narrow AI systems that specialize in specific tasks such as image recognition or natural language processing. In this blog article, we'll look at what General AI is, its possible applications, present progress, obstacles, and ethical concerns. What is GenAI (General Artificial Intelligence)? General AI refers to AI systems that can understand, learn, and apply knowledge in a way that is indistinguishable from human intellect. General AI, unlike specialized AI, can accomplish any intellectual work that humans can,…
Read More
AWS: Your Ally in Amplifying Reliability with GenAI

AWS: Your Ally in Amplifying Reliability with GenAI

Generative AI, or the Large Language Models, is by far one of the most exciting technologies we have seen. It has far-reaching consequences, impacting various fields. Site Reliability Engineering is currently experiencing its moment, with GenAI revolutionizing operations. I refer to this as SRE 2.0, a new and improved version of SRE powered by GenAI. What really is an LLM? Before delving deeper, let's examine LLMs. A Large Language Model (LLM) is a type of artificial intelligence model developed to process and generate human-like text at scale. These models are trained on vast amounts of text data and can perform…
Read More
Let’s Build Small AI Buzz, Offer ‘Claim Processing’ to Mid/Big Companies

Let’s Build Small AI Buzz, Offer ‘Claim Processing’ to Mid/Big Companies

Discover How AI Can Transform Businesses, Every Details Spelled Out. Full Article Artificial Intelligence (AI) is rapidly reshaping business landscapes, promising unprecedented efficiency and accuracy across industries. In this article, we delve into how Aniket Insurance Inc. (Imaginary) leverages AI to revolutionize its claim processing operations, offering insights into the transformative power of AI in modern business environments. ➡️ What’s This Article About? The article explores how Aniket Insurance Inc. uses AI to transform its claim processing. It details the three main workflows: User claim submission, Admin + AI claim processing, and Executive + AI claim analysis. ➡️ Why Read…
Read More
Docker DevTools Day 2.0: Dive Deep into the Docker Developer Ecosystem

Docker DevTools Day 2.0: Dive Deep into the Docker Developer Ecosystem

Calling all Docker enthusiasts! Join us for the second edition of Docker DevTools Day Bengaluru on June 22nd. This community event is your chance to dive deep into the world of developer tooling that revolves around Docker. What to Expect Engaging Talks: Gain valuable insights from industry leaders as they explore cutting-edge tools, real-world use cases, and how to overcome common development challenges with Docker. Interactive Workshops: Solidify your understanding through hands-on exercises led by experts. Networking Opportunities: Connect with like-minded developers and industry professionals to share experiences and build a vibrant Docker community. Docker DevTools Day 2.0 Agenda Time…
Read More
Shutterstock’s Content Datasets Now on Databricks Marketplace

Shutterstock’s Content Datasets Now on Databricks Marketplace

In today's data-driven world, the fusion of visual assets and analytical capabilities unlocks a realm of untapped potential. Image datasets are crucial in developing and training Generative AI (GenAI) technologies. We are thrilled to announce a groundbreaking collaboration that brings the vast collection of Shutterstock imagery to the Databricks Marketplace — our first listing of Volume (aka non-tabular) datasets on our Marketplace. This free sample dataset, which consists of 1,000 images and accompanying metadata sourced from Shutterstock's 550+ million image library, is available for immediate access. This blog will explore Shutterstock's image library on Databricks Marketplace and the industry use…
Read More
No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.