machinelearning

01 Jun

Creating In-Video Search

stp2y0 CommentsNewsai, coding, community, datascience, development, engineering, inclusive, machinelearning, software, tutorial

In-video search is ability to search for a specific content within a video. This can include searching for particular words spoken, objects shown or description of a scene. With the current advancement in transformers the process of in-video search have become more accurate and fairly simple. Although most of the transformers doesn’t have a joint embedding space for multiple modalities but there are few models like Meta’s ImageBind that a joint embedding space between text, image, audio, depth, thermal and IMU, or OpenAI’s CLiP model have joint embedding space between text and image. We can use these models to create…

30 May

How Retrieval Augmented Generation (RAG) Work

stp2y0 CommentsNewscoding, community, development, engineering, gpt3, inclusive, LLM, machinelearning, rag, software

Retrieval Augmented Generation (RAG, pronounced 'rag') works by fetching selective data from a custom knowledge base and integrating it with the output of a language model to provide accurate and up-to-date responses.RAG can be defined as a ChatGPT-like interface that can use your pdfs, documents or databases to answer questions from you. You can use it as a study assistant to understand documents by asking questions about those documents. In this article, we discuss the benefits of using a RAG system and explain its key components. We also detailhow RAG works to enhance the capabilities of large language models by…