CybAI news

Vision transformers are already good at multiple tasks like image recognition, object detection, and semantic segmentation. However, we can also apply them to data with temporal information like videos. One such use case is using Vision Transformers for video classification. To this end, in this article, we will go over the important parts of the Multiscale Vision Transformer (MViT) paper and also carry out inference using the pretraining model. Figure 1. An example output after passing a bowling video through the Multiscale Vision Transformer model. Although there are several models for this, the Multiscale Vision Transformer model stands out for…

(Michael Vi/Shutterstock) Investors in Snowflake breathed a sigh of relief this week when the cloud data warehouser reported solid revenue growth for its first quarter and raised its guidance for the rest of the year. But questions still remain over its long-term growth, which the company is hoping that artificial intelligence will power. The company’s acquisition this week of assets of TruEra fits that mold. Snowflake on Wednesday reported $829 million in total GAAP revenues for the quarter ended April 30, 2024, representing a 33% increase over the same period last year. It reported 14 cents per share, which was…

The New Breed of Open Mixture-of-Experts (MoE) Models. In a push to beat the closed-box AI models from the AI Titans, many startups and research orgs have embarked in releasing open MoE-based models. These new breed of MoE-based models introduce many clever architectural tricks, and seek to balance training cost efficiency, output quality, inference performance and much more. For an excellent introduction to MoEs, checkout this long post by the Hugging Face team: Mixture of Experts ExplainedWe’re starting to see several open MoE-based models achieving near-SOTA or SOTA performance as compared to e.g. OpenAI GPT-4 and Google Gemini 1.5 Pro.…