stp2y

arXiv:2406.02831v1 Announce Type: new Abstract: Video anomaly detection aims to develop automated models capable of identifying abnormal events in surveillance videos. The benchmark setup for this task is extremely challenging due to: i) the limited size of the training sets, ii) weak supervision provided in terms of video-level labels, and iii) intrinsic class imbalance induced by the scarcity of abnormal events. In this work, we show that distilling knowledge from aggregated representations of multiple backbones into a relatively simple model achieves state-of-the-art performance. In particular, we develop a bi-level distillation approach along with a novel disentangled cross-attention-based feature aggregation network.…

arXiv:2406.02830v1 Announce Type: new Abstract: As artificial neural networks grow in complexity, understanding their inner workings becomes increasingly challenging, which is particularly important in healthcare applications. The intrinsic evaluation metrics of autoregressive neural language models (NLMs), perplexity (PPL), can reflect how "surprised" an NLM model is at novel input. PPL has been widely used to understand the behavior of NLMs. Previous findings show that changes in PPL when masking attention layers in pre-trained transformer-based NLMs reflect linguistic anomalies associated with Alzheimer's disease dementia. Building upon this, we explore a novel bidirectional attention head ablation method that exhibits properties attributed to…

(Pinare/Shutterstock) The big data community gained clarity on the future of data lakehouses earlier this week as a result of Snowflake’s open sourcing of its new Polaris metadata catalog and Databricks’ acquisition of Tabular. The actions cemented Apache Iceberg as the winner of the battle of open table formats, which is a big win for customers and open data, while it exposes a new competitive front: the metadata catalog. The news Monday and Tuesday was as hot as the weather in San Francisco this week, and left some longtime big data watchers gasping for breath. To recap: On Monday, Snowflake…

This is a collaborative post from Databricks and Microsoft. We thank Mohini Verma, Senior Product Marketing Manager, for her contributions.Data + AI Summit 2024: Register now to join this in-person and virtual event June 10-13 and learn from the global data community.Microsoft is a Legend Sponsor of the Databricks Data + AI Summit 2024, the premier event for the global data community. Join us to learn how data intelligence enables every organization to harness the power of generative AI on their own data. Hear from Microsoft leaders who will share how customers have successfully leveraged the Databricks Data Intelligence Platform…