stp2y

30694 Posts
Distributed In-Context Learning under Non-IID Among Clients

Distributed In-Context Learning under Non-IID Among Clients

arXiv:2408.00144v1 Announce Type: new Abstract: Advancements in large language models (LLMs) have shown their effectiveness in multiple complicated natural language reasoning tasks. A key challenge remains in adapting these models efficiently to new or unfamiliar tasks. In-context learning (ICL) provides a promising solution for few-shot adaptation by retrieving a set of data points relevant to a query, called in-context examples (ICE), from a training dataset and providing them during the inference as context. Most existing studies utilize a centralized training dataset, yet many real-world datasets may be distributed among multiple clients, and remote data retrieval can be associated with costs.…
Read More
The Republican National Committee loses its legal challenge to Gmail

The Republican National Committee loses its legal challenge to Gmail

A federal judge dismissed a case brought by the Republican National Committee (RNC) against Google over its Gmail service. The suit alleged that Google’s email platform labeled GOP fundraising emails as spam at a higher rate than those from the other side of the aisle.District Court Judge Daniel Calabretta from the Eastern California District Court dismissed the case with prejudice, preventing the Republican party from bringing its case against Google back to court. The dismissal with prejudice means it cannot bring the case to another court but can still file an appeal to Calabretta’s decision, according to The Verge.Calabretta wrote…
Read More
Olympians are going wild over the chocolate muffins in the dining hall. They’re easy to recreate.

Olympians are going wild over the chocolate muffins in the dining hall. They’re easy to recreate.

If the Olympic dining hall food could participate in a competition, the chocolate muffin would be a sure winner.The pastry went viral when Norwegian swimmer Henrik Christiansen posted videos of himself devouring the dining hall snack."Guys, I think I have a problem," he captioned a TikTok video that showed his drawer full of muffins.In another video, Christiansen, who declared himself the "Olympic muffin man," is seen walking while grabbing two muffins in each hand.Last Thursday, Business Insider reported that athletes had called the food in Paris a "disaster." Team Great Britain even flew in a private chef.However, the dining hall…
Read More
Measuring Progress in Dictionary Learning for Language Model Interpretability with Board Game Models

Measuring Progress in Dictionary Learning for Language Model Interpretability with Board Game Models

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. Source link lol
Read More
From Attributes to Natural Language: A Survey and Foresight on Text-based Person Re-identification

From Attributes to Natural Language: A Survey and Foresight on Text-based Person Re-identification

arXiv:2408.00096v1 Announce Type: new Abstract: Text-based person re-identification (Re-ID) is a challenging topic in the field of complex multimodal analysis, its ultimate aim is to recognize specific pedestrians by scrutinizing attributes/natural language descriptions. Despite the wide range of applicable areas such as security surveillance, video retrieval, person tracking, and social media analytics, there is a notable absence of comprehensive reviews dedicated to summarizing the text-based person Re-ID from a technical perspective. To address this gap, we propose to introduce a taxonomy spanning Evaluation, Strategy, Architecture, and Optimization dimensions, providing a comprehensive survey of the text-based person Re-ID task. We start…
Read More
Correcting Negative Bias in Large Language Models through Negative Attention Score Alignment

Correcting Negative Bias in Large Language Models through Negative Attention Score Alignment

arXiv:2408.00137v1 Announce Type: new Abstract: A binary decision task, like yes-no questions or answer verification, reflects a significant real-world scenario such as where users look for confirmation about the correctness of their decisions on specific issues. In this work, we observe that language models exhibit a negative bias in the binary decisions of complex reasoning tasks. Based on our observations and the rationale about attention-based model dynamics, we propose a negative attention score (NAS) to systematically and quantitatively formulate negative bias. Based on NAS, we identify attention heads that attend to negative tokens provided in the instructions as answer candidate…
Read More
GitHub Models gives developers new power to experiment with Gen AI

GitHub Models gives developers new power to experiment with Gen AI

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More GitHub is no stranger to the world of AI for development, but to date it hasn’t been as easy as it could be for developers to try out new gen AI models. That’s starting to change today. GitHub is launching a new effort called GitHub Models in a bid to provide an easier onramp for enterprise developers to try out and build applications with gen AI. GitHub is an early pioneer in the use of gen AI, particularly with its GitHub Copilot…
Read More
No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.