stp2y

34189 Posts
Rethinking the Role of PPO in RLHF

Rethinking the Role of PPO in RLHF

Rethinking the Role of PPO in RLHF TL;DR: In RLHF, there’s tension between the reward learning phase, which uses human preference in the form of comparisons, and the RL fine-tuning phase, which optimizes a single, non-comparative reward. What if we performed RL in a comparative way? Figure 1: This diagram illustrates the difference between reinforcement learning from absolute feedback and relative feedback. By incorporating a new component - pairwise policy gradient, we can unify the reward modeling stage and RL stage, enabling direct updates based on pairwise responses. Large Language Models (LLMs) have powered increasingly capable virtual assistants, such as…
Read More
Spacebilt and Phison to send powerful data server to ISS

Spacebilt and Phison to send powerful data server to ISS

This article was upadted April 16 at 4 pm ET with information on HPE’s Spaceborne Computer-2. COLORADO SPRINGS – Spacebilt announced an agreement April 8 with Phison to qualify a powerful data server on the International Space Station. When the Large in Space Server (LiSS) launches in 2025, it will be one of the most powerful data server in orbit. Liss will have “100 terabytes plus of data storage,” Dennis Wingo, Spacebilt chief technology officer told SpaceNews. “We are qualifying it so we can launch petabyte servers in the future.” LiSS is headed to an external platform on the Japanese…
Read More
US Sues to Break Up Ticketmaster and Live Nation, Alleging Monopoly Abuse

US Sues to Break Up Ticketmaster and Live Nation, Alleging Monopoly Abuse

In the second case, a class action brought in 2022 on behalf of Ticketmaster customers in the US, Live Nation and Ticketmaster were accused of abusing the complementary relationship between their services to overcharge consumers and sustain their monopoly. “Live Nation controls the vast majority of the big national touring acts and, either explicitly or implicitly, coerces concert venues into selecting Ticketmaster as their ticketing service provider on pain of losing high-value acts,” claims Adam Wolfson, a partner at Quinn Emanuel, the law firm representing the plaintiffs.This type of conduct, known as tying, was explicitly forbidden under the consent decree…
Read More
FasterViT for Semantic Segmentation

FasterViT for Semantic Segmentation

In this article, we will modify the FasterViT model for semantic segmentation. FasterViT is a family of CNN-Transformer hybrid models for deep learning based computer vision tasks. The FasterViT models are faster and more accurate on several computer vision benchmarks, particularly the ImageNet dataset. We can also modify the model for semantic segmentation to get excellent results on a custom dataset. Although it is not straightforward and requires several changes to the architecture, it is possible. In this article, we will cover the architectural details and the changes we must make to the FasterViT model for semantic segmentation. Figure 1.…
Read More
VivaTech & The New French Tech Next40/120: When AI Meets Green Tech

VivaTech & The New French Tech Next40/120: When AI Meets Green Tech

Paris will be the center of innovation and technology this week. The 2024 edition of VivaTech in Paris is set to be a great success with more than 150,000 in-person visitors. It has become the largest technology and innovation event in Europe with CEOs, C-leaders, VCs, and startups attending from all over the world. The lineup of speakers is quite impressive with Elon Musk (Tesla, SpaceX, X), Robin Li (Baidu), Eric Schmidt (former CEO of Google), John Kerry (68th US Secretary of State), Charles Michel (European Council President), Marc Pritchard (P&G chief brand officer), Yoshua Bengio (Université de Montreal professor),…
Read More
Build a serverless exam generator application from your own lecture content using Amazon Bedrock | Amazon Web Services

Build a serverless exam generator application from your own lecture content using Amazon Bedrock | Amazon Web Services

Crafting new questions for exams and quizzes can be tedious and time-consuming for educators. The time required varies based on factors like subject matter, question types, experience level, and class level. Multiple-choice questions require substantial time to generate quality distractors and ensure a single unambiguous answer, and composing effective true-false questions demands careful effort to avoid vagueness and assess deeper understanding. Creating high-quality assessment questions of any format necessitates meticulous attention to detail from educators in order to produce fair and valid student evaluations. To streamline this cumbersome process, we propose an automated exam generation solution based on Amazon Bedrock.…
Read More

Hey, Zoey by Sarah Crossan review – ‘the perfect girlfriend’

Intelligent sex robots may seem like a dream of the future, but that dream is a couple of centuries old. ETA Hoffmann’s 1816 story The Sandman imagines a young man falling for a lovely but “stiff and soulless” girl who turns out to be a clockwork creation. More recently, Alan Ayckbourn and first-time novelist Sierra Greer have used the artificial girlfriend to shed light on human emotions.Sarah Crossan is an Irish author whose eight novels for teens and young adults have racked up an impressive slate of prize nominations. This is her second work for adults, after Here Is the Beehive, a verse…
Read More

Vanderbilt Machine Learning Seminar Talk “Conformal Prediction under Ambiguous Ground Truth” • David Stutz

Vanderbilt Machine Learning Seminar Talk “Conformal Prediction under Ambiguous Ground Truth” Last week, I presented our work on Monte Carlo conformal prediction — conformal prediction with ambiguous and uncertain ground truth — at the Vanderbilt Machine Learning Seminar Series. In this work, we show how to adapt standard conformal prediction if there are no unique ground truth labels available due to disagreement among experts during annotation. In this article, I want to share the slides of my talk. Abstract Conformal Prediction (CP) allows to perform rigorous uncertainty quantification by constructing a prediction set $C(X)$ satisfying $mathbb{P}_{agg}(Y in C(X))geq 1-alpha$ for…
Read More
Only 1 in 4 Americans think you need a college degree to get a high-paying job: report

Only 1 in 4 Americans think you need a college degree to get a high-paying job: report

A majority of Americans don't think earning a college degree is a pre-requisite for snagging a high-paying job, according to a Pew Research Center report released on Thursday."Only one-in-four US adults say it's extremely or very important to have a four-year college degree in order to get a well-paying job in today's economy," the center wrote in its report, citing a survey it conducted with 5,203 US adults from November to December 2023.Nearly half of the survey's respondents said having a four-year college degree is less important in getting a high-paying job today than it was 20 years ago. The…
Read More
Fujitsu Chosen For GENIAC Project To Enhance Reliability Of GenAI in Business Applications

Fujitsu Chosen For GENIAC Project To Enhance Reliability Of GenAI in Business Applications

(issaro prakalung/Shutterstock) Fujitsu, one of the leading technology and business solutions providers, has been chosen for the research and development project for the enhanced infrastructures for post-5G information and communication systems. This project is part of the Generative AI Accelerator Challenge (GENIAC) initiative by Japan’s New Energy and Industrial Technology Development Organization (NEDO).  The goal of the GENIAC project is to enhance Japan’s capabilities to harness the transformative power of GenAI by bringing together the knowledge of stakeholders in Japan and other countries. Fujitsu will be responsible for R&D on GenAI technologies with a focus on combining knowledge graphs with…
Read More
No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.