Is GPT-4 getting worse over time?

Is GPT-4 getting worse over time?

A new paper making the rounds is being interpreted as saying that GPT-4 has gotten worse since its release. Unfortunately, this is a vast oversimplification of what the paper found. And while the findings are interesting, some of the methods are questionable, so it’s worth digging into the details.One important concept to understand about chatbots is that there is a big difference between capability and behavior. A model that has a capability may or may not display that capability in response to a particular prompt.Chatbots acquire their capabilities through pre-training. It is an expensive process that takes months for the…
Read More
Foundational nabs $8M to help developers fix data quality issues faster – SiliconANGLE

Foundational nabs $8M to help developers fix data quality issues faster – SiliconANGLE

Foundational Data Inc., a startup helping enterprises ensure their internal datasets are accurate, today announced that it has raised $8 million to finance growth initiatives.  Viola Ventures and Google LLC’s Gradient Ventures fund led the seed round. They were joined by executives from Meta Platforms Inc., Datadog Inc. and other major tech firms. Against the backdrop of the investment, Foundational Data today announced the general availability of its namesake platform for troubleshooting data quality issues.  Inaccuracies in business information are tricky to spot because their scope is often limited. In an analytics dashboard that contains multiple graphs, a pie chart…
Read More
6 NATO countries are planning to build a ‘drone wall’ to defend themselves against Russia, reports say

6 NATO countries are planning to build a ‘drone wall’ to defend themselves against Russia, reports say

Six NATO countries are joining forces to create a "drone wall" to defend themselves against Russia, AFP news agency reported.Over the weekend, ministers from Finland, Norway, Poland, Estonia, Latvia, and Lithuania convened to discuss a coordinated system to help defend against Russian provocations and smuggling attempts, per the Financial Times."This is a completely new thing -- a drone wall stretching from Norway to Poland, and the goal is to use drones and other technologies to protect our borders," Lithuania's interior minister Agnė Bilotaitė reportedly told the Baltic News Service.Further details on when the wall could be in place and how…
Read More
Dissecting Query-Key Interaction in Vision Transformers

Dissecting Query-Key Interaction in Vision Transformers

arXiv:2405.14880v1 Announce Type: new Abstract: Self-attention in vision transformers has been thought to perform perceptual grouping where tokens attend to other tokens with similar embeddings, which could correspond to semantically similar features in an image. However, contextualization is also an important and necessary computation for processing signals. Contextualization potentially requires tokens to attend to dissimilar tokens such as those corresponding to backgrounds or different objects, but this effect has not been reported in previous studies. In this study, we investigate whether self-attention in vision transformers exhibits a preference for attending to similar tokens or dissimilar tokens, providing evidence of perceptual…
Read More
Gemma: Introducing new state-of-the-art open models

Gemma: Introducing new state-of-the-art open models

Responsible by designGemma is designed with our AI Principles at the forefront. As part of making Gemma pre-trained models safe and reliable, we used automated techniques to filter out certain personal information and other sensitive data from training sets. Additionally, we used extensive fine-tuning and reinforcement learning from human feedback (RLHF) to align our instruction-tuned models with responsible behaviors. To understand and reduce the risk profile for Gemma models, we conducted robust evaluations including manual red-teaming, automated adversarial testing, and assessments of model capabilities for dangerous activities. These evaluations are outlined in our Model Card.We’re also releasing a new Responsible…
Read More
Alteryx Inspire focuses on innovation in enterprise-grade AI – SiliconANGLE

Alteryx Inspire focuses on innovation in enterprise-grade AI – SiliconANGLE

The role of data and innovation in shaping the future of generative artificial intelligence is critical. All year on theCUBE, a major focus of coverage has been around workflows, data and intellectual property, especially given the recent wave of gen AI, according to Dave Vellante, chief analyst of theCUBE Research. “This AI thing is real. It’s AI everywhere … powering all the trends, all the markets … all the way through the stack,” said Vellante, during the recent “Supercloud 6: AI Innovators” event. The trends at play that are driving innovation in enterprise-grade AI represent a perfect wave for a company such…
Read More
Extracting Prompts by Inverting LLM Outputs

Extracting Prompts by Inverting LLM Outputs

arXiv:2405.15012v1 Announce Type: new Abstract: We consider the problem of language model inversion: given outputs of a language model, we seek to extract the prompt that generated these outputs. We develop a new black-box method, output2prompt, that learns to extract prompts without access to the model's logits and without adversarial or jailbreaking queries. In contrast to previous work, output2prompt only needs outputs of normal user queries. To improve memory efficiency, output2prompt employs a new sparse encoding techique. We measure the efficacy of output2prompt on a variety of user and system prompts and demonstrate zero-shot transferability across different LLMs. Source link…
Read More
Netflix’s Standard with Ads plan grows to 40 million subscribers – gHacks Tech News

Netflix’s Standard with Ads plan grows to 40 million subscribers – gHacks Tech News

There was a lot of outcry when Netflix announced the introduction of ads on its platform. The streaming service introduced an ad-powered plan in late 2022 in select regions. At $6.99 per month, it was considerably cheaper than non-ad plans, even back in 2022. In fact, adding another user slot to one of the ad-free Netfllix plans is more expensive than subscribing to the ad-powered plan. Netflix did a lot to push the ad-powered plan. First called Basic with ads, it soon was rebranded to Standard with ads, to highlight its advantages over Netflix's basic plan. This was not the…
Read More
AI pioneer LeCun to next-gen AI builders: ‘Don’t focus on LLMs’

AI pioneer LeCun to next-gen AI builders: ‘Don’t focus on LLMs’

Join us in returning to NYC on June 5th to collaborate with executive leaders in exploring comprehensive methods for auditing AI models regarding bias, performance, and ethical compliance across diverse organizations. Find out how you can attend here. AI pioneer Yann LeCun kicked off an animated discussion today after telling the next generation of developers not to work on large language models (LLMs).  “This is in the hands of large companies, there’s nothing you can bring to the table,” Lecun said at VivaTech today in Paris. “You should work on next-gen AI systems that lift the limitations of LLMs.” The…
Read More
No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.