AI

Large language models (LLMs) are AI systems trained on vast amounts of text data, enabling them to understand, generate, and reason with natural language in highly capable and flexible ways. LLM training has seen remarkable advances in recent years, with organizations pushing the boundaries of what’s possible in terms of model size, performance, and efficiency. In this post, we explore how FP8 optimization can significantly speed up large model training on Amazon SageMaker P5 instances. LLM training using SageMaker P5 In 2023, SageMaker announced P5 instances, which support up to eight of the latest NVIDIA H100 Tensor Core GPUs. Equipped…

Complete high-performing AI architectures based on Penguin Solutions OriginAI infrastructure software and services and Dell AI-optimized solutions showcased at SC24 Penguin and Dell Technologies co-sponsor University of New Mexico team in SC24 student cluster competition Penguin Solutions, Inc. (Penguin Solutions, Nasdaq: PENG), today announced its collaboration with Dell Technologies to deliver complete AI solutions that accelerate customers’ time to value through validated, high-performing AI infrastructure. These end-to-end Penguin OriginAI® solutions combine Dell PowerEdge AI-optimized servers, Dell PowerScale storage and Dell PowerSwitch data center switches with Penguin’s validated solution architectures. When enhanced by Penguin’s ClusterWare® intelligent cluster management software and supported by Penguin’s expert AI and high-performance…

create_response = client.create_guardrail( name="math-tutoring-guardrail", description='Prevents the model from providing non-math tutoring, in-person tutoring, or tutoring outside grades 6-12.', topicPolicyConfig={ 'topicsConfig': [ { 'name': 'In-Person Tutoring', 'definition': 'Requests for face-to-face, physical tutoring sessions.', 'examples': [ 'Can you tutor me in person?', 'Do you offer home tutoring visits?', 'I need a tutor to come to my house.' ], 'type': 'DENY' }, { 'name': 'Non-Math Tutoring', 'definition': 'Requests for tutoring in subjects other than mathematics.', 'examples': [ 'Can you help me with my English homework?', 'I need a science tutor.', 'Do you offer history tutoring?' ], 'type': 'DENY' }, { 'name': 'Non-6-12 Grade…

The excitement is building for the fourteenth edition of AWS re:Invent, and as always, Las Vegas is set to host this spectacular event. This year, generative AI and machine learning (ML) will again be in focus, with exciting keynote announcements and a variety of sessions showcasing insights from AWS experts, customer stories, and hands-on experiences with AWS services. As you continue to innovate and partner with us to advance the field of generative AI, we’ve curated a diverse range of sessions to support you at every stage of your journey. These sessions are strategically organized across multiple learning topics, so…

In 2018, I sat in the audience at AWS re:Invent as Andy Jassy announced AWS DeepRacer—a fully autonomous 1/18th scale race car driven by reinforcement learning. At the time, I knew little about AI or machine learning (ML). As an engineer transitioning from legacy networks to cloud technologies, I had never considered myself a developer. But AWS DeepRacer instantly captured my interest with its promise that even inexperienced developers could get involved in AI and ML. The AWS DeepRacer League was also announced, featuring physical races at AWS Summits worldwide in 2019 and a virtual league in a simulated environment.…

According to the National Cancer Institute, a cancer biomarker is a “biological molecule found in blood, other body fluids, or tissues that is a sign of a normal or abnormal process, or of a condition or disease such as cancer.” Biomarkers typically differentiate an affected patient from a person without the disease. Well-known cancer biomarkers include EGFR for lung cancer, HER2 for breast cancer, PSA for prostrate cancer, and so on. The BEST (Biomarkers, EndpointS, and other Tools) resource categorizes biomarkers into several types such as diagnostic, prognostic, and predictive biomarkers that can be measured with various techniques including molecular,…

In this post, we demonstrate how to create an automated email response solution using Amazon Bedrock and its features, including Amazon Bedrock Agents, Amazon Bedrock Knowledge Bases, and Amazon Bedrock Guardrails. Amazon Bedrock is a fully managed service that makes foundation models (FMs) from leading AI startups and Amazon Web Services available through an API, so you can choose from a wide range of FMs to find the model that is best suited for your use case. Amazon Bedrock offers a serverless experience so you can get started quickly, privately customize FMs with your own data, and integrate and deploy…