Reliable edge machine learning hardware for scientific applications

AmazUtah_NLP at SemEval-2024 Task 9: A MultiChoice Question Answering System for Commonsense Defying Reasoning


[Submitted on 27 Jun 2024]

Authors:Tommaso Baldi (1 and 2), Javier Campos (1), Ben Hawks (1), Jennifer Ngadiuba (1), Nhan Tran (1), Daniel Diaz (3), Javier Duarte (3), Ryan Kastner (3), Andres Meza (3), Melissa Quinnan (3), Olivia Weng (3), Caleb Geniesse (4), Amir Gholami (4), Michael W. Mahoney (4), Vladimir Loncar (5), Philip Harris (5), Joshua Agar (6), Shuyu Qin (6) ((1) Fermilab, (2) University of Pisa, (3) UC San Diego, (4) UC Berkeley/LBNL/ICSI, (5) MIT, (6) Drexel University)

View a PDF of the paper titled Reliable edge machine learning hardware for scientific applications, by Tommaso Baldi (1 and 2) and 22 other authors

View PDF
HTML (experimental)

Abstract:Extreme data rate scientific experiments create massive amounts of data that require efficient ML edge processing. This leads to unique validation challenges for VLSI implementations of ML algorithms: enabling bit-accurate functional simulations for performance validation in experimental software frameworks, verifying those ML models are robust under extreme quantization and pruning, and enabling ultra-fine-grained model inspection for efficient fault tolerance. We discuss approaches to developing and validating reliable algorithms at the scientific edge under such strict latency, resource, power, and area requirements in extreme experimental environments. We study metrics for developing robust algorithms, present preliminary results and mitigation strategies, and conclude with an outlook of these and future directions of research towards the longer-term goal of developing autonomous scientific experimentation methods for accelerated scientific discovery.

Submission history

From: Nhan Tran [view email] [via Fermilab Proxy as proxy]
[v1]
Thu, 27 Jun 2024 20:45:08 UTC (2,968 KB)



Source link
lol

By stp2y

Leave a Reply

Your email address will not be published. Required fields are marked *

No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.