A Framework for testing Federated Learning algorithms using an edge-like environment

AmazUtah_NLP at SemEval-2024 Task 9: A MultiChoice Question Answering System for Commonsense Defying Reasoning


[Submitted on 17 Jul 2024]

View a PDF of the paper titled A Framework for testing Federated Learning algorithms using an edge-like environment, by Felipe Machado Schwanck and Marcos Tomazzoli Leipnitz and Joel Lu’is Carbonera and Juliano Araujo Wickboldt

View PDF
HTML (experimental)

Abstract:Federated Learning (FL) is a machine learning paradigm in which many clients cooperatively train a single centralized model while keeping their data private and decentralized. FL is commonly used in edge computing, which involves placing computer workloads (both hardware and software) as close as possible to the edge, where the data is being created and where actions are occurring, enabling faster response times, greater data privacy, and reduced data transfer costs. However, due to the heterogeneous data distributions/contents of clients, it is non-trivial to accurately evaluate the contributions of local models in global centralized model aggregation. This is an example of a major challenge in FL, commonly known as data imbalance or class imbalance. In general, testing and assessing FL algorithms can be a very difficult and complex task due to the distributed nature of the systems. In this work, a framework is proposed and implemented to assess FL algorithms in a more easy and scalable way. This framework is evaluated over a distributed edge-like environment managed by a container orchestration platform (i.e. Kubernetes).

Submission history

From: Juliano Wickboldt [view email]
[v1]
Wed, 17 Jul 2024 19:52:53 UTC (2,870 KB)



Source link
lol

By stp2y

Leave a Reply

Your email address will not be published. Required fields are marked *

No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.