[Submitted on 3 Oct 2024]
View a PDF of the paper titled Accelerating Deep Learning with Fixed Time Budget, by Muhammad Asif Khan and 2 other authors
Abstract:The success of modern deep learning is attributed to two key elements: huge amounts of training data and large model sizes. Where a vast amount of data allows the model to learn more features, the large model architecture boosts the learning capability of the model. However, both these factors result in prolonged training time. In some practical applications such as edge-based learning and federated learning, limited-time budgets necessitate more efficient training methods. This paper proposes an effective technique for training arbitrary deep learning models within fixed time constraints utilizing sample importance and dynamic ranking. The proposed method is extensively evaluated in both classification and regression tasks in computer vision. The results consistently show clear gains achieved by the proposed method in improving the learning performance of various state-of-the-art deep learning models in both regression and classification tasks.
Submission history
From: Muhammad Asif Khan [view email]
[v1]
Thu, 3 Oct 2024 21:18:04 UTC (6,482 KB)
Source link
lol
