The Bayan Algorithm: Detecting Communities in Networks Through Exact and Approximate Optimization of Modularity

AmazUtah_NLP at SemEval-2024 Task 9: A MultiChoice Question Answering System for Commonsense Defying Reasoning


View a PDF of the paper titled The Bayan Algorithm: Detecting Communities in Networks Through Exact and Approximate Optimization of Modularity, by Samin Aref and 2 other authors

View PDF
HTML (experimental)

Abstract:Community detection is a classic network problem with extensive applications in various fields. Its most common method is using modularity maximization heuristics which rarely return an optimal partition or anything similar. Partitions with globally optimal modularity are difficult to compute, and therefore have been underexplored. Using structurally diverse networks, we compare 30 community detection methods including our proposed algorithm that offers optimality and approximation guarantees: the Bayan algorithm. Unlike existing methods, Bayan globally maximizes modularity or approximates it within a factor. Our results show the distinctive accuracy and stability of maximum-modularity partitions in retrieving planted partitions at rates higher than most alternatives for a wide range of parameter settings in two standard benchmarks. Compared to the partitions from 29 other algorithms, maximum-modularity partitions have the best medians for description length, coverage, performance, average conductance, and well clusteredness. These advantages come at the cost of additional computations which Bayan makes possible for small networks (networks that have up to 3000 edges in their largest connected component). Bayan is several times faster than using open-source and commercial solvers for modularity maximization, making it capable of finding optimal partitions for instances that cannot be optimized by any other existing method. Our results point to a few well performing algorithms, among which Bayan stands out as the most reliable method for small networks. A Python implementation of the Bayan algorithm (bayanpy) is publicly available through the package installer for Python (pip).

Submission history

From: Samin Aref [view email]
[v1]
Sat, 10 Sep 2022 00:17:09 UTC (151 KB)
[v2]
Thu, 6 Apr 2023 15:35:14 UTC (218 KB)
[v3]
Sat, 8 Jul 2023 16:23:56 UTC (59 KB)
[v4]
Tue, 17 Sep 2024 18:51:45 UTC (617 KB)



Source link
lol

By stp2y

Leave a Reply

Your email address will not be published. Required fields are marked *

No widgets found. Go to Widget page and add the widget in Offcanvas Sidebar Widget Area.