43
11

Towards a Query-Optimal and Time-Efficient Algorithm for Clustering with a Faulty Oracle

Abstract

Motivated by applications in crowdsourced entity resolution in database, signed edge prediction in social networks and correlation clustering, Mazumdar and Saha [NIPS 2017] proposed an elegant theoretical model for studying clustering with a faulty oracle. In this model, given a set of nn items which belong to kk unknown groups (or clusters), our goal is to recover the clusters by asking pairwise queries to an oracle. This oracle can answer the query that ``do items uu and vv belong to the same cluster?''. However, the answer to each pairwise query errs with probability ε\varepsilon, for some ε(0,12)\varepsilon\in(0,\frac12). Mazumdar and Saha provided two algorithms under this model: one algorithm is query-optimal while time-inefficient (i.e., running in quasi-polynomial time), the other is time efficient (i.e., in polynomial time) while query-suboptimal. Larsen, Mitzenmacher and Tsourakakis [WWW 2020] then gave a new time-efficient algorithm for the special case of 22 clusters, which is query-optimal if the bias δ:=12ε\delta:=1-2\varepsilon of the model is large. It was left as an open question whether one can obtain a query-optimal, time-efficient algorithm for the general case of kk clusters and other regimes of δ\delta. In this paper, we make progress on the above question and provide a time-efficient algorithm with nearly-optimal query complexity (up to a factor of O(log2n)O(\log^2 n)) for all constant kk and any δ\delta in the regime when information-theoretic recovery is possible. Our algorithm is built on a connection to the stochastic block model.

View on arXiv
Comments on this paper