Towards a Query-Optimal and Time-Efficient Algorithm for Clustering with a Faulty Oracle
- FedML

Motivated by applications in crowdsourced entity resolution in database, signed edge prediction in social networks and correlation clustering, Mazumdar and Saha [NIPS 2017] proposed an elegant theoretical model for studying clustering with a faulty oracle. In this model, given a set of items which belong to unknown groups (or clusters), our goal is to recover the clusters by asking pairwise queries to an oracle. This oracle can answer the query that ``do items and belong to the same cluster?''. However, the answer to each pairwise query errs with probability , for some . Mazumdar and Saha provided two algorithms under this model: one algorithm is query-optimal while time-inefficient (i.e., running in quasi-polynomial time), the other is time efficient (i.e., in polynomial time) while query-suboptimal. Larsen, Mitzenmacher and Tsourakakis [WWW 2020] then gave a new time-efficient algorithm for the special case of clusters, which is query-optimal if the bias of the model is large. It was left as an open question whether one can obtain a query-optimal, time-efficient algorithm for the general case of clusters and other regimes of . In this paper, we make progress on the above question and provide a time-efficient algorithm with nearly-optimal query complexity (up to a factor of ) for all constant and any in the regime when information-theoretic recovery is possible. Our algorithm is built on a connection to the stochastic block model.
View on arXiv