A Nonconvex Implementation of Sparse Subspace Clustering: Algorithm and Convergence Analysis

• Main Authors: Xiaoge Deng, Tao Sun, Peibing Du, Dongsheng Li
• Format: Article
• Language: English
• Published: IEEE 2020-01-01
• Series: IEEE Access
• Subjects: Sparse subspace clustering; nonconvex approximation; ADMM; reweighted algorithms
• Online Access: https://ieeexplore.ieee.org/document/9040629/

Subspace clustering has been widely applied to detect meaningful clusters in high-dimensional data spaces. And the sparse subspace clustering (SSC) obtains superior clustering performance by solving a relaxed ℓ₀-minimization problem with ℓ₁-norm. Although the use of ℓ₁-norm instead of the ℓ₀ one can make the object function convex, it causes large errors on large coefficients in some cases. In this paper, we study the sparse subspace clustering algorithm based on a nonconvex modeling formulation. Specifically, we introduce a nonconvex pseudo-norm that makes a better approximation to the ℓ₀-minimization than the traditional ℓ₁-minimization framework and consequently finds a better affinity matrix. However, this formulation makes the optimization task challenging due to that the traditional alternating direction method of multipliers (ADMM) encounters troubles in solving the nonconvex subproblems. In view of this, the reweighted techniques are employed in making these subproblems convex and easily solvable. We provide several guarantees to derive the convergence results, which proves that the nonconvex algorithm is globally convergent to a critical point. Experiments on two real-world problems of motion segmentation and face clustering show that our method outperforms state-of-the-art techniques.