Gaussian graphical models are of great interest in statistical learning.
Because the conditional independencies between different nodes correspond to
zero entries in the inverse covariance matrix of the Gaussian distribution, one
can learn the structure of the graph by estimating a sparse inverse covariance
matrix from sample data, by solving a convex maximum likelihood problem with an
$\ell_1$-regularization term.
Splitting and alternating direction methods have been widely used for solving
convex optimization problems. We present in this paper two first-order
alternating linearization algorithms based on variable splitting and
alternating linearization techniques for minimizing the sum of two convex
functions. We prove that the number of iterations needed by the first algorithm
is $O(1/\epsilon)$ to obtain an $\epsilon$-optimal solution.
We present in this paper two different classes of general $K$-splitting
algorithms for solving convex optimization problems. We prove that the number
of iterations needed by the first class of algorithms to obtain an
$\epsilon$-optimal solution is $O(1/\epsilon)$. The algorithms in the second
class are accelerated versions of those in the first class, where the
complexity result is improved to $O(1/\sqrt{\epsilon})$ while the computational
effort required at each iteration is almost unchanged.