Stochastic Complexity for Sparse Modeling

We are concerned with the issue of modeling sparsity in statistical inference. We proposed a novel scheme to choose a model efficiently from exponentially many sparsity models based on the minimum description length principle. Surprisingly, even though the proposed criterion is often intractable, the optimal model is tractable in numerical sense.