It is now known that an extended Gaussian process model equipped with
rescaling can adapt to different smoothness levels of a function valued
parameter in many nonparametric Bayesian analyses, offering a posterior
convergence rate that is optimal (up to logarithmic factors) for the smoothness
class the true function belongs to. This optimal rate also depends on the
dimension of the function's domain and one could potentially obtain a faster
rate of convergence by casting the analysis in a lower dimensional subspace
that does not amount to any loss of information about the true function.
Predictive recursion is an accurate and computationally efficient algorithm
for nonparametric estimation of mixing densities in mixture models. In
semiparametric mixture models, however, the algorithm fails to account for any
uncertainty in the additional unknown structural parameter. As an alternative
to existing profile likelihood methods, we treat predictive recursion as a
filter approximation to fitting a fully Bayes model, whereby an approximate
marginal likelihood of the structural parameter emerges and can be used for
inference.
Mixture models have received considerable attention recently and Newton
[Sankhy\={a} Ser. A 64 (2002) 306--322] proposed a fast recursive algorithm for
estimating a mixing distribution. We prove almost sure consistency of this
recursive estimate in the weak topology under mild conditions on the family of
densities being mixed. This recursive estimate depends on the data ordering and
a permutation-invariant modification is proposed, which is an average of the
original over permutations of the data sequence.