Sequential Monte Carlo (SMC) methods are a class of techniques to sample
approximately from any sequence of probability distributions using a
combination of importance sampling and resampling steps. This paper is
concerned with the convergence analysis of a class of SMC methods where the
times at which resampling occurs are computed online using criteria such as the
effective sample size. This is a popular approach amongst practitioners but
there are very few convergence results available for these methods.
While statisticians are well-accustomed to performing exploratory analysis in
the modeling stage of an analysis, the notion of conducting preliminary
general-purpose exploratory analysis in the Monte Carlo stage (or more
generally, the model-fitting stage) of an analysis is an area which we feel
deserves much further attention. Towards this aim, this paper proposes a
general-purpose algorithm for automatic density exploration.
Let $\mathscr{P}(E)$ be the space of probability measures on a measurable
space $(E,\mathcal{E})$. In this paper we introduce a class of nonlinear Markov
chain Monte Carlo (MCMC) methods for simulating from a probability measure
$\pi\in\mathscr{P}(E)$. Nonlinear Markov kernels (see [Feynman--Kac Formulae:
Genealogical and Interacting Particle Systems with Applications (2004)
Springer]) $K:\mathscr{P}(E)\times E\rightarrow\mathscr{P}(E)$ can be
constructed to, in some sense, improve over MCMC methods.
Sequential Monte Carlo methods, also known as particle methods, are a widely
used set of computational tools for inference in non-linear non-Gaussian
state-space models. In many applications it may be necessary to compute the
sensitivity, or derivative, of the optimal filter with respect to the static
parameters of the state-space model; for instance, in order to obtain maximum
likelihood model parameters of interest, or to compute the optimal controller
in an optimal control problem. In Poyiadjis et al.
Sequential Monte Carlo (SMC) methods are a widely used set of computational
tools for inference in non-linear non-Gaussian state-space models. We propose a
new SMC algorithm to compute the expectation of additive functionals
recursively. Essentially, it is an online or forward-only implementation of a
forward filtering backward smoothing SMC algorithm proposed in Doucet .et .al
(2000).
We present a new class of interacting Markov chain Monte Carlo algorithms for
solving numerically discrete-time measure-valued equations. The associated
stochastic processes belong to the class of self-interacting Markov chains. In
contrast to traditional Markov chains, their time evolutions depend on the
occupation measure of their past values. This general methodology allows us to
provide a natural way to sample from a sequence of target probability measures
of increasing complexity.
In practical nonlinear filtering, the assessment of achievable filtering
performance is important. In this paper, we focus on the problem of efficiently
approximate the posterior Cramer-Rao lower bound (CRLB) in a recursive manner.
By using Gaussian assumptions, two types of approximations for calculating the
CRLB are proposed: An exact model using the state estimate as well as a
Taylor-series-expanded model using both of the state estimate and its error
covariance, are derived. Moreover, the difference between the two approximated
CRLBs is also formulated analytically.
In the following paper we provide a review and development of sequential
Monte Carlo (SMC) methods for option pricing. SMC are a class of Monte
Carlo-based algorithms, that are designed to approximate expectations w.r.t a
sequence of related probability measures. These approaches have been used,
successfully, for a wide class of applications in engineering, statistics,
physics and operations research. SMC methods are highly suited to many option
pricing problems and sensitivity/Greek calculations due to the nature of the
sequential simulation.
Several particle algorithms admit a Feynman-Kac representation such that the
potential function may be expressed as a recursive function which depends on
the complete state trajectory. An important example is the mixture Kalman
filter, but other models and algorithms of practical interest fall in this
category. We study the asymptotic stability of such particle algorithms as time
goes to infinity. As a corollary, practical conditions for the stability of the
mixture Kalman filter, and a mixture GARCH filter, are derived.
We design a particle interpretation of Feynman-Kac measures on path spaces
based on a backward Markovian representation combined with a traditional mean
field particle interpretation of the flow of their final time marginals. In
contrast to traditional genealogical tree based models, these new particle
algorithms can be used to compute normalized additive functionals "on-the-fly"
as well as their limiting occupation measures with a given precision degree
that does not depend on the final time horizon.