To successfully work on variable selection, sparse model structure has become
a basic assumption for all existing methods. However, this assumption is
questionable as it is hard to hold in most of cases and none of existing
methods may provide consistent estimation and accurate model prediction in
nons-parse scenarios.
For consistency (even oracle properties) of estimation and model prediction,
almost all existing methods of variable/feature selection critically depend on
sparsity of models. However, for ``large $p$ and small $n$" models sparsity
assumption is hard to check and particularly, when this assumption is violated,
the consistency of all existing estimations is usually impossible because
working models selected by existing methods such as the LASSO and the Dantzig
selector are usually biased. To attack this problem, we in this paper propose
adaptive post-Dantzig estimation and model prediction.
In this paper, we propose a covariate-adjusted nonlinear regression model. In
this model, both the response and predictors can only be observed after being
distorted by some multiplicative factors. Because of nonlinearity, existing
methods for the linear setting cannot be directly employed. To attack this
problem, we propose estimating the distorting functions by nonparametrically
regressing the predictors and response on the distorting covariate; then,
nonlinear least squares estimators for the parameters are obtained using the
estimated response and predictors.