How to calculate confidence interval of parameter estimated by global optimization--pattern search

7 次查看(过去 30 天)
Hi everyone,
I recently used pattern search to find the global minimal. Though the algorithm worked very well to find me a solution, I do not know how to estimate the confidence interval for these predicted values. Different from local lsqcurvefit which offers output can be used to calculate confidence interval directly, pattern search does not that output.
So I would like to know normally how do people handle this after they get their global minimal solution? How do they perform a uncertainty test on their prediction? And do they generally perform any other statistical analysis/inference on it? Any suggestion will be highly appreciated!
Rui

回答(2 个)

Matt J
Matt J 2013-6-8
编辑:Matt J 2013-6-10
It's usually pretty hard to get statistical information about a solution for general problems. I imagine most people just measure statistical variation of the solution by running repeated simulations.
The methods you're talking about usually assume that all of the following are true of the problem
  1. It is unconstrained and differentiable
  2. It uses a least squares objective function
  3. The residuals are Gaussian distributed.
If that is your situation, you could compute the Jacobian at the solution yourself. Or, once you've found the solution, you can feed it to LSQCURVEFIT as an initial point and use its Jacobian output in the usual way. LSQCURVEFIT should stop in 1 iteration, since your solution is already optimal.
  5 个评论
Matt J
Matt J 2013-6-10
编辑:Matt J 2013-6-10
What I meant was, computing statistical variation based on data repetitions that are not i.i.d. sounds problematic.
Rui
Rui 2013-6-10
Matt, that's true. We have 7 compounds. Data set (concentration time course, several data points) for each compound is from a different paper. Our model has a few compound-specific but known parameters, and a few parameters same across compounds, which we try to estimate. These parameters are estimated by minimizing errors between pooled simulation and pooled data with a global algorithm. Can we still use bootstrap safely under this situation?

请先登录,再进行评论。


Shashank Prasanna
Shashank Prasanna 2013-6-10
There are no analytic approximations for CIs for pattern search similar to linear regression. The best alternative as you note is to use a resampling technique. Of course you are further away from an ideal world if you violate MattJ points.
BOOTCI is probably your best bet:
  7 个评论
Matt J
Matt J 2013-6-11
Then time concentration curves are randomly picked according to a uniform distribution. According to the curves chosen, corresponding simulations are made from our model.
If each simulated trial is randomized based on the same uniform distribution, then yes, it does sound i.i.d.

请先登录,再进行评论。

类别

Help CenterFile Exchange 中查找有关 Repeated Measures and MANOVA 的更多信息

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by