Quasi-maximum likelihood estimate
In statistics a quasi-maximum likelihood estimate (QMLE), also known as a pseudo-likelihood estimate or a composite likelihood estimate, is an estimate of a parameter θ in a statistical model that is formed by maximizing a function that is related to the logarithm of the likelihood function, but in discussing the consistency and (asymptotic) variance-covariance matrix, we assume some parts of the distribution may be mis-specified.[1][2] In contrast, the maximum likelihood estimate maximizes the actual log likelihood function for the data and model. The function that is maximized to form a QMLE is often a simplified form of the actual log likelihood function. A common way to form such a simplified function is to use the log-likelihood function of a misspecified model that treats certain data values as being independent, even when in actuality they may not be. This removes any parameters from the model that are used to characterize these dependencies. Doing this only makes sense if the dependency structure is a nuisance parameter with respect to the goals of the analysis. [3] As long as the quasi-likelihood function that is maximized is not oversimplified, the QMLE (or composite likelihood estimate) is consistent and asymptotically normal. It is less efficient than the maximum likelihood estimate, but may only be slightly less efficient if the quasi-likelihood is constructed so as to minimize the loss of information relative to the actual likelihood.[4] Standard approaches to statistical inference that are used with maximum likelihood estimates, such as the formation of confidence intervals, and statistics for model comparison,[5] can be generalized to the quasi-maximum likelihood setting.
See also
[edit]References
[edit]- ^ Lindsay, Bruce G. (1988). "Composite likelihood methods". Statistical inference from stochastic processes (Ithaca, NY, 1987). Contemporary Mathematics. Vol. 80. Providence, RI: American Mathematical Society. pp. 221–239. doi:10.1090/conm/080/999014. MR 0999014.
- ^ Davidson, Russel; MacKinnon, James (2004). Econometric Theory and Methods. New York, New York: Oxford University Press. ISBN 978-0-19-512372-2.
- ^ Gourieroux, Christian; Monfort, Alain; Trognon, Alain (1984). "Pseudo Maximum Likelihood Methods: Theory" (PDF). Econometrica. 52 (3): 681–700. doi:10.2307/1913471. JSTOR 1913471. S2CID 122981013.
- ^ Cox, D.R.; Reid, Nancy (2004). "A note on pseudo-likelihood constructed from marginal densities". Biometrika. 91 (3): 729–737. CiteSeerX 10.1.1.136.7476. doi:10.1093/biomet/91.3.729.
- ^ Varin, Cristiano; Vidoni, Paolo (2005). "A note on composite likelihood inference and model selection" (PDF). Biometrika. 92 (3): 519–528. doi:10.1093/biomet/92.3.519.