dc.contributor.author | Krnjajic, Milovan | |
dc.date.accessioned | 2013-11-11T16:48:50Z | |
dc.date.available | 2013-11-11T16:48:50Z | |
dc.date.issued | 2011 | |
dc.identifier.citation | Draper, David (2011) Bayesian Model Specification: Some problems related to model choice and calibration Proceedings of AMSA 2011, Novosibirsk, Russia | en_US |
dc.identifier.uri | http://hdl.handle.net/10379/3804 | |
dc.description.abstract | In the development of Bayesian model specification for inference and prediction we
focus on the conditional distributions p([theta],[beta]) and p(D[theta],[beta]), with data D and background
assumptions [beta], and consider calibration (an assessment of how often we get the right
answers) as an important integral step of the model development. We compare several
predictive model-choice criteria and present related calibration results. In particular, we
have implemented a simulation study to compare predictive model-choice criteria LS[cv] ,
a log-score based on cross-validation, LS[fs], a full-sample log score, with deviance information
criterion, DIC. We show that for several classes of models DIC and LS[cv] are
(strongly) negatively correlated; that LS[fs] has better small-sample model discrimination
performance than either DIC, or LS[cv] ; we further demonstrate that when validating
the model-choice results, a standard use of posterior predictive tail-area for hypothesis
testing can be poorly calibrated and present a method for its proper calibration. | en_US |
dc.format | application/pdf | en_US |
dc.language.iso | en | en_US |
dc.relation.ispartof | Proceedings of AMSA 2011, Novosibirsk, Russia | en |
dc.rights | Attribution-NonCommercial-NoDerivs 3.0 Ireland | |
dc.rights.uri | https://creativecommons.org/licenses/by-nc-nd/3.0/ie/ | |
dc.subject | Log-score | en_US |
dc.subject | Deviance information criterion | en_US |
dc.subject | Posterior predictive tail areas | en_US |
dc.subject | Hypothesis testing | en_US |
dc.title | Bayesian Model Specification: Some problems related to model choice and calibration | en_US |
dc.type | Conference Paper | en_US |
dc.date.updated | 2013-11-06T22:56:36Z | |
dc.description.peer-reviewed | non-peer-reviewed | |
dc.contributor.funder | |~| | |
dc.internal.rssid | 1162428 | |
dc.local.contact | Milovan Krnjajic, School Of Mathematics Statistics, Room C205, Aras De Brun, Nui Galway. 2327 Email: milovan.krnjajic@nuigalway.ie | |
dc.local.copyrightchecked | Yes | |
dc.local.version | PUBLISHED | |
nui.item.downloads | 345 | |