Unbiased estimation of the gradient of the log-likelihood in inverse problems
dc.contributor.author | Jasra, Ajay | |
dc.contributor.author | Law, Kody J. H.; orcid: 0000-0003-3133-2537; email: kody.law@manchester.ac.uk | |
dc.contributor.author | Lu, Deng | |
dc.date.accessioned | 2021-05-20T16:38:02Z | |
dc.date.available | 2021-05-20T16:38:02Z | |
dc.date.issued | 2021-03-03 | |
dc.date.submitted | 2020-03-10 | |
dc.identifier | https://chesterrep.openrepository.com/bitstream/handle/10034/624546/11222_2021_Article_9994.pdf?sequence=2 | |
dc.identifier | https://chesterrep.openrepository.com/bitstream/handle/10034/624546/11222_2021_Article_9994_nlm.xml?sequence=3 | |
dc.identifier.citation | Statistics and Computing, volume 31, issue 3, page 21 | |
dc.identifier.uri | http://hdl.handle.net/10034/624546 | |
dc.description | From Springer Nature via Jisc Publications Router | |
dc.description | History: received 2020-03-10, registration 2021-01-07, accepted 2021-01-07, pub-electronic 2021-03-03, online 2021-03-03, pub-print 2021-05 | |
dc.description | Publication status: Published | |
dc.description | Funder: King Abdullah University of Science and Technology; doi: http://dx.doi.org/10.13039/501100004052; Grant(s): Baseline | |
dc.description | Funder: Alan Turing Institute; doi: http://dx.doi.org/10.13039/100012338 | |
dc.description.abstract | Abstract: We consider the problem of estimating a parameter θ∈Θ⊆Rdθ associated with a Bayesian inverse problem. Typically one must resort to a numerical approximation of gradient of the log-likelihood and also adopt a discretization of the problem in space and/or time. We develop a new methodology to unbiasedly estimate the gradient of the log-likelihood with respect to the unknown parameter, i.e. the expectation of the estimate has no discretization bias. Such a property is not only useful for estimation in terms of the original stochastic model of interest, but can be used in stochastic gradient algorithms which benefit from unbiased estimates. Under appropriate assumptions, we prove that our estimator is not only unbiased but of finite variance. In addition, when implemented on a single processor, we show that the cost to achieve a given level of error is comparable to multilevel Monte Carlo methods, both practically and theoretically. However, the new algorithm is highly amenable to parallel computation. | |
dc.language | en | |
dc.publisher | Springer US | |
dc.rights | Licence for this article: http://creativecommons.org/licenses/by/4.0/ | |
dc.source | pissn: 0960-3174 | |
dc.source | eissn: 1573-1375 | |
dc.subject | Article | |
dc.subject | Parameter estimation | |
dc.subject | Inverse problems | |
dc.subject | Unbiased estimation | |
dc.subject | Stochastic gradient | |
dc.title | Unbiased estimation of the gradient of the log-likelihood in inverse problems | |
dc.type | article | |
dc.date.updated | 2021-05-20T16:38:01Z | |
dc.date.accepted | 2021-01-07 |