Laplace based approximate posterior inference for differential equation models
Ordinary differential equations are arguably the most popular and useful mathematical tool for describing physical and biological processes in the real world. Often, these physical and biological processes are observed with errors, in which case the most natural way to model such data is via regress...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Published: |
Springer New York LLC
2017
|
| Online Access: | https://www.scopus.com/inward/record.uri?eid=2-s2.0-84961615481&doi=10.1007%2fs11222-016-9647-0&partnerID=40&md5=d758663601ac280ee350e0e7a75f3a05 http://eprints.utp.edu.my/19515/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| id |
my.utp.eprints.19515 |
|---|---|
| record_format |
eprints |
| spelling |
my.utp.eprints.195152018-04-20T06:05:39Z Laplace based approximate posterior inference for differential equation models Dass, S.C. Lee, J. Lee, K. Park, J. Ordinary differential equations are arguably the most popular and useful mathematical tool for describing physical and biological processes in the real world. Often, these physical and biological processes are observed with errors, in which case the most natural way to model such data is via regression where the mean function is defined by an ordinary differential equation believed to provide an understanding of the underlying process. These regression based dynamical models are called differential equation models. Parameter inference from differential equation models poses computational challenges mainly due to the fact that analytic solutions to most differential equations are not available. In this paper, we propose an approximation method for obtaining the posterior distribution of parameters in differential equation models. The approximation is done in two steps. In the first step, the solution of a differential equation is approximated by the general one-step method which is a class of numerical numerical methods for ordinary differential equations including the Euler and the Runge-Kutta procedures; in the second step, nuisance parameters are marginalized using Laplace approximation. The proposed Laplace approximated posterior gives a computationally fast alternative to the full Bayesian computational scheme (such as Makov Chain Monte Carlo) and produces more accurate and stable estimators than the popular smoothing methods (called collocation methods) based on frequentist procedures. For a theoretical support of the proposed method, we prove that the Laplace approximated posterior converges to the actual posterior under certain conditions and analyze the relation between the order of numerical error and its Laplace approximation. The proposed method is tested on simulated data sets and compared with the other existing methods. © 2016, Springer Science+Business Media New York. Springer New York LLC 2017 Article PeerReviewed https://www.scopus.com/inward/record.uri?eid=2-s2.0-84961615481&doi=10.1007%2fs11222-016-9647-0&partnerID=40&md5=d758663601ac280ee350e0e7a75f3a05 Dass, S.C. and Lee, J. and Lee, K. and Park, J. (2017) Laplace based approximate posterior inference for differential equation models. Statistics and Computing, 27 (3). pp. 679-698. http://eprints.utp.edu.my/19515/ |
| institution |
Universiti Teknologi Petronas |
| building |
UTP Resource Centre |
| collection |
Institutional Repository |
| continent |
Asia |
| country |
Malaysia |
| content_provider |
Universiti Teknologi Petronas |
| content_source |
UTP Institutional Repository |
| url_provider |
http://eprints.utp.edu.my/ |
| description |
Ordinary differential equations are arguably the most popular and useful mathematical tool for describing physical and biological processes in the real world. Often, these physical and biological processes are observed with errors, in which case the most natural way to model such data is via regression where the mean function is defined by an ordinary differential equation believed to provide an understanding of the underlying process. These regression based dynamical models are called differential equation models. Parameter inference from differential equation models poses computational challenges mainly due to the fact that analytic solutions to most differential equations are not available. In this paper, we propose an approximation method for obtaining the posterior distribution of parameters in differential equation models. The approximation is done in two steps. In the first step, the solution of a differential equation is approximated by the general one-step method which is a class of numerical numerical methods for ordinary differential equations including the Euler and the Runge-Kutta procedures; in the second step, nuisance parameters are marginalized using Laplace approximation. The proposed Laplace approximated posterior gives a computationally fast alternative to the full Bayesian computational scheme (such as Makov Chain Monte Carlo) and produces more accurate and stable estimators than the popular smoothing methods (called collocation methods) based on frequentist procedures. For a theoretical support of the proposed method, we prove that the Laplace approximated posterior converges to the actual posterior under certain conditions and analyze the relation between the order of numerical error and its Laplace approximation. The proposed method is tested on simulated data sets and compared with the other existing methods. © 2016, Springer Science+Business Media New York. |
| format |
Article |
| author |
Dass, S.C. Lee, J. Lee, K. Park, J. |
| spellingShingle |
Dass, S.C. Lee, J. Lee, K. Park, J. Laplace based approximate posterior inference for differential equation models |
| author_facet |
Dass, S.C. Lee, J. Lee, K. Park, J. |
| author_sort |
Dass, S.C. |
| title |
Laplace based approximate posterior inference for differential equation models |
| title_short |
Laplace based approximate posterior inference for differential equation models |
| title_full |
Laplace based approximate posterior inference for differential equation models |
| title_fullStr |
Laplace based approximate posterior inference for differential equation models |
| title_full_unstemmed |
Laplace based approximate posterior inference for differential equation models |
| title_sort |
laplace based approximate posterior inference for differential equation models |
| publisher |
Springer New York LLC |
| publishDate |
2017 |
| url |
https://www.scopus.com/inward/record.uri?eid=2-s2.0-84961615481&doi=10.1007%2fs11222-016-9647-0&partnerID=40&md5=d758663601ac280ee350e0e7a75f3a05 http://eprints.utp.edu.my/19515/ |
| _version_ |
1738656081055318016 |
| score |
13.211869 |