Numerical solution of Hamilton-Jacobi-Bellman equations by an exponentially fitted finite volume method

Steven Richardson, Song Wang

    Research output: Contribution to journal › Article

    16 Citations (Scopus)

    Abstract

    In this article, we present a numerical method for solving Hamilton-Jacobi-Bellman (HJB) equations governing a class of optimal feedback control problems. This method is based on a finite volume discretisation in state space coupled with an exponentially fitted difference technique. The time discretisation of the method is the backward Euler finite difference scheme, which is unconditionally stable. It is shown that the system matrix of the resulting discrete equations is an M-matrix. To demonstrate the effectiveness of this approach, numerical experiments on test problems with up to three states and three control variables were performed. The numerical results show that the method yields accurate approximate solutions to both the control and state variables.
    Original languageEnglish
    Pages (from-to)121-140
    JournalOptimization
    Volume55
    Issue number1/52
    DOIs
    Publication statusPublished - 2006

    Fingerprint

    Hamilton-Jacobi-Bellman Equation
    Finite volume method
    Finite Volume Method
    Numerical Solution
    Feedback control
    Optimal Feedback Control
    Numerical methods
    Unconditionally Stable
    M-matrix
    Discrete Equations
    Time Discretization
    Finite Volume
    Finite Difference Scheme
    Test Problems
    Euler
    Control Problem
    State Space
    Approximate Solution
    Discretization
    Numerical Methods

    Cite this

    Richardson, Steven ; Wang, Song. / Numerical solution of Hamilton-Jacobi-Bellman equations by an exponentially fitted finite volume method. In: Optimization. 2006 ; Vol. 55, No. 1/52. pp. 121-140.
    @article{a05c8baf70bb49ceb6155d8f186fcc63,
    title = "Numerical solution of Hamilton-Jacobi-Bellman equations by an exponentially fitted finite volume method",
    abstract = "In this article, we present a numerical method for solving Hamilton-Jacobi-Bellman (HJB) equations governing a class of optimal feedback control problems. This method is based on a finite volume discretisation in state space coupled with an exponentially fitted difference technique. The time discretisation of the method is the backward Euler finite difference scheme, which is unconditionally stable. It is shown that the system matrix of the resulting discrete equations is an M-matrix. To demonstrate the effectiveness of this approach, numerical experiments on test problems with up to three states and three control variables were performed. The numerical results show that the method yields accurate approximate solutions to both the control and state variables.",
    author = "Steven Richardson and Song Wang",
    year = "2006",
    doi = "10.1080/02331930500530237",
    language = "English",
    volume = "55",
    pages = "121--140",
    journal = "Optimization",
    issn = "0233-1934",
    publisher = "Taylor & Francis",
    number = "1/52",

    }

    Richardson, S & Wang, S 2006, 'Numerical solution of Hamilton-Jacobi-Bellman equations by an exponentially fitted finite volume method' Optimization, vol. 55, no. 1/52, pp. 121-140. https://doi.org/10.1080/02331930500530237

    Numerical solution of Hamilton-Jacobi-Bellman equations by an exponentially fitted finite volume method. / Richardson, Steven; Wang, Song.

    In: Optimization, Vol. 55, No. 1/52, 2006, p. 121-140.

    Research output: Contribution to journal › Article

    TY - JOUR

    T1 - Numerical solution of Hamilton-Jacobi-Bellman equations by an exponentially fitted finite volume method

    AU - Richardson, Steven

    AU - Wang, Song

    PY - 2006

    Y1 - 2006

    N2 - In this article, we present a numerical method for solving Hamilton-Jacobi-Bellman (HJB) equations governing a class of optimal feedback control problems. This method is based on a finite volume discretisation in state space coupled with an exponentially fitted difference technique. The time discretisation of the method is the backward Euler finite difference scheme, which is unconditionally stable. It is shown that the system matrix of the resulting discrete equations is an M-matrix. To demonstrate the effectiveness of this approach, numerical experiments on test problems with up to three states and three control variables were performed. The numerical results show that the method yields accurate approximate solutions to both the control and state variables.

    AB - In this article, we present a numerical method for solving Hamilton-Jacobi-Bellman (HJB) equations governing a class of optimal feedback control problems. This method is based on a finite volume discretisation in state space coupled with an exponentially fitted difference technique. The time discretisation of the method is the backward Euler finite difference scheme, which is unconditionally stable. It is shown that the system matrix of the resulting discrete equations is an M-matrix. To demonstrate the effectiveness of this approach, numerical experiments on test problems with up to three states and three control variables were performed. The numerical results show that the method yields accurate approximate solutions to both the control and state variables.

    U2 - 10.1080/02331930500530237

    DO - 10.1080/02331930500530237

    M3 - Article

    VL - 55

    SP - 121

    EP - 140

    JO - Optimization

    JF - Optimization

    SN - 0233-1934

    IS - 1/52

    ER -

    Richardson S, Wang S. Numerical solution of Hamilton-Jacobi-Bellman equations by an exponentially fitted finite volume method. Optimization. 2006;55(1/52):121-140. https://doi.org/10.1080/02331930500530237

    Access to Document