Skip to content
Kenneth L. Judd
  • Home
  • Teaching
    • Numerical Methods Course by Judd
    • Penn State Numerical Methods
      • Penn State 2024
      • Penn State 2023
      • Penn State 2019
      • Penn State 2018
      • Penn State 2017
      • Penn State 2015
      • Penn State 2014
      • Penn State 2013
      • Penn State 2012
      • Penn State 2011
    • University of Zurich 2020
    • 2009 Lectures at Peking and Renmin Universities
  • Commentary
    • Blog
    • Economics vs. Science
    • Freedom of Speech
  • Papers
    • Published Papers
    • Working Papers
  • Conferences
    • Initiative for Computational Economics
      • ICE 2005
      • ICE 2006
      • ICE 2007
      • ICE 2008
      • ICE 2009
      • ICE 2010
      • ICE 2011
      • ICE 2012
    • New Initiative for Computational Economics
      • nICE 2018
      • nICE 2019
      • ICE2016
      • Summer 2014 Computation at Hoover
      • Summer 2013 Computation in CA
    • Che-Lin Su Conference
      • Program
  • Research
    • Dynamic Stochastic Integration of Climate and Economy
    • FlatTax+40
    • Research Videos
  • Books
  • Privacy
Kenneth L. Judd
  • About Us
  • Academic Freedom Conference: Rationality and Academic Freedom with Steven Pinker
  • Block Content Examples
  • Blog
  • Books
  • books
  • Che-Lin Su Conference
    • Program
  • Commentary
    • Economics vs. Science
      • Economics and Computation
        • Introduction – April, 2010 version
          • American Economic Review
            • AER’s curious definition of “the literature”
            • Proof by bad analogies
          • Econometrica
          • Economists vs Computation
          • Europe: Here’s an opportunity! Take it!
          • Games and Economic Behavior
          • Long Live Ludd!
          • Review of Economic Studies
    • Freedom of Speech
      • Academic Freedom Conference
        • Academic Freedom Conference: Academia, Science, and Public Health: Will Trust Return with Scott Atlas
        • Academic Freedom Conference: Academic Freedom in Law and Legal Education with Ilya Shapiro, Eugene Volokh, and Michael McConell
        • Academic Freedom Conference: Academic Freedom in STEM with Jerry Coyne, Luana Maroja, Anna Krylov, Mimi St Johns
        • Academic Freedom Conference: Academic Freedom Solutions with Dorian Abbot, Peter Arcidiacono, Richard Lowery, John Hasnas
        • Academic Freedom Conference: Academic Freedom: What Is It and What Is It For? with Lukianoff, Strossen, Shweder, and Robbins
        • Academic Freedom Conference: Academica, Science, and Public Health: Will Trust Return with Scott Atlas version 2
        • Academic Freedom Conference: Are the Humanities Liberal? with John Rose, Solveig Gold, and Joseph Manson
        • Academic Freedom Conference: Climate Science and Biomedical Sciences with Lomborg, Bhattacharya, Ioannidis, and Diffenbaugh
        • Academic Freedom Conference: Opening Remarks by John H. Cochrane
          • Academic Freedom Conference: The End of the Future with Peter Thiel
        • Academic Freedom Conference: The Cost of Academic Dissent with Amy Wax, Joshua Katz, Elizabeth Weiss, and Frances Widdowson
        • Academic Freedom Conference: The Economics of Academic Freedom with Niall Ferguson, Tyler Cowen, and John H. Cochrane
        • Academic Freedom Conference: The Radicalization of the Academy with Lee Jussim
        • Academic Freedom Conference: The State of Higher Education with Gad Saad, John Ellis, and Eric Kauffman
        • Academic Freedom Conference: The War on the West with Jordan Peterson and Douglas Murray in conversation
        • Academic Freedom Conference: Why Has It Gotten Harder to Find the Truth with Jonathan Haidt
      • Trump Must Go 2021
        • Trump Must Go January 7, 2021 Email
    • Trump Must Go
  • Conferences
    • ICE 2005
      • ICE 2005 Participants
      • ICE 2005 Personnel
      • ICE 2005 Photos
      • ICE 2005 Poster Session Winners
      • ICE 2005 Program Description
      • ICE 2005 Schedule
    • ICE 2006
      • ICE 2006 Participants
      • ICE 2006 Personnel
      • ICE 2006 Program Description
      • ICE 2006 Schedule
      • ICE 2006 Supplemental Resources
    • ICE 2007
      • ICE 2007 Personnel
      • ICE 2007 Program Description
      • ICE 2007 Schedule
      • ICE 2007 Supplemental Resources
    • ICE 2008
      • ICE 2008 Personnel
      • ICE 2008 Program Description
      • ICE 2008 Schedule
      • ICE 2008 Student Presentations
      • ICE 2008 Supplemental Resources
    • ICE 2009
      • ICE 2009 Personnel
      • ICE 2009 Photos
      • ICE 2009 Program Description
      • ICE 2009 Schedule
      • ICE 2009 Student Presentations
    • ICE 2010
      • ICE 2010 Personnel
      • ICE 2010 Program Description
      • ICE 2010 Schedule
      • ICE 2010 Supplemental Materials
    • ICE 2011
      • ICE 2011 Personnel
      • ICE 2011 Program Description
      • ICE 2011 Schedule
    • ICE 2012
      • Benjamin Skrainka’s Reading List
      • ICE 2012 Personnel
      • ICE 2012 Program Description
      • ICE 2012 Schedule
    • nICE 2016
  • Contact
  • Contact Us
  • Documentation for “Tyranny of the Top Five”
  • Documentation for “Tyranny of the Top Five” – Original
  • Econometrica versus confidentiality
  • Economics and Computation
    • Econometrica
      • “We mean something else by ‘we’ “
      • Feelings
      • I reject your paper – here are my reasons and I am sure I am infallible
      • The ES (North America) Council: A Barrier to Progress
  • FlatTax+40
  • Homepage
  • Initiative for Computational Economics
  • judd home page
  • Judd Lecture Materials
  • Ken Judd Home Page
  • Ken Judd Home Page Old
  • Landing Page
  • New Initiative for Computational Economics
    • ICE2016
    • nICE 2018
    • nICE 2019
  • Other Useful Information and Warnings
  • Paarsch Lecture Materials
  • Papers
  • Penn State 2022
  • posts page
  • Privacy Policy
  • Program
  • Published Papers
  • Research Projects
    • Dynamic Stochastic Integration of Climate and Economy
      • DICE_N vs DICE_CJL
        • CJL-flexible time period
          • CJL1
          • CJL10
          • CJL2
          • CJL4
          • CJL8
          • CJLhalf
          • CJLquarter
          • Terminal Value Function
        • DICE-N and Solvers
          • DICE with unconstrainted investment and Solvers
        • Nordhaus original code
          • output
        • Nordhaus unconstrained investment
          • output
        • Notes in Nordhaus original code
          • Code Simplified
        • template
      • Open Science Letter
        • General Discussion
        • Introduction
        • Results
          • CJL – one half year
            • GAMS Code
          • CJL – one quarter year
            • GAMS Code
          • CJL – One Year
            • GAMS Code
          • DICE2007 – Ten Year Time Step
            • GAMS Code
  • Research Videos
  • Skrainka Lecture Materials
  • Summer 2013 Computation in CA
  • Summer 2013 Computation in CA Accommodations
  • Summer 2013 Computation in CA Housing Info from Karl
  • Summer 2013 Computation in CA Participants
  • Summer 2013 Computation in CA Schedule
  • Summer 2014 Computation at Hoover
  • Summer 2014 Computation at Hoover Participants
  • Summer 2014 Computation at Hoover Schedule
  • Summer 2014 Computation at Hoover: Housing Info from Karl
  • Teaching
    • 2009 Lectures at Peking and Renmin Universities
      • AMPL
      • Class Notes
      • Matlab Software
      • Other Useful Slides
    • Numerical Methods Course by Judd
      • Lecture 05: Nonlinear Equations
      • Lecture 06: Constrained optimization theory and methods
      • Lecture 07: Constrained optimization applications
      • Lecture 08: Structural Estimation I
      • Lecture 09: Finite-difference ODEs
      • Lecture 13: Approximation I
      • Lecture 21: Perturbation methods
      • Lecture 01: Introduction
      • Lecture 02: Computer Arithmetic
      • Lecture 03: Linear algebra and equations
      • Lecture 04: Unconstrained optimization
      • Lecture 10: Version Control Using Git
      • Lecture 11: Automatic Differentiation
      • Lecture 12: Homotopy
      • Lecture 14: Numerical quadrature MC qMC
      • Lecture 15: Dynamic optimization equilibrium NLCEQ
      • Lecture 16: Dynamic programming-discrete state
      • Lecture 17: Structural estimation II
      • Lecture 18: Dynamic programming-continuous state
      • Lecture 19: Projection methods I
      • Lecture 20: Projection Methods II
      • Lecture 22: Modern Approximation
      • Lecture 23: Dynamic Games
      • Lecture 24: Multi Objective Optimization
      • Lecture 25: Structural estimation III
      • Bonus Lecture: Macroeconomics
      • Lecture 26: DSICE
      • Lecture 27: Concluding remarks
    • Penn State Numerical Methods
      • Penn State 2014
        • DownWithLogLin
        • DSICE
          • Open_Science_Letter
            • Results
        • FAQ
        • Iterative Methods
      • Penn State 2015
        • Lecture Notes
        • Michelangeli Papers
        • Papers
        • XSEDE
      • Penn State 2017
      • Penn State 2018
      • Penn State 2019
      • Penn State 2020
      • Penn State 2021
        • Penn State 2021, March 16: Discrete-state dynamic programming
        • Penn State 2021, March 18: MPEC, NFXP, Algorithms and Software
        • Penn State 2021, March 23: Not your grandfather’s confidence intervals
        • Penn State 2021, March 25: Macro-based empirical micro
        • Penn State 2021, March 25: SimEcon: A possible path for economics
        • Penn State 2021: Comments related to student presentations
      • Penn State 2023
      • Penn State 2024
      • Penn State 2011
        • Approximation
        • Doraszelski-Judd Paper and RAND’s rejection
        • Dynamic Programming
        • Judd Maliar Maliar
        • Quadrature
        • Structural Estimation
      • Penn State 2012
      • Penn State 2013
    • University of Zurich 2020
      • Bonus Lecture: Macroeconomics
      • Lecture 01: Introduction
      • Lecture 02: Computer Arithmetic
      • Lecture 03: Linear algebra and equations
      • Lecture 04: Unconstrained optimization
      • Lecture 05: Nonlinear Equations
      • Lecture 06: Constrained optimization theory and methods
      • Lecture 08: Structural Estimation I
      • Lecture 09: Finite-difference ODEs
      • Lecture 10: Version Control Using Git
      • Lecture 11: Automatic Differentiation
      • Lecture 12: Homotopy
      • Lecture 13: Approximation I
      • Lecture 14: Numerical quadrature MC qMC
      • Lecture 15: Dynamic optimization equilibrium NLCEQ
      • Lecture 16: Dynamic programming-discrete state
      • Lecture 17: Structural estimation II
      • Lecture 18: Dynamic programming-continuous state
      • Lecture 19: Projection methods I
      • Lecture 20: Projection Methods II
      • Lecture 21: Perturbation methods
      • Lecture 22: Modern Approximation
      • Lecture 23: Dynamic Games
      • Lecture 24: Multi Objective Optimization
      • Lecture 25: Structural estimation III
      • Lecture 26: DSICE
      • Lecture 27: Concluding remarks
      • Lecture 07: Constrained optimization applications
  • The Fed and its Models
    • Is extra computational power useful?
    • Is macro underfunded?
    • Pictures are important
    • Questions about FRB/US
    • We knew 2008 could happen
  • Things to do when you are done coding
  • Trust No One
  • Working Papers

Lecture 16: Dynamic programming-discrete state

Chapter 12. Value function iteration, policy iteration, acceleration methods.

Lecture 16: Discrete State DP

Course home page

Copyright © 2024 Kenneth L. Judd | Powered by Astra WordPress Theme