In the economics literature, there are two dominant approaches for solving models with optimal experimentation (also called active learning). The first approach is based on the value function and the second on an approximation method. In principle the value function approach is the preferred method. However, it suffers from the curse of dimensionality and is only applicable to small problems with a limited number of policy variables. The approximation method allows for a computationally larger class of models, but may produce results that deviate from the optimal solution. Our simulations indicate that when the effects of learning are limited, the differences may be small. However, when there is sufficient scope for learning, the value function solution seems more aggressive in the use of the policy variable.

Amman, H.M., Kendrick, D.A., Tucci, M.P. (2020). Approximating the value function for optimal experimentation. MACROECONOMIC DYNAMICS, 24(5), 1073-1086 [10.1017/S1365100518000664].

Approximating the value function for optimal experimentation

MARCO P. TUCCI
Methodology
2020-01-01

Abstract

In the economics literature, there are two dominant approaches for solving models with optimal experimentation (also called active learning). The first approach is based on the value function and the second on an approximation method. In principle the value function approach is the preferred method. However, it suffers from the curse of dimensionality and is only applicable to small problems with a limited number of policy variables. The approximation method allows for a computationally larger class of models, but may produce results that deviate from the optimal solution. Our simulations indicate that when the effects of learning are limited, the differences may be small. However, when there is sufficient scope for learning, the value function solution seems more aggressive in the use of the policy variable.
2020
Amman, H.M., Kendrick, D.A., Tucci, M.P. (2020). Approximating the value function for optimal experimentation. MACROECONOMIC DYNAMICS, 24(5), 1073-1086 [10.1017/S1365100518000664].
File in questo prodotto:
File Dimensione Formato  
approximating_the_value_function_for_optimal_experimentation.pdf

non disponibili

Tipologia: PDF editoriale
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 492.84 kB
Formato Adobe PDF
492.84 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11365/1067405