Information-Theoretic Bounded Rationality and ε-Optimality

Bounded rationality concerns the study of decision makers with limited information processing resources. Previously, the free energy difference functional has been suggested to model bounded rational decision making, as it provides a natural trade-off between an energy or utility function that is to...

Full description

Bibliographic Details
Main Authors: Daniel A. Braun, Pedro A. Ortega
Format: Article
Language:English
Published: MDPI AG 2014-08-01
Series:Entropy
Subjects:
Online Access:http://www.mdpi.com/1099-4300/16/8/4662
id doaj-baec67c9f6274acd88157aeba28f7bd5
record_format Article
spelling doaj-baec67c9f6274acd88157aeba28f7bd52020-11-24T21:02:06ZengMDPI AGEntropy1099-43002014-08-011684662467610.3390/e16084662e16084662Information-Theoretic Bounded Rationality and ε-OptimalityDaniel A. Braun0Pedro A. Ortega1Max Planck Institute for Biological Cybernetics, Max Planck Institute for Intelligent Systems, Spemannstrasse 38, Tübingen 72076, GermanyGRASP Laboratory, Electrical and Systems Engineering Department, University of Pennsylvania, Philadelphia, PA 19104, USABounded rationality concerns the study of decision makers with limited information processing resources. Previously, the free energy difference functional has been suggested to model bounded rational decision making, as it provides a natural trade-off between an energy or utility function that is to be optimized and information processing costs that are measured by entropic search costs. The main question of this article is how the information-theoretic free energy model relates to simple ε-optimality models of bounded rational decision making, where the decision maker is satisfied with any action in an ε-neighborhood of the optimal utility. We find that the stochastic policies that optimize the free energy trade-off comply with the notion of ε-optimality. Moreover, this optimality criterion even holds when the environment is adversarial. We conclude that the study of bounded rationality based on ε-optimality criteria that abstract away from the particulars of the information processing constraints is compatible with the information-theoretic free energy model of bounded rationality.http://www.mdpi.com/1099-4300/16/8/4662bounded rationalityε-optimalityprobabilistic choiceambiguity
collection DOAJ
language English
format Article
sources DOAJ
author Daniel A. Braun
Pedro A. Ortega
spellingShingle Daniel A. Braun
Pedro A. Ortega
Information-Theoretic Bounded Rationality and ε-Optimality
Entropy
bounded rationality
ε-optimality
probabilistic choice
ambiguity
author_facet Daniel A. Braun
Pedro A. Ortega
author_sort Daniel A. Braun
title Information-Theoretic Bounded Rationality and ε-Optimality
title_short Information-Theoretic Bounded Rationality and ε-Optimality
title_full Information-Theoretic Bounded Rationality and ε-Optimality
title_fullStr Information-Theoretic Bounded Rationality and ε-Optimality
title_full_unstemmed Information-Theoretic Bounded Rationality and ε-Optimality
title_sort information-theoretic bounded rationality and ε-optimality
publisher MDPI AG
series Entropy
issn 1099-4300
publishDate 2014-08-01
description Bounded rationality concerns the study of decision makers with limited information processing resources. Previously, the free energy difference functional has been suggested to model bounded rational decision making, as it provides a natural trade-off between an energy or utility function that is to be optimized and information processing costs that are measured by entropic search costs. The main question of this article is how the information-theoretic free energy model relates to simple ε-optimality models of bounded rational decision making, where the decision maker is satisfied with any action in an ε-neighborhood of the optimal utility. We find that the stochastic policies that optimize the free energy trade-off comply with the notion of ε-optimality. Moreover, this optimality criterion even holds when the environment is adversarial. We conclude that the study of bounded rationality based on ε-optimality criteria that abstract away from the particulars of the information processing constraints is compatible with the information-theoretic free energy model of bounded rationality.
topic bounded rationality
ε-optimality
probabilistic choice
ambiguity
url http://www.mdpi.com/1099-4300/16/8/4662
work_keys_str_mv AT danielabraun informationtheoreticboundedrationalityandeoptimality
AT pedroaortega informationtheoreticboundedrationalityandeoptimality
_version_ 1716776579082747904