An associability decay model of paradoxical choice

Carter W. Daniels, Federico Sanabria

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

Paradoxical choices in human and nonhuman animals represent substantial deviations from rational models of behavior; such deviations often demand models that incorporate multiple perspectives, including psychology, biology, and economics. The past couple of decades have seen an increased interest in the paradoxical choice of pigeons in 2-armed bandit tasks (2ABT) developed by Zentall and colleagues. In these 2ABTs, pigeons, but not rats, systematically choose an alternative that yields less reward over multiple trials but provides more information on events within a trial, over an alternative that yields more reward over trials but provides less information on events within a trial. Although current computational models account for much of the extant data generated in studies on 2ABT choice, they do not explain, in a trial-by-trial basis, how pigeons learn to ignore some stimuli and not others in 2ABTs. To address the provenance of this differential allocation of attention, a simple model composed of Bush-Mosteller linear operators and a Pearce-Hall-like associability mechanism is proposed. This model, referred to as the Associability Decay Model (ADM) of paradoxical choice, adequately accounts for the performance of pigeons and rats in 2ABTs. The ADM yields an untested prediction that is inconsistent with other computational models of 2ABT performance, and offers potential explanations for why differences in motivation, social enrichment, and impulsivity alter the degree to which pigeons systematically choose information despite earning fewer rewards. The success of the ADM shows that a relatively simple dynamic trial-by-trial model can account for much of the extant paradoxical-choice data while identifying opportunities for further study and refinement of models of 2ABT performance.

Original languageEnglish (US)
Pages (from-to)258-271
Number of pages14
JournalJournal of Experimental Psychology: Animal Learning and Cognition
Volume44
Issue number3
DOIs
StatePublished - Jul 1 2018

Fingerprint

Columbidae
deterioration
Reward
pigeons
Task Performance and Analysis
Impulsive Behavior
Motivation
social enrichment
Economics
Psychology
trial
psychology
rats
provenance
Biological Sciences
economics

Keywords

  • Attention
  • Paradoxical choice
  • Pearce-Hall
  • Pigeons
  • Rats

ASJC Scopus subject areas

  • Ecology, Evolution, Behavior and Systematics
  • Experimental and Cognitive Psychology

Cite this

An associability decay model of paradoxical choice. / Daniels, Carter W.; Sanabria, Federico.

In: Journal of Experimental Psychology: Animal Learning and Cognition, Vol. 44, No. 3, 01.07.2018, p. 258-271.

Research output: Contribution to journalArticle

@article{e775918fe0cd448c86d89b252ec2067c,
title = "An associability decay model of paradoxical choice",
abstract = "Paradoxical choices in human and nonhuman animals represent substantial deviations from rational models of behavior; such deviations often demand models that incorporate multiple perspectives, including psychology, biology, and economics. The past couple of decades have seen an increased interest in the paradoxical choice of pigeons in 2-armed bandit tasks (2ABT) developed by Zentall and colleagues. In these 2ABTs, pigeons, but not rats, systematically choose an alternative that yields less reward over multiple trials but provides more information on events within a trial, over an alternative that yields more reward over trials but provides less information on events within a trial. Although current computational models account for much of the extant data generated in studies on 2ABT choice, they do not explain, in a trial-by-trial basis, how pigeons learn to ignore some stimuli and not others in 2ABTs. To address the provenance of this differential allocation of attention, a simple model composed of Bush-Mosteller linear operators and a Pearce-Hall-like associability mechanism is proposed. This model, referred to as the Associability Decay Model (ADM) of paradoxical choice, adequately accounts for the performance of pigeons and rats in 2ABTs. The ADM yields an untested prediction that is inconsistent with other computational models of 2ABT performance, and offers potential explanations for why differences in motivation, social enrichment, and impulsivity alter the degree to which pigeons systematically choose information despite earning fewer rewards. The success of the ADM shows that a relatively simple dynamic trial-by-trial model can account for much of the extant paradoxical-choice data while identifying opportunities for further study and refinement of models of 2ABT performance.",
keywords = "Attention, Paradoxical choice, Pearce-Hall, Pigeons, Rats",
author = "Daniels, {Carter W.} and Federico Sanabria",
year = "2018",
month = "7",
day = "1",
doi = "10.1037/xan0000179",
language = "English (US)",
volume = "44",
pages = "258--271",
journal = "Journal of experimental psychology. Animal learning and cognition",
issn = "2329-8456",
publisher = "American Psychological Association Inc.",
number = "3",

}

TY - JOUR

T1 - An associability decay model of paradoxical choice

AU - Daniels, Carter W.

AU - Sanabria, Federico

PY - 2018/7/1

Y1 - 2018/7/1

N2 - Paradoxical choices in human and nonhuman animals represent substantial deviations from rational models of behavior; such deviations often demand models that incorporate multiple perspectives, including psychology, biology, and economics. The past couple of decades have seen an increased interest in the paradoxical choice of pigeons in 2-armed bandit tasks (2ABT) developed by Zentall and colleagues. In these 2ABTs, pigeons, but not rats, systematically choose an alternative that yields less reward over multiple trials but provides more information on events within a trial, over an alternative that yields more reward over trials but provides less information on events within a trial. Although current computational models account for much of the extant data generated in studies on 2ABT choice, they do not explain, in a trial-by-trial basis, how pigeons learn to ignore some stimuli and not others in 2ABTs. To address the provenance of this differential allocation of attention, a simple model composed of Bush-Mosteller linear operators and a Pearce-Hall-like associability mechanism is proposed. This model, referred to as the Associability Decay Model (ADM) of paradoxical choice, adequately accounts for the performance of pigeons and rats in 2ABTs. The ADM yields an untested prediction that is inconsistent with other computational models of 2ABT performance, and offers potential explanations for why differences in motivation, social enrichment, and impulsivity alter the degree to which pigeons systematically choose information despite earning fewer rewards. The success of the ADM shows that a relatively simple dynamic trial-by-trial model can account for much of the extant paradoxical-choice data while identifying opportunities for further study and refinement of models of 2ABT performance.

AB - Paradoxical choices in human and nonhuman animals represent substantial deviations from rational models of behavior; such deviations often demand models that incorporate multiple perspectives, including psychology, biology, and economics. The past couple of decades have seen an increased interest in the paradoxical choice of pigeons in 2-armed bandit tasks (2ABT) developed by Zentall and colleagues. In these 2ABTs, pigeons, but not rats, systematically choose an alternative that yields less reward over multiple trials but provides more information on events within a trial, over an alternative that yields more reward over trials but provides less information on events within a trial. Although current computational models account for much of the extant data generated in studies on 2ABT choice, they do not explain, in a trial-by-trial basis, how pigeons learn to ignore some stimuli and not others in 2ABTs. To address the provenance of this differential allocation of attention, a simple model composed of Bush-Mosteller linear operators and a Pearce-Hall-like associability mechanism is proposed. This model, referred to as the Associability Decay Model (ADM) of paradoxical choice, adequately accounts for the performance of pigeons and rats in 2ABTs. The ADM yields an untested prediction that is inconsistent with other computational models of 2ABT performance, and offers potential explanations for why differences in motivation, social enrichment, and impulsivity alter the degree to which pigeons systematically choose information despite earning fewer rewards. The success of the ADM shows that a relatively simple dynamic trial-by-trial model can account for much of the extant paradoxical-choice data while identifying opportunities for further study and refinement of models of 2ABT performance.

KW - Attention

KW - Paradoxical choice

KW - Pearce-Hall

KW - Pigeons

KW - Rats

UR - http://www.scopus.com/inward/record.url?scp=85050135609&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85050135609&partnerID=8YFLogxK

U2 - 10.1037/xan0000179

DO - 10.1037/xan0000179

M3 - Article

VL - 44

SP - 258

EP - 271

JO - Journal of experimental psychology. Animal learning and cognition

JF - Journal of experimental psychology. Animal learning and cognition

SN - 2329-8456

IS - 3

ER -