The Dynamics of Conditioning and Extinction

Peter R. Killeen, Federico Sanabria, Igor Dolgov

Research output: Contribution to journalArticle

20 Citations (Scopus)

Abstract

Pigeons responded to intermittently reinforced classical conditioning trials with erratic bouts of responding to the conditioned stimulus. Responding depended on whether the prior trial contained a peck, food, or both. A linear persistence-learning model moved pigeons into and out of a response state, and a Weibull distribution for number of within-trial responses governed in-state pecking. Variations of trial and intertrial durations caused correlated changes in rate and probability of responding and in model parameters. A novel prediction-in the protracted absence of food, response rates can plateau above zero-was validated. The model predicted smooth acquisition functions when instantiated with the probability of food but a more accurate jagged learning curve when instantiated with trial-to-trial records of reinforcement. The Skinnerian parameter was dominant only when food could be accelerated or delayed by pecking. These experiments provide a framework for trial-by-trial accounts of conditioning and extinction that increases the information available from the data, permitting such accounts to comment more definitively on complex contemporary models of momentum and conditioning.

Original languageEnglish (US)
Pages (from-to)447-472
Number of pages26
JournalJournal of Experimental Psychology: Animal Behavior Processes
Volume35
Issue number4
DOIs
StatePublished - Oct 2009

Fingerprint

conditioned behavior
conditioning
extinction
Food
pecking
Columbidae
pigeons
learning
Classical Conditioning
Learning Curve
food
momentum
plateaus
Learning
duration
prediction
trial
Psychological Extinction
Conditioning (Psychology)
erratic

Keywords

  • autoshaping
  • behavioral momentum
  • classical conditioning
  • dynamic analyses
  • instrumental conditioning

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Ecology, Evolution, Behavior and Systematics

Cite this

The Dynamics of Conditioning and Extinction. / Killeen, Peter R.; Sanabria, Federico; Dolgov, Igor.

In: Journal of Experimental Psychology: Animal Behavior Processes, Vol. 35, No. 4, 10.2009, p. 447-472.

Research output: Contribution to journalArticle

@article{6db193a2f402400992277158d35f7236,
title = "The Dynamics of Conditioning and Extinction",
abstract = "Pigeons responded to intermittently reinforced classical conditioning trials with erratic bouts of responding to the conditioned stimulus. Responding depended on whether the prior trial contained a peck, food, or both. A linear persistence-learning model moved pigeons into and out of a response state, and a Weibull distribution for number of within-trial responses governed in-state pecking. Variations of trial and intertrial durations caused correlated changes in rate and probability of responding and in model parameters. A novel prediction-in the protracted absence of food, response rates can plateau above zero-was validated. The model predicted smooth acquisition functions when instantiated with the probability of food but a more accurate jagged learning curve when instantiated with trial-to-trial records of reinforcement. The Skinnerian parameter was dominant only when food could be accelerated or delayed by pecking. These experiments provide a framework for trial-by-trial accounts of conditioning and extinction that increases the information available from the data, permitting such accounts to comment more definitively on complex contemporary models of momentum and conditioning.",
keywords = "autoshaping, behavioral momentum, classical conditioning, dynamic analyses, instrumental conditioning",
author = "Killeen, {Peter R.} and Federico Sanabria and Igor Dolgov",
year = "2009",
month = "10",
doi = "10.1037/a0015626",
language = "English (US)",
volume = "35",
pages = "447--472",
journal = "Journal of Experimental Psychology: Animal Behavior Processes",
issn = "0097-7403",
publisher = "American Psychological Association Inc.",
number = "4",

}

TY - JOUR

T1 - The Dynamics of Conditioning and Extinction

AU - Killeen, Peter R.

AU - Sanabria, Federico

AU - Dolgov, Igor

PY - 2009/10

Y1 - 2009/10

N2 - Pigeons responded to intermittently reinforced classical conditioning trials with erratic bouts of responding to the conditioned stimulus. Responding depended on whether the prior trial contained a peck, food, or both. A linear persistence-learning model moved pigeons into and out of a response state, and a Weibull distribution for number of within-trial responses governed in-state pecking. Variations of trial and intertrial durations caused correlated changes in rate and probability of responding and in model parameters. A novel prediction-in the protracted absence of food, response rates can plateau above zero-was validated. The model predicted smooth acquisition functions when instantiated with the probability of food but a more accurate jagged learning curve when instantiated with trial-to-trial records of reinforcement. The Skinnerian parameter was dominant only when food could be accelerated or delayed by pecking. These experiments provide a framework for trial-by-trial accounts of conditioning and extinction that increases the information available from the data, permitting such accounts to comment more definitively on complex contemporary models of momentum and conditioning.

AB - Pigeons responded to intermittently reinforced classical conditioning trials with erratic bouts of responding to the conditioned stimulus. Responding depended on whether the prior trial contained a peck, food, or both. A linear persistence-learning model moved pigeons into and out of a response state, and a Weibull distribution for number of within-trial responses governed in-state pecking. Variations of trial and intertrial durations caused correlated changes in rate and probability of responding and in model parameters. A novel prediction-in the protracted absence of food, response rates can plateau above zero-was validated. The model predicted smooth acquisition functions when instantiated with the probability of food but a more accurate jagged learning curve when instantiated with trial-to-trial records of reinforcement. The Skinnerian parameter was dominant only when food could be accelerated or delayed by pecking. These experiments provide a framework for trial-by-trial accounts of conditioning and extinction that increases the information available from the data, permitting such accounts to comment more definitively on complex contemporary models of momentum and conditioning.

KW - autoshaping

KW - behavioral momentum

KW - classical conditioning

KW - dynamic analyses

KW - instrumental conditioning

UR - http://www.scopus.com/inward/record.url?scp=70350434161&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350434161&partnerID=8YFLogxK

U2 - 10.1037/a0015626

DO - 10.1037/a0015626

M3 - Article

VL - 35

SP - 447

EP - 472

JO - Journal of Experimental Psychology: Animal Behavior Processes

JF - Journal of Experimental Psychology: Animal Behavior Processes

SN - 0097-7403

IS - 4

ER -