The role of timing in reinforcement schedule performance

J. E R Staddon, Clive Wynne, J. J. Higa

Research output: Contribution to journalArticle

18 Citations (Scopus)

Abstract

Reinforcement schedules produce distinctive and reliable temporal patterns of behavior. Temporal discrimination is known to be an important ingredient in these patterns. We sketch a simple dynamic model for the discrimination of short time intervals, linear waiting, in terms of four assumptions: that the time before the onset of the reinforced response, waiting time, is determined by the food delay in the just-preceding interfood interval; that waiting is triggered by the most recent time marker; that different delays signaled by the same time marker are averaged; and that the effectiveness of a given stimulus as a time marker is limited by memory constraints. We show that recursive application of linear waiting can generate contiguity learning and many molecular patterns of behavior on interval schedules, such as the fixed-interval "scallop" and interresponse times on variable-interval schedules, as well as molar properties such as the hyperbolic relation between response and reinforcement rates on variable-interval schedules. Linear waiting also implies the high response rates on ratio schedules and their instability. Linear waiting does not seem able to account for differences in response rates between ratio and interval schedules equated for reinforcement rate, molar response functions on ratio schedules, and some features of responding on cyclic schedules. These failures highlight our limited understanding of the role of memory in timing and hint at additional mechanisms.

Original languageEnglish (US)
Pages (from-to)200-225
Number of pages26
JournalLearning and Motivation
Volume22
Issue number1-2
DOIs
StatePublished - 1991
Externally publishedYes

Fingerprint

Reinforcement Schedule
reinforcement
Appointments and Schedules
performance
discrimination
Pectinidae
time
stimulus
food
Learning
Food

ASJC Scopus subject areas

  • Behavioral Neuroscience
  • Developmental and Educational Psychology
  • Experimental and Cognitive Psychology
  • Neuropsychology and Physiological Psychology

Cite this

The role of timing in reinforcement schedule performance. / Staddon, J. E R; Wynne, Clive; Higa, J. J.

In: Learning and Motivation, Vol. 22, No. 1-2, 1991, p. 200-225.

Research output: Contribution to journalArticle

Staddon, J. E R ; Wynne, Clive ; Higa, J. J. / The role of timing in reinforcement schedule performance. In: Learning and Motivation. 1991 ; Vol. 22, No. 1-2. pp. 200-225.
@article{ea873a2f26004bbbb329e02b77d3ac33,
title = "The role of timing in reinforcement schedule performance",
abstract = "Reinforcement schedules produce distinctive and reliable temporal patterns of behavior. Temporal discrimination is known to be an important ingredient in these patterns. We sketch a simple dynamic model for the discrimination of short time intervals, linear waiting, in terms of four assumptions: that the time before the onset of the reinforced response, waiting time, is determined by the food delay in the just-preceding interfood interval; that waiting is triggered by the most recent time marker; that different delays signaled by the same time marker are averaged; and that the effectiveness of a given stimulus as a time marker is limited by memory constraints. We show that recursive application of linear waiting can generate contiguity learning and many molecular patterns of behavior on interval schedules, such as the fixed-interval {"}scallop{"} and interresponse times on variable-interval schedules, as well as molar properties such as the hyperbolic relation between response and reinforcement rates on variable-interval schedules. Linear waiting also implies the high response rates on ratio schedules and their instability. Linear waiting does not seem able to account for differences in response rates between ratio and interval schedules equated for reinforcement rate, molar response functions on ratio schedules, and some features of responding on cyclic schedules. These failures highlight our limited understanding of the role of memory in timing and hint at additional mechanisms.",
author = "Staddon, {J. E R} and Clive Wynne and Higa, {J. J.}",
year = "1991",
doi = "10.1016/0023-9690(91)90023-2",
language = "English (US)",
volume = "22",
pages = "200--225",
journal = "Learning and Motivation",
issn = "0023-9690",
publisher = "Academic Press Inc.",
number = "1-2",

}

TY - JOUR

T1 - The role of timing in reinforcement schedule performance

AU - Staddon, J. E R

AU - Wynne, Clive

AU - Higa, J. J.

PY - 1991

Y1 - 1991

N2 - Reinforcement schedules produce distinctive and reliable temporal patterns of behavior. Temporal discrimination is known to be an important ingredient in these patterns. We sketch a simple dynamic model for the discrimination of short time intervals, linear waiting, in terms of four assumptions: that the time before the onset of the reinforced response, waiting time, is determined by the food delay in the just-preceding interfood interval; that waiting is triggered by the most recent time marker; that different delays signaled by the same time marker are averaged; and that the effectiveness of a given stimulus as a time marker is limited by memory constraints. We show that recursive application of linear waiting can generate contiguity learning and many molecular patterns of behavior on interval schedules, such as the fixed-interval "scallop" and interresponse times on variable-interval schedules, as well as molar properties such as the hyperbolic relation between response and reinforcement rates on variable-interval schedules. Linear waiting also implies the high response rates on ratio schedules and their instability. Linear waiting does not seem able to account for differences in response rates between ratio and interval schedules equated for reinforcement rate, molar response functions on ratio schedules, and some features of responding on cyclic schedules. These failures highlight our limited understanding of the role of memory in timing and hint at additional mechanisms.

AB - Reinforcement schedules produce distinctive and reliable temporal patterns of behavior. Temporal discrimination is known to be an important ingredient in these patterns. We sketch a simple dynamic model for the discrimination of short time intervals, linear waiting, in terms of four assumptions: that the time before the onset of the reinforced response, waiting time, is determined by the food delay in the just-preceding interfood interval; that waiting is triggered by the most recent time marker; that different delays signaled by the same time marker are averaged; and that the effectiveness of a given stimulus as a time marker is limited by memory constraints. We show that recursive application of linear waiting can generate contiguity learning and many molecular patterns of behavior on interval schedules, such as the fixed-interval "scallop" and interresponse times on variable-interval schedules, as well as molar properties such as the hyperbolic relation between response and reinforcement rates on variable-interval schedules. Linear waiting also implies the high response rates on ratio schedules and their instability. Linear waiting does not seem able to account for differences in response rates between ratio and interval schedules equated for reinforcement rate, molar response functions on ratio schedules, and some features of responding on cyclic schedules. These failures highlight our limited understanding of the role of memory in timing and hint at additional mechanisms.

UR - http://www.scopus.com/inward/record.url?scp=0000083210&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0000083210&partnerID=8YFLogxK

U2 - 10.1016/0023-9690(91)90023-2

DO - 10.1016/0023-9690(91)90023-2

M3 - Article

VL - 22

SP - 200

EP - 225

JO - Learning and Motivation

JF - Learning and Motivation

SN - 0023-9690

IS - 1-2

ER -