The Japanese Psychonomic Society
NII-Electronic Library Service
The Japanese?sychonomic Society
V'he
JaPanese
Jot{rnat
of
lli.v:honomic・Stience
2e02,Vol.2I,No.1,39-40
Prizewinner's
Summary
P-IA-"11
The
effect
of
reward
amount
on
discounting
of
delayed
rewards
in
ratsi)
Daisuke
SAEKi,
Tetsuo
YAMAGucHi,
and
Masato
ITo
Osaka
Cits,
Uitiversib'#
The
present
study used aconcurrent-chains
schedule
to
examine
the
effect
of
reward
amount
ondelay
discounting
in
rats.Delay
periods
dcfincd
by
fixed-interval
schedulesin
the
terminal
links
were
fixed
at
2
sin
one alternative and variedin
the
other alternative acrossfive
conditions rangingfrom
2s
to
40
s.The
reward amounts were varied acrossthree
conditionsby
manipulatingthe
numberof
food
pelrets
(1
pellet
vs.1
pellet,
5
pellets
vs.1
pelret,
and5
pellets
vs.5
pellets).
The
discounting
rate
estimated
with
a
modified
hyperbolic
function
washigher
in
the
smaller rewardamount condition
than
in
the
]arger
reward amount conditions.This
finding
indicates
that
in
animalsthe
rate ofdelay
discounting
decreases
us
the
rewardarnount
increases.
'
'
Key
words : choice,clelay
discounting,
reward amount effect, concurrent-chains schedule, ratsDelayed
rewardsare
judged
rower
in
value
than
immediate
rewardsbecause
the
delay
is
thought
to
cliscount
the
value of areward.
Studies
ofdelay
discountjng
in
human$
reported
that
the
discounting
is
welldescribed
by
the
folrowing
hyperbolic
func-tion:
v-i+Ant)
a)
where
V
is
the
discountecl
value
of
the
delayed
reward,
A
is
the
reward
amount,D
is
the
length
ofthe
delay,
andk
is
afree
parameter
representingthe
cliscounting
rate, respectively.On
the
otherhand,
some
modificationsof
Equation
1
have
been
proposed
in
studies
of
delay
discounting
in
animals.The
following
modification,a
hyperbolic
function
with an exponent, wasproposed
by
Ro-driguez
&
Logue
(1988)
because
rnany studies ofanimar choice assume no
proportional
(or
linear)
relatiOnbetween
the
reward amount(A)
andthe
subjective value
(
V)
:'
Department
of
Psychology,
Faculty
ofLiterature,
Osaka
City
University,
3-3--138
Sugirnoto
Sumiyoshi,
Osaka,
558J8585
1)
The
first
author
was supportedby
Research
Fellowships
ofthe
Japan
Society
for
the
tion
ofScience
for
Young
Scientists.
As
V ±
1+to
(2)・
where s
is
afree
parameter
representingthe
sensitiv-ity
to
A.
Some
studies
of
delay
discounting
in
humans
repor-ted
that
the
cliscounting
ratedecreases
as
the
rewardamount
increases
(e,g.,
Green,
Myerson,
&
McFad-den,
1997),
however,
this
effecthas
notbeen
reportedin
animal
studies.Therefore,
the
present
study used ratsto
examinethe
effect ofthe
reward amount onthe
discounting
raEein
terms
ofEquation
2.
Method
Subjects
Five
experimentally
naive
male
Wistar
rats
were maintained at approximately80%
oftheir
free-feeding
weight.
Apparatus
Two
standard experfmental chambers withtwo
horizontally
arranged responselevers
"iere used.A
45-mg
food
pellet
was
used
as
a
reinforcer.Procedure
The
subjects
were
exposed
to
a
concurrent-chains schedurein
which a singlevariable-interval
30-s
schedule arranged entryinto
one efthe
two
terminal-links
with equalprobability.
Fixed-interval
schedules werein
effect
for
the
terminal
links.
The
length
ofthe
de]ay
wasfixecl
at2
s
for
one(ress
delayed)
alternative and was variedfor
the
The Japanese Psychonomic Society
NII-Electronic Library Service
TheJapanesePsychonomic Society
40
'
The
Japanese
Journal
of'
other
(rnore
delayed)
alternative
acruss
five
condi-tions
(2
s,5s,
10
s,20
s,and40
s),The
number offood
pellets
presented
in
the
terminal
links
was varied acrossthree
conditions:three
pairs
of1
pellet
vs.1
pellet,
5
perlets
vs.1
pellet,
and5
pellets
vs.5
pellets
werearranged
for
the
moredelayed
andthe
less
clelayed
alternative, respectively.A
time-out
period
followed
the
shorterdelay
to
equate
atrial
duration
between
the
two
alternatives.AII
ofthe
subjects were exposedto
each ofthe
delay
and reward arnount conditions.Each
conditipn remainedfor
atleast
14
sessions and was continued until a stability criterion(Ito
&
Asaki,
1982)
wassatisfied.
Results
andDiscussion
Figure
1
showsthe
mean choiceproportions
ofthe
groups
for
the
moredelayed
alternative as afunction
of
the
delay
for
each
rewardamount
condition.
The
choice
proportions
"Terecalculated
by
dividing
the
initial-link
responses
for
the
rnore
delayed
altevnative
by
the
total
initiar-link
responses,Equation2
wastt
fitted
to
the
choiceproportions
represented as'
tion
3:
B,.
Lbtr],
(3)
B.+B,
-bIG,.
VL
where
B
is
the
initia]-link
responses,b
is
a
free
parameter
representing abias,
andM
andL
arethe
more
delayed
andless
delayed
alternatives,respec-tively,
The
sensitivity
te
the
rewardamount
(s)
can
be
specified
only
in
the
5
pellets
vs.1
pellet
condition
:the
terms
representingthe
rewardamount
(A")
are
cancelled out
in
Equatien3
for
the
other conditions,The
meanle
valuesfor
the
five
subjects were:O.049
for
the
1
pellet
vs.1
pellet
condition;O.026
for
the
5
pellets
vs.
1
pellet
condition;
and
O.030
for
the
5
pelrets
vs.5
pellets
condition.The
meanfe
valuefor.
the
1
pellet
vs.
1
pellet
condition
wassignificantly
higher
than
the
valuesfor
the
othertwo
conditions(t(4)=2.37
for
the
5
pellets
vs.1
pellet
condition andt(4)==2.42
for
the
5
pellets
vs.5
pellets
conditien,Ps
<
,05).
However
the
difference
between
the
meank
PsychonomicScience
Vol.
21,
No.1
u 1.0gg'
:i:.2
e o,i=g.E'
:/:a
}
o.4sI. n.i'6 e O.2Sij
D.: o lo 2o 3o 4oo lo 2o 3o 4Do lo 2o 3e 4oDelay
(scc)
Figurel.
TAe
meanchoice
proportions
for
the
more
delayed
alternative as afunction
ofthe
delay
for
three
pairs
of reward amount.The
curves
are
the
best
fit
for
the
modified
hyperbolic
functions
(Equation
3).
1peUeLvs.1pelletSpclEetsvs.1pellet5peUetsvs,5pellets
k
±
D.044b.IA3rL=O,97k..O.v]6s=o.gab-O,71ff\O.98
k.O.024b=1.32ri-,D2
values
for
the
5
pellets
vs.
1
perlet
condition
andthe
5
pellets
vs.
5
pellets
condition
was notsignificant.
These
results
indicate
that,
in
rats,
the
rate
of
delay
discounting
decreases
asthe
reward amountincreases.
This
finding
is
consistent with aninvestiga-tion
by
Grace
(1999).
The
study examinedthe
effect of reward amount onthe
sensitivityto
de]ay
esti-mated withthe
generalized
matchinglaw.
However
the
data
did
notyield
a statistically significantdifference
(Grace,
1999).
The
fact
that
the
direction
of
the
reward
amount
effect
is
the
sarnefor
humans
and animals suggeststhat
this
effect
is
a
general
phenomenen
onthe
dis-countirig ofthe
delayed
rewards.
References
Grace,
R.C.
1999
The
matchinglaw
anddependent
exponential
discounting
as
accounts
of
self-control choice.
Iburnag
of
the
Etpen'meninl
Anab'sis
of
Behavior,
71,
27-44.
Green,
L,,
Myerson,
J.,
&
McFaddefi,
E.
1997
Rate
oftemporal
cliscounting
clecreases
with
amount
of
reward.
Memory
&
Cagnition,
25,
715-723.
Ito,
M.,
&
Asaki,
K.
1982
Choice
behavior
of ratsin
aconcurrent-chains,schedule:
Amount
and
delay
of
reinforcement.