The Japanese Psychonomic Society
NII-Electronic Library Service
The JapanesePsychonomic Society
11ie
Jopanese
Jbumal
o,.fPs,yehonomic
Science
2004,
VvL
23,
A'o,
1,
107-108
Summaryof
Awarded
Presentation2P044
The
interrelationship
theof
recognition
of
facial
six
basic
emotions
expression
of
Atsunobu
SuzuKi,Takahiro
HosmNo,i)
The
Uitiversit.v
qf
Tokyoand
Kazuo
SHIGEMASU
*An
interrelationship
in
the
recognitionof
facial
expressions
ofthe
sixbasic
and specificemetions
has
been
inferrcd
from
neurologicalcases
who
have
displayed
adisproportionatc
impairment
in
recognizingthem.
The
previous
reports,however,
nre s・,ulnerableto
thc
criticism
that
the
apparent
emotion-specific
inipairments
are merety artifactsdue
to
the
variouslevc]s
ofdifficulty
in
rccognisingthe
different
emotions,Wc
propose
a
new
methed
for
the
assessment
ofrecognition of
facial
expression.In
thts
mcthod,
the
dithculty
artifact$
arc
fully
controlledby
means
of
morphing anditem
responsetheory
CIRT),
We
used a morphingtechnique
to
create
intermediate
facial
expre$$ions
which
would
have
variouslevels
ofdiraculty
for
recognising each ernotion.By
usingIRT,
the
sensitivityto
the
expressions
was
estimatcdby
taking
account ofdifferential
diMculty
leve]s,
The
results revealedthat
a
sen$itivity
to
happiness
alone was notcorrelated
with
a
sensitivity
to
the
other emotions, andindicated
that
the
recognition
ot
happiness
wasindependent.
'
iKey
words:facial
expression recognition,basic
ernotions, morphing,item
response
theory
<IRT}
It
is
well-knownfrom
the
literature
that
there
is
a
moderately common, cross-cultural abilityto
recog-nise
facial
expressions
which show atleast
asubset
of
emotions,
the
so-called
basic
emotions:
happiness,
surprise,fear,
anger,
disgust,
and
sadness.
The
issue
of
an
interrelation$hip
betwcen
the
recognition ofthe
six
basic
emotions
is
controversial, Neuropsy-chological research reportshavc
indicated
that
focal
brain
damage
can causc adisproportionate
impair-rnent
in
the
recognition offacial
expressions of spe-ciflc emotions,especially
fear
and
disgust.
The
result
suggeststhat
there
are neuralsubstrates
that
are
specialized
for
rccognizing certain emotions,A
broad
deficit
in
recognizing
emotions
whieh ure nothappiness
atso
indicates
a
major
differentiation
be-tween
the
recognition ofhappiness
andthe
otheremotions,
Thc
previous
reports,however,
have
been
criticizedfor
alack
of control overthe
different
levels
of recognitiondifficulty
acrossthe
emotions.
*
Department
of
Cognitive
and
Behavioral
ence,
Graduate
School
of
Arts
and
Sciences,
Thc
University
ofTok},o,
3-8-1
Komaba,
Meguro-ku,
Tokyo
153-8902
i)
Takahiro
Hoshine
is
now atthe
Division
ofHumanities
and
Social
Sciences,
Departmcnt
ofInterdi$ciplinary
Statistics,
The
Institute
of
Statistical
Mathernatics.
The
critics
have
arguedthat
the
apparentemotion-specific
impairments
are merely artifactsthat
aredue
to
differentia]
difilculty
levels
acrossthe
cmo-tions,
The
present
articleproposes
a new methodthat
is
designcd
to
assessthe
recognition
of
emotiona]
facial
expression as"the
sensitivityto
basic
emotions
indi-catedby
facial
expressions",or
simply
"sensitivityscore$".
In
this
method,participants
arc askedto
ratethe
emotional
intensity
ol
morphed
iacial
expres-sions,
andtheir
scnsitivity scores are estimatcdby
app]ying
item
responsetheory
CIRT)
to
their
ratingresponscs.
Morphing
canprovide
stimuli withvari-ous
levels
of recognitiendifliculty
for
each
emotion.
An
elaboratepsychometric
measurementof
IRT
en-ables
the
estimation
of
sensitivity
scores,depending
both
onthe
ratingresponses
of
the
participants
andon
the
properties
ofthe
stimulus
which
affcct
the
recognition
difflculty
(Embretson
&
Reise,
2000).
[n
this
study,by
usingthe
new method, weex-plored
the
relationship
of
recognition ofthe
sixbasic
emotions shown
in
facial
expressionswithout
the
confounding
factor
ofdifficulty
artifacts.Method
undergradu-The Japanese Psychonomic Society
NII-Electronic Library Service
TheJapanesePsychonomic Society
108
The
Japanese
Journal
of
Psych
ates,
of
whorn
340
were
males,
with anage
range
of18
to
31
years.
Taskandstimuli
The
participants
were
tested
together
in
a
large
classroom
with alarge
screen atthe
front,
Each
of36
black-and-white
photographs
of
facial
expressions waspresented
onthe
screenfor
25
seconds.
During
the
presentation
of each stimulusthe
participants
were askeclto
iate
the
emotionalinten$ity
of eachfacial
expression with respectto
the
six
basic
emotions.
The
ratings
weremade
on a6-point
scale,from
O
{not
at all)to
5
(very
much),Six
ofthe
36
photographs
were
prototypical
im-ages
of
the
six
basic
emotions,
posed
by
a
Japanese
woman,
Each
of
the
other
30
stimuli were morphedimages
oftwo
different
prototypical
photographs,
For
each ofthe
15
possiblc
pairs
of
the
six
proto-types,
two
morphs were createdby
b]cnding
in
the
proportions
of60:40,
and vice versa.The
order ofthe
36
stimuli
wa$
quasi-randomized
with
the
constraintthat
anytwo
images
containingthe
sameprototypical
expression were notpresented
consecutively.
IRT
model
The
scores ofthe
sensitivityto
anyspecific
basic
emotion were estimatedby
applying agraded-response
model
to
the
participants'
rating
re-sponses
to
11
fa
¢ial
images
containingthe
corre-sponding emotion.Results
Thc
IRT
estimates ofthe
sensitivity scores showedconsiderable variability
among
the
participants,
and
their
distributiens
displayed
a unimodal and roughlysymmetrical curve
for
each emotion.This
resultindicated
that
the
sensitivity scoreswere
netdis-torted
by
diMculty
factors,
The
correlations
of
the
sensitivity scores of eachbasic
emotion
are
shown
in
Table
1.
The
sensitivity
scores
of
the
five
basic
emotions,
excludinghappi-ness,
were
significantly
andpositively
correlated
with each other.The
sensitivity scoreof
happiness,
however,
was
not
cerrelated
with
that
of
any
other
emotlon,We
conducted an exp16ratoryfactor
analysis
to
further
examinethe
correlation structure ofthe
sixonomlcScience
VoL
23,
No.
1
Table
1
Correlation
ofthe
sensitivity sceresHA
su
FE
AN
DI
suFEANDISA
O.O09
O.O06
O.O17・-O.O17
O.077
0.366*O.624*
e.351*
O,550*
O.412*
O.511*
O.417*o.sle*O.567*
O,430*
Nbte,
HA;happiness,
SU=surprise,
FE=fear,
AN
=: anger,DI=disgust,
SA
= sadness.*p<O.OOL
sensitivities,
A
scree
plot
revealed
that
the
first
factor
alone
had
an
outstanding
eigenvalue{2.9),
when compared
to
the
following
factors
(O.4-1.0),
indicating
that
a
one-factor
model
was
appropriate.
The
variance
explained
by
the
first
factor
was40%,
and
the
factor
loadings
wereO.027
for
happiness,
O.770
for
surprise.O.525
for
fear,
O.773
for
anger,
O.683
for
disgust,
and
O.697
for
sadness.
This
result
rneant an aimost nullfactor
loading
for
happiness.
Discussion
Analyses
ofthe
correlation structure ofthe
sensi-tivity
to
different
ernotions
confirmed
the
indepen-dence
of
a
recognition
sensitivity
for
happiness,
rath-erthan
acompletedissociation/association
ofrecog-nition
sensitivity
for
each
emotion.
AIthough
previ-ous
studies
which
reported
an
independence
for
the
recognition
of
happiness
have
been
attackedfor
not controllingdiMculty
artifacts,
the
present
studyap-pears
to
have
contrelled
these
artifacts
successfully,
because
the
distributions
ofthe
sensitivity scores are approximately normaLBecause
happiness
is
the
only completelypositive
emotion ofthe
sixbasic
emotions, andthe
others are mostly negative,the
finding
suggests an orthogonalitybctween
positive
emotion
recognition
and
negative
emotion
recogni-tion,
It
wouldbe
desirable
to
use several otherpositive
emotions
in
any
future
researchwhich
at-tempted
to
establish
this
orthogonality.