Effect of sound on perceptual masking in apparent motion trajectory(Summary of Awarded Presentation at the 30th Annual Meeting)

The Japanese Psychonomic Society

NII-Electronic Library Service

TheJapanesePsychonomicSociety

The;apaneseJournatofPs],chonemFc'SLience

2012,NbL31,No.1,Sl

.S2

Summary

of

Awarded

PresentationIL26

Effect

ofsound

on

_perceptual

masking

in

apparent

motion

trajectory

Souta

HiDAKA*'",

Wataru

TERAMoTo*2,

and

Masayoshi

NAGAi*3

Rikkyo

University*,

iVfuroran

Institute

of

fochnology*2,

Nationat

Institute

ofAdvanced

Industrial

Science

and

7lechnology

(AIST)*3

Our

previous

study showed

that

detection

_performance

was

impaired

for

avisual

target

in

an

apparent

motion

(AM)

trajectory.

Moreover,

the

magnitude ofthis

AM

interference

became

weaker when the erientation

information

of the target was

incensistent

with

that

ofAM stimuli,

These

findings

suggest

that

internal

object representations of

AM

stimuli established

in

the

AM

trajectory

can

induce

_perceptual

masking.

The

_present

study

demonstrates

audi-tory

effects on

AM

interference:

1)

Transient

sounds

_presented

together

with

AM

stimuli can enhance

the

magni-tude

of

AM

interference,

2)

this auditory effect weakened when

the

frequencies

of

the

sounds changed

during

AM,

and

3>

the

sounds wholly strengthened

the

magnitude of

ArvT

interference

against

the

inconsistency

in

orientation

information

between

the

target and

AM

stirnuli,

These

resuLts suggest

that

sounds can contribute

to

the

robust

es-tablishment

and spatiotemporal maintenance ofthe

internal

object representation ofan

AM

stimulus.

Key

words: apparent motion,

internal

representation, audio-visual

interactjon,

_perceptual

masking

In

an apparent rnotion

CAM)

display,

illusory motion

per-ception vividly occurs even

in

a motion

trajectory

where no

physical

inputs

exist,

This

indicates

that

the

representation of

an object undergoing

AM

can

be

established aleng

the

whole

trajectory,

In

_fact,

Hidaka,

_Nagai,

_Sekuler,

_Bennett,

_&

_Gyoba

(2011)

found

that

detection

_performan[e

for

a visual

target

was

impaired

in

an

AM

trajectory

Moreove

r,

the

magnitude of

this

AM

interference

became

weaker when

the

orientation

in-formation

of

the

target

was

inconsistent

with

that

of

AM

stim-uli.

These

findings

suggest

that

internal

object representatiens

ofAM stimuli can

induce

_perceptual

masking.

Recent

studies

regarding audie-visual

interaction

have

shown

that

transient

sounds can enhance

the

_perceptual

intensity

of visuaL stimuli

(e.g.,

Stein,

London,

Wi]kinson,

&

Price,

]996).

The

_present

study

investigated

the

effect of

transient

sounds on

internal

object representations

by

using

the

magnitude ofAM

interfer-ence as an

index.

GeneralMethod

Stimuli.

We

_presented

Gabor

_patches

with

black

and

white

horjzontal

stripes

O.5

×

1.5

deg,

l,5

cycle/deg, o=O.25

deg)

as visuat stimuli against a

_gray

background

(30

cdfm2). *

_Department

_of

_Psychology,

_Riklcyo

_UniversitB

_1-2-26

Kitano,

Niiza-shi,

Saitama

352-8558,

Japan

E-mail:hidaka@rikkyo,ac.jp

#

The

_part

of the

data

in

this

summary was

_published

in

Vision

Research

(Hidaka,

Tbramoto,

&

Nagai,

2012)

Copyright2012

The

}urninance

of

inducers

for

AM

ranged

from

O.1

to

60

cdi

]n2, and

the

target's

luminance

ranged

from

15

to

45

cdlm!.

The

inducers

and

target

were vertical]y aligned.

The

distance

between

the

inducers

was

6

deg,

The

target

was

_presented

in-between

the

inducers

so

that

the

distance

between

the

target

and

inducers

was

3

deg.

'l'he

distan[e

between

a

fixation

cirde

and

targets

was

7.S

deg.

'i'he

inducers

were

_presented

for

80

ms, and

the

inter-stimulus

intervals

(ISIs)

were

106

ms.

The

target

was

_presented

for

26

ms at an

intermediate

temporal

position

between

the

inducers,

The

ISIs

between

the target

and

inducers

were

40

ms.

Tk-To

types

of

_pure

tone-400

Hz

and

2100

Hz

{SPL=75

dB)-were

used as auditory stimulL

The

duration

of ea[h

tone

was

80

ms, with rise and

fa11

times

of5

ins.

Procedllre.

In

one condjtion,

the

target

was

_presented

in-between

the

inducers

(AM-On-path).

In

a second condition,

the

horizontal

_position

of

the

inducers

was

disp]aced

relative

to

the

target

by

2

deg

_{(AM-Off-path),}

In

a third cendition, two

inducers

simultaneously

flickered

so

that

an

A)vl

was not

per-ceived

(FL)

(Figure

IA).

The

target

was randomly

_presented

once within

20

cycles of

the

ADvl

sequences.

Two

auditor},

con-ditions

were

_presented:

Transient

tones were

presented

togeth-er

with

the

inducers

in

the

seund

condition,

and

were omitted

during

the

no-sound condition.

The

task

of

the

_parti[ipants

was to report whether they

_perceiyed

the target or not,

From

the

average

_proportion

correct

for

the

target-present

and

tar-get-absent

trials,

we computed

d-primes

as an

index

of target

,

The

Japanese

Psychonomic

Society.

AII

rights reserved,

The Japanese Psychonomic Society

NII-Electronic Library Service

TheJapanesePsychonomic Society

82

The

_Japanese

_Journal

ef

Psychonomic

Science

Vbl.

31,

No.

1

detectionsensitivitv.

'

Results

Experiment

l.

We

investigated

whether sounds affected

the

magnitude of

AM

interference.

Regarding

the

obtained

d-primes

_(N=8,

Figure

1B),

a

two-way

repeated

ANOVA

with

visual conditions

(3)

× auditory conditions

(2)

revealed a sig-nificant

interaction

effect

(F(2,

14)=6,47,

_p<.05>,

A

signifi-cant main effect of auditory [onditions

in

the

AM-On-path

condition

(F(1,

21)=

10.19,

p<,O05)

revealed

that

the

d-prime

in

the

sound condition was smaller

than

that

in

the

no-sound condjtion.

This

result

demenstrates

that

the

sound enhanced

the

magnitude of

AM

interference.

Experiment

2,

In

the

second experiment, we examined

whether

frequency

changes

in

sound cou]d

influence

the

audi-tory

effect on

AM

interference.

The

AM-On-path

and

AM-Off-path

conditions were

included.

and

the

inducers

were

al-ways accompanied

by

sounds,

Whereas

the

frequency

of

the

accompanying sounds was censistent

during

the

20

AM

se-quences

in

some

trials,

the

frequencies

differed

by

O.5

octave

or

1

octave

in

the

other

trials.

Regarding

the

obtained

d-primes

(N=7),

A

2-way

repeated

ANOVA

with visual conditions

(2)

×sound

frequencies

(3)

found

asignificant

interaction

effect

(F(2,

12)=S.87,p<,05).

Concerning

a significant main effe[t of auditory

frequencies

in

the

AM-On-path

condition

(F(2,

24)=4.90,

p<.05),

a

post-hoc

test

(Tukey's

HSD,

_p<.05)

revealed

that

the

d-prime

with

O-octave

difference

was smaller than those observed with

O.5-octave

and

1-octave

differences.

This

result

indicates

that

the

magnitude of

AM

interference

was reduced when sound

frequen[ies

were varied

during

AM

relative

to

when

they

were

conslstent,

Experiment

3,

Hidaka

et al.

(201D

found

that

AM

inter-ference

weakened when orientation

information

was

inconsis-tent

between

the

target

and

AM

stimulL.

In

the

third

experi-ment, we

tested

whether the effect of sounds could

interact

with

that

of visual orientation

differences,

Whereas

the

hori-zontal orientation of

inducers

was always

O

deg,

that

of

the

target

stirnulus was either

O,

±

15,

or ±

45

deg.

We

included

the

AM-On-path

and

FL

conditions as visual conditions, and

the

sound

and no-seund conditions asauditory conditions.

Regarding

the

obtained

dprimes

(N=8,

Figure

IC),

a

3-way

repeated-measures

ANOVA

with visual conditions

(2)

Xauditory

conditions

(2)

Xtarget's

orientations

(3)

found

a significant

interaction

among the

factors

(F(2,

12)=3.98,

A

EM,Qn-path SOms 26ms SOms /..I L ISd40ms snun4

'i

i)''

"-

4ooor

'

Ng･$g-nd. _.:. 2100Hi t:1/ma AM-Qmm

B

eE"a 4321o 5o,us,csn u +rL .--.----.

x

AM/OepethFigure

1,AM'Off-peth

FL

foms OAM-on-pitn if-.---.

x

/1 iS 4S MfcrDnan,nom"tn//on/dop/

H"seLnd Z /S -E u/fidian"///orwota//"t/elee/

SDJnd

(A)

Stimuli

and

conditions.

{B.

C)

Results.

p<.05).

The

simple simple main effect af auditory conditions

showed

that

the

d-prime

of

the

sound [ondition was smaller

than

that

of

the

no-sound [ondition

for

all targets'

orienta-tions

in

the

AM-On-path

condition

{Fs(1,

36)>4,70,

_p<,05).

This

indicates

that

the

auditory effect

did

not

interact

with

that

ofthe orientation

differences.

GeneralDiscussion

Transient

sounds

_presented

together

with

AM

stimuli,

but

not

target

stimuli,

degraded

target

detection

_performance

only when

the

target

was

presented

along

the

AM

trajectory.

Fur-thermore,

this

auditery effect on

AM

interference

weakened

when sound

frequencies

were varied

during

AM

cornpared

to

when

they

were consistent.

We

also cenfirmed

that

the

sounds strengthened the magnitude ofAM

interference

irrespective

of

the

incensistency

in

orientation

information

between

the

tar-get

and

AM

stimu[i.

These

findings

suggest

that

sound can

contribute to the robust establishment and spatiotemperal

maintenance of an

intemal

object representation of an

AM

stimulus,

References

Hidaka,

S,,

Nagaj,

M.,

Sekuler,

A.

B.,

Bennett,

R

_J.,

&

Gyoba,

_J.

(2011).

Inhibition

of

target

detection

in

apparent motion

trajectory,

Journal

of

Vk'sion,

11(10):2,

1-12,

Hidaka,

S.,

1[leramote,

IM,

&

Nagai,

M.

(2012).

Sound

can

hance

the

suppression ofvisual

target

detection

in

apparent

motion trajectory.

va'sion

Research,

59,

25-33.

Stein,

B,

E.,

London,

N.,

Wilkinson,

I.,

K.,

&

Pri[e,

D.

D,

(1996),

Enhancement

of

_perceived

visual

intensity

by

tor}F

stimuli:

A

_{psychophysical}

analysis.

Journat

of

Cognitive