目標指向行動と内発的動機の神経機構

全文

(1)ῑῐΐῒ. The Japanese Journal of Psychonomic Science 2011, Vol. 29, No. 2, 164῍170.

(2)

(3) ῎῎ . ῎῎ . ῎῎῎. !"#$%&$'()῎*+$,-./01232#$῎῎ 456789:;&#$῎῎῎. Neural mechanisms of goal-directed behavior and intrinsic motivation Kenji MATSUMOTO, Madoka MATSUMOTO, Kou MURAYAMA, and Keise IZUMA Tamagawa University Brain Science Institute῎, Japan Society for the Promotion of Science, University of Munich῎῎, California Institute of Technology῎῎῎. The prefrontal cortices play important roles in cognitive control of behavior. The medial prefrontal cortex guides actions on the basis of the representation of action-outcome contingency, because many neurons represent action-outcome contingency when represented information is examined in a visually cued go/no-go task with asymmetrical rewards with reversals. Also, the medial prefrontal cortex evaluates the correctness of actions on the basis of classifying the outcome of actions, because both success- and failure-responsive neurons were observed in an action-learning task. On the other hand, the lateral prefrontal cortex regulates the relationship between actions and rewards by comparing the values of intrinsic and extrinsic rewards, because the lateral prefrontal cortex shows the activity corresponding to the undermining e#ect of extrinsic rewards on intrinsic motivation in a task that could be voluntarily engaged in. Both the medial and lateral prefrontal cortices may interact to link between goal-directed behaviors and intrinsic motivation through the cortico-basal ganglia loops. Key words : prefrontal cortex, striatum, goal-based action selection, performance monitoring, intrinsic motivation ZH[\]^YZH (Aosaki, Graybiel, & Kimura,. ῎ῌ῏῍. 1994; Schultz, 1998; Sutton & Barto, 1998; Doya,. <=> ?@AB <CDEFGH<=<I (Figure. 2002; O’Doherty, Dayan, Schultz, Deichmann, Fris-. 1) JK LM NODPQRSTUVWXYZH. ton, & Dolan, 2004)_ ~^]<=<IbcdJK <. [\]^YZH (Stuss & Benson, 1986; Damasio,. =<Ibcdbcd #% . 1994; Fuster, 1997; Roberts, Robbins, Weiskrantz,. <=<IZῌ8uUXYh. 1998)_ àK bcd (Figure 2) JK efghAiZjV. (Alexander, DeLong, & Strick, 1986)K ~ 8uD. klmWmD nXYopeqrsUtuvXYZH. gYK LM NO $ J. ?%vuw02xy] z{U|}H~DgYK. ^YZH[\]^H_ +@JK ~ ῌ. $ DPQRSTUVWXY. 8uk gR

(4) UYZHDZYK W '(]¡¢^H~U£¤H_. ῎ Tamagawa University Brain Science Institute, 6῍1῍1, Tamagawa-gakuen, Machida, Tokyo Copyright 2011. The Japanese Psychonomic Society. All rights reserved..

(5) !"´!"´µ¶´.·¸ 8]¹º»¼º½.

(6)

(7) . 165. >**?@A<B$ CDE FDGD @&'86HI8ῌ JKLMCNO*89P

(8) . !" 2001#$

(9) . *8QRS8@$ /QP . % 1 &'()$ *% 1 &'. T' 8OU8VWXY Z;. . ῌJKL?[$. +,# -./ *. 0*/12345 % 2 )$. Matsumoto, Suzuki, & Tanaka (2003) 8O. 6/*% 2 -./ 6. UVW\]^_àb5. 2345% 3 )77819. HcP$ 2 Cde 2 C 2 COU. 1

(10) 5:;&')< =. fghi (Figure 2a) jkl/$ D m 2 Znode de 1 de 2# pq5rQs tuvwxyz{|}~F jk node GOῌ}wM D NGῌ '# P$ /M/ 8 6OU [Eῌ D /ῌ# Q $ P jkQ88pqN @5P $ 5@K @ 2 deῌῌOU ¡¢Q£D ¤ ?pq ¡¢¥15 2 Z1q5¦ t§b¨©nodeª9EB$ ?KQ«E¬¡

(11) deῌῌOU. Figure 1. Location of the prefrontal cortex and the striatum.. ®¯? jk 6°de8 8®±²?fg/@³©@@5P. Figure 2. (a) Behavioral task to examine goal-based action selection. Dashed box surrounds the visual cues that provide the earliest opportunity to select action in a trial. (b) A medial prefrontal neuron that represent a specific action-outcome combination (NG/) in the responses to the visual cues..

(12) V¨©ª«¬. 166 . 2¯. jkO 9lXYmnopI=q5 gF.

(13)

(14) . 29 ®. !" #$%&'() *+,. -./01 2 , 341567 2 8 9 :;<=5> ?@' 2 ?@A7$' B C ?DEFGHI= EMN (< . h(?@- 2 $ XY'?@6 M 2 r16P MstI=('-_`1u=. ῐῑ῏῎ῌῒ῍. !" (Figure 2b) -JKL. $ ?@-XYvI=MwrM TUEPO. !"5 BC $'BC ?. xyz{|}~<MI=q m Matsu-. @' ?DEFGHOP= -NO

(15)

(16) . moto, Matsumoto, Abe, & Tanaka (2007) 5N. 5 $'?@ QRS TUVWP XY. / ]^ / *+,=. Z[\6$]^_`6ab@OP='cd<. NOI r6$. =. (Figure 3a) > BC . M ]^$-XY'?@e>fg Fh(I'5i<6P -NO $XYZ[\. ' ¡O. ¢¡=('NO. :1 £'O¤r¥d ¦ §{. Figure 3. (a) Behavioral task to examine evaluation of outcome of action selection. (b) Averaged responses of positive feedback-preferring neurons (top) and negative feedback-preferring ones in the medial prefrontal cortex (bottom)..

(17) »»¼ 6TpL' S?'º%Rº½. 167.

(18)

(19) . ]B A78S?CBC C$ Y. . .L'Z#$&A(A C'F &. . ! "#$%&. [3Q\V]! BkS?CBCZ#. ' (. !

(20) ' )*. 5$&A. ]^_-. & (Deci & Ryan, 1985;. +

(21) ! ,. Carver & Scheier, 1998) -B Murayama, Matsu-. -./ 1 0 ,123! . moto, Izuma, & Matsumoto (2010) YCamerer (2010).

(22) ! &456 7 ,. e`B Z ! S?CBCaBbHc. 12 !&

(23) 89:;. * I*\A/ ,.

(24) <2=>&$?@AB . magnetic resonance imaging) d&$L. 0$

(25) @B . 3 0C& 4 ! DE. fMRI. (functional. ,! 28 ef, Yg 10 e h 18 eZ K.

(26) FGHI J/$ . 8iX$zLBCj#A YBCZ.

(27) & ?. K8i !kxyD&C]zLBCj. BKL$&AM. # Y0`Z ] K! <. N!"OP#5$ $Q%RS&T'N!. < G@B $. U(. 5 l]m/AK Y<<K 4.95ῌ. U(. VW%RS&)X YT'Z [ *\ . ! U(. A{. 5.05 lC 8 -5}C no Z (. . A (Figure 4a, top) Qp q\K $<. [])X@A%RS& (Figure 3b, top) U. <Q'?maA+$G. (. [])X@A%RS& (Figure 3b, bot-. @K Y<<K 8 e 8 e. tom) 2 +,(AB ^ B5%RS. CZ d& (Figure 4a, bottom) B 2 `K. &!

(28) 5 1 0. 30 rL4`FGHICst a5A¡<¢£G 2. 89:;

(29) <2P_ àb -. C cd.. ¡<¢£GL$j& -McT' fMRI . [])X a

(30) ^. $¤ <<K! 8@A. 5. 89:;

(31) <2P_ àb/C cd .5C. u ¥v 535A¦§¨©5. ! &

(32) 0$. ;<CB w 1 ¡<¢£G"3! 3ª

(33). U($e B5%RS&!f )X. $4# BC! <<K8. 4 -X1-. ! -L'`&$. u «200 ¬.5A "3 w. cd0X2g3 BB ! . 1 ¡<¢£G®¯x3 yz{b¬. . +`B5%RS&! /. 4# Qp 0`! ¬`&$"3!. U(4#A cd5h$&AB 3i. Q|4#4 w 1 ¡<¢£G®¯x3 }[. $%b . ! jBL'678. 8i !kxy¬4# YC% ¬. 9a&ek:le;<C=mn. °! FGHI{BC[ ±<Z `. $&A o#5A. ab ~peBC4#5. ῏ῐ῍῎ῌ. $&A BC!8iXBC4#5 &kB CA. 6>p?L'8@@A/! L'0@A. w 2 ¡<¢£G! w 1 ¡<¢£G ²Cb . 9:;

(34) <2q-5AkBCrs(A BC. e ¬!Q|C&B #$ K. $@tD&`]! E\FquvFCGH. L$e a w 2 ¡<¢£G. ?IwJ?xy@AQK?BCq 3J?xy. ! -5³5f,!U 3 ]3 Q[$. @AzLCMK?BC{|k -k}. e& -3. ?CBCC&NUe (AKObP~B QR. <<K <<KQ . ]$ K%A78QRS?CBCC. G¶B . $%b 6Tp?L'GjU5$&AB e. !f,B 3 ]3 B5KQS?·. V& # We 4#A X}?. 0{ ¦G¸¹N!$%b Yf,!. CBCC]$eQS?ObP~ B5! . BB C&Z -5S?BC=>]'º. ´$(Aµ¦G Ak$%&.

(35) 168. YZ23456. [ 29 \. [2].

(36) (Deci & Ryan,. %;<=, #$%&>?@ A. 1985) . B, &CDEFGHIJB,&K. !. "#$%&'()*+, -./01234 56! 789:#$. L M H ) , M ; N O P Q R S T O U V W X (Deci, 1971; Deci, Koestner, & Ryan, 1999; Murayama. Figure 4. (a) Behavioral task to examine intrinsic motivation. (b) Anterior striatum activation by success vs. failure in the stop-watch task..

(37) ³´µ³´µ¶·µ#¸ ¹º < =»¼=½. 169. & Kuhbandner, in press)

(38) . ®¬H ª\. . !"#. rr$< $%&' J¯". $! %&' 3 ()*+( ,-./. >?L:°¯H#IL<de'L DM±:. 01.23456789:; . Us} I¤ῌ¥¦§¨ /J²[#¯H. < $! =>? @ 1 A.BC. #IL<de'L. D@ 2 A.BC D E. !"#F 9GH#I. <JKH#IL $! M& @ 1 A. BC N

(39) OH#P;Q R,S J<H#3 4TUVWXY

(40) Z[ ,-./01.234\]^L<_$< H#à9b<cL<de'L f <H# $! . !< ghi. jI# ,-./01.234 k\]l H<m kn l H<m<"#8oIf ' (Figure 4b) ghif J!(pH#qL < $!. !cU8o:; <. @ 1 A.BC N $! k\]l rstu $YvwI#jU tu$^Lf oIf JxmyH<de'L z @ 2 A.BC !<tu$esI< I{|}[h~P;::' @ 1 A. BC < ghijI# . !$!. cU8oIf ' < $! ,-./01.234 k\]l 5 s $<H#à9bH#IL . ! _. c{s9b's:;<JH#IL<de 'L ,-./01.234< 34PL 01.2,-./34 H# :UK #I (Figure 4b) :U^Lf. J"#qL< iir %gh f <[ f q' ^s& @ 1 A.BC . !"#$!foI. @ 2 A.BC $!. !cUii. rfJ9GPL < % &'34:<I{ ,-./01.234 j?L k\]l 5 $<H#à J?iir gh ij?L,-./01.234 k\]l <I{ $àJeL<I{ ¡.¢£ ¤ῌ¥¦§¨ /jI#=H# IL©JKH#IL. ῍. ῌ. ῎. ii Jª\^L« ¬. ῐ. I:!` ii. ῏. Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986). Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience, 9, 357῍381. Aosaki, T., Graybiel, A. M., & Kimura, M. (1994). E#ect of the nigrostriatal dopamine system on acquired neural responses in the striatum of behaving monkeys. Science, 265, 412῍415. Camerer, C. F. (2010) Removing financial incentives demotivates the brain. Proceedings of the National Academy of Sciences of the USA, 107, 20849῍20850. Carver, C. S., & Scheier, M. (1998). On the selfregulation of behavior. Cambridge: Cambridge University Press. Damasio, A. R. (1994). Descartes’ error: emotion, reason, and the human brain. New York: G. P. Putnam. Deci, E. L. (1971). E#ects of externally mediated rewards on intrinsic motivation. Journal of Personality and Social Psychology, 18, 105῍115. Deci, E. L., Koestner, R., & Ryan, R. M. (1999). A metaanalytic review of experiments examining the e#ects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125, 627῍668; discussion 692῍700. Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human behavior. New York: Plenum. Doya, K. (2002). Metalearning and neuromodulation. Neural Networks, 15, 495῍506. Fuster, J. M. (1997). The prefrontal cortex: anatomy, physiology, and neuropsychology of the frontal lobe. Philadelphia: Lippincott-Raven. Matsumoto, K., Suzuki, W., & Tanaka, K. (2003). Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science, 301, 229῍232. Matsumoto, M., Matsumoto, K., Abe, H., & Tanaka, K. (2007). Medial prefrontal cell activity signaling prediction errors of action values. Nature Neuroscience, 10, 647῍656. Murayama, K., & Kuhbandner, C. (in press). Money enhances memory consolidationῌBut only for boring materials. Cognition, 119, 120῍124. Murayama, K., Matsumoto, M., Izuma, K., & Matsumoto, K. (2010). Neural basis of the undermining e#ect of monetary reward on intrinsic motivation. Proceedings of the National Academy of Sciences of the USA, 107, 20911῍20916..

(41) 170. . O’Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304, 452ῌ454. Roberts, A. C., Robbins, T. W., & Weiskrantz, L., (Eds.) (1998). The prefrontal cortex: executive and cognitive functions. Oxford: Oxford University Press. Schultz, W. (1998). Predictive reward signal of dopa-. 29 . 2. mine neurons. Journal of neurophysiology, 80, 1ῌ27. Stuss, D. T., & Benson, D. F. (1986). The frontal lobes. New York: Raven Press,. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: an introduction. Cambridge, MA: MIT Press. (2001).

(42) 39, 76ῌ83..

(43)