TSUBAMEの飛翔: ペタスケールへ向けた「みんなのスパコン」の構築

全文

(1)2006−HPC−107（7） 2006／7／31. 社団法人情報処理学会研究報告 IPSJ SIG Technical Report. TSUBAME ߩ㘧⠍: ࡍ࠲ࠬࠤ࡯࡞߳ะߌߚ‫ߩޠࡦࠦࡄࠬߩߥࠎߺޟ‬᭴▽ ᧻ጟ ⡡ ᧲੩Ꮏᬺᄢቇቇⴚ࿖㓙ᖱႎ࠮ࡦ࠲࡯ [email protected] 1.. ߪߓ߼ߦ – TSUBAME ߳ߩ㆏. Tom Sterling, Don Becker ឭ໒ߩ Beowulf ဳ㨇1㨉PC ࠢ࡜ࠬ࠲߇ 1994 ᐕߦ↢߹ࠇߡ߆ࠄ 12 ᐕ૛ࠅ߇⚻ㆊߒߚ‫ޕ‬ ᦨೋߩ Wiglaf ߢߩᕈ⢻ߪᢙ⊖ MFlops ߦḩߚߥ߆ߞߚ߇‫ޔ‬ ߎߩචᐕߢ 10 ਁ୚ㄭ޿ᕈ⢻ߩㅴᱠࠍᨐߚߒߚ‫ߥߒ߆ߒޕ‬ ߇ࠄ‫ޔ‬࿾⃿ࠪࡒࡘ࡟࡯࠲ߩࠃ߁ߥኾ↪⸳⸘ߩࠬࡄࠦࡦߣᲧ セߔࠆߣ‫ޔ‬න⚐ߦᕈ⢻ߛߌߢߥߊ‫ࡆ࡜࡯ࠤࠬߥ⊛࠭ࠗࠨޔ‬ ࡝࠹ࠖ࡮ㆇ↪ᕈߥߤߦ㑐ߒߡ‫੹ޔ‬ᓟߩ 100TFlops/ਁන૏ߩ ࡊࡠ࠮࠶ࠨᤨઍߩ࠻࠶ࡊࡑࠪࡦࠍࠢ࡜ࠬ࠲ᛛⴚߢ᭴▽ߒ‫ޔ‬ ࠮ࡦ࠲࡯ㆇ↪ߩᄙᢙߩ࡙࡯ࠩߩ᭽‫ࡦ࡚ࠪ࡯ࠤ࡝ࡊࠕߥޘ‬ ߩታⴕⅣႺࠍ቟ቯߦଏ⛎ߢ߈ࠆ߆ߪᧂ⍮ᢙߢ޽ߞߚ‫ޕ‬ TSUBAME (Tokyo-tech Supercomputer and Ubiquitously Accessible Mass-storage Environment)ߪ‫ޔ‬ ࠕࠢ࠮࡜࡟࡯࠲ㇱಽࠍ฽߼ࠆߣ 100TFlops ㄭ޿ࡇ࡯ࠢᕈ ⢻࡮20TByte એ਄ߩࡔࡕ࡝࡮Fat Node ߅ࠃ߮㜞ㅦߥ㑆ធ ✂ࠍၮᧄߣߒߚ౒᦭ࡔࡕ࡝ࠬࡄࠦࡦᒻࠕ࡯ࠠ࠹ࠢ࠴ࡖ࡮ਗ ߮ߦ 1PByte એ਄ߩࠝࡦ࡜ࠗࡦࠬ࠻࡟࠶ࠫࠍ஻߃‫ޔ‬2006 ᐕᤐߩᤨὐߢ‫⃻ߢ࠲ࡔ࡜ࡄࠆࠁࠄ޽ޔ‬࿷ࠊ߇࿖ᦨ㜞ᕈ⢻࡮ ᦨᄢⷙᮨߩᣂဳࠬࡄࠦࡦߣߒߡ᧲Ꮏᄢ࡮ቇⴚ࿖㓙ᖱႎ࠮ࡦ ࠲࡯ߦ᭴▽ߐࠇߚ‫ޕ‬TSUBAME ߪᦨ㜞ᕈ⢻ߩࠬࡄࠦࡦߢ ޽ࠆߣหᤨߦ‫⿥ޔ‬ᄢⷙᮨߩ PC ࠢ࡜ࠬ࠲ߣߒߡ‫ޔ‬ᓥ᧪ߩኾ ↪ࠬࡄࠦࡦߣ PC ࠢ࡜ࠬ࠲ਔ⠪ߩ೑ὐࠍ౗ߨ஻߃‫ߘߟ߆ޔ‬ ࠇߙࠇߩᰳὐࠍ⵬߁ࡑࠪࡦߣߒߡ⸳⸘ߐࠇߡ߅ࠅ‫ࠦࡄࠬޔ‬ ࡦߣߒߡߩᨵエ߆ߟᒝജߥࡂࠗࠛࡦ࠼ߩᄢⷙᮨਗ೉⸘▚ ߿࠺࡯࠲ಣℂߩ⢻ജߣ‫ࡁ࡮ࡊ࠶࠻ࠢࠬ࠺ߩࠩ࡯࡙࠼ࡦࠛޔ‬ ࡯࠻ࡉ࠶ࠢ߿ PC ࠢ࡜ࠬ࠲ⅣႺߣߩ㜞޿ⷫ๺ᕈ㧔หߓࡃࠗ ࠽࡝߇േߊߥߤ㧕ߣߩਔ┙ࠍታ⃻ߒߡ޿ࠆ‫ࠍࠄࠇߎޕ‬หᤨ ߦḩߚߔߎߣ߇‫ޔ‬TSUBAME ߇ᮡ᭙ߔࠆ‫ࡄࠬߩߥࠎߺޟ‬ ࠦࡦ‫ߩޠ‬਎⇇ߢ޽ࠅ‫ޔ‬ᓥ᧪ߩ㒢ቯߐࠇߚ࡙࡯ࠩߩߺࠍኻ⽎ ߣߒߚࠬࡄࠦࡦߣߪߘߩၮᧄ⊛ߥ⊒ᗐࠍ⇣ߦߒߡ߅ࠅ‫ߘޔ‬ ߩὐߢ੹ᓟߩᄢቇ߿⎇ⓥᚲㆇ↪ߩࠬࡄࠦࡦ߅ࠃ߮࠮ࡦ࠲ ࡯ߩ޽ࠅᣇߦ㑐ߒߡ‫ޔ‬ᄢ߈ߥᣇะᕈࠍ␜ߔߎߣ߇ߢ߈ߚߣ ାߓߡ޿ࠆ‫ޕ‬ ․ߦ੹࿁ TSUBAME ߩᄢ߈ߥ⋡ᮡߪ‫ޔ‬ᓥ᧪ߩࠬ࡯ࡄ࡯ ࠦࡦࡇࡘ࡯࠲ߩᣢᚑ᭎ᔨࠍᛂߜ፣ߔߎߣߦ޽ߞߚ‫ޕ‬ᢙචᐕ ೨ߩࡔࠗࡦࡈ࡟࡯ࡓᤨઍߪ‫৻ޔ‬บߩ⸘▚ᯏࠍᄙߊߩੱ㑆߇ 㐽ߓߚⅣႺߢ౒᦭ߒߡ૶ߞߡ޿ߚߚ߼‫ޔ‬ㅒߦ૶↪߇น⢻ߥ ┵ᧃ߇⟎޿ߡ޽ࠆ▎ᚲ߆ࠄߪోߡห৻ߩⅣႺ---޿ࠊࠁࠆ SSO(Single Sign-On)---߇⥄ὼߦታ⃻ߒߡ߅ࠅ‫ޔ‬ᬺോ♽ߩ ಣℂ߆ࠄࠪࡒࡘ࡟࡯࡚ࠪࡦ߹ߢ‫ޔ‬ห৻ߩⅣႺߢⴕࠊࠇߡ޿ ߚ‫ߩߘޕ‬ᓟ‫ޔ‬70 ᐕઍᓟඨ߆ࠄ 80 ᐕઍࠃࠅࡑࠗࠢࡠࡊࡠ࠮ ࠶ࠨ/PC ᤨઍߦᧄᩰ⊛ߦ⒖ⴕߒ‫ޔ‬หᤨᦼߦ Cray ╬ߩࠬ࡯ ࡄ࡯ࠦࡦࡇࡘ࡯࠲߇ឭଏߐࠇࠆࠃ߁ߦߥߞߡ‫▚⸘ޔ‬ⅣႺߪ ᄢ᏷ߦ⇣ᯏ⒳࡮⇣ⅣႺߩ߽ߩ߇ᷙ࿷ߔࠆߎߣߣߥߞߚ‫ߒޕ‬ ߆ߒߥ߇ࠄ 90 ᐕઍએ㒠ࡑࠗࠢࡠࡊࡠ࠮࠶ࠨߩᕈ⢻ะ਄߿ ࡆࠫࡀࠬ೑↪ߩߚ߼ߩା㗬ᕈ߇⪺ߒߊ㜞ߊߥࠅ‫ޔ‬ ߆ߟ LAN, WAN ߣ߽ߦ഍⊛ߥ㜞ㅦൻ࡮ࠦࡕ࠺ࠖ࠹ࠖൻ߇ᕆㅦߦㅴⴕ ߒߡ‫ ߩࠕࠚ࠙࠻ࡈ࠰ߦࠄߐޔ‬OS ߿ਗ೉ࡊࡠࠣ࡜ࡒࡦࠣߩ ⅣႺ߇ Linux,Windows ߿‫ޔ‬MPI/OpenMPI ߥߤ‫ޔ‬ኦභൻ ߿㜞ᯏ⢻ൻ߇ㅴ߻ߦߟࠇߡ‫ޔ‬PC ࠢ࡜ࠬ࠲╬ߩᦨᣂߩ PC ߿ߘࠇࠍਛᔃߣߒߚࠦࡕ࠺ࠖ࠹ࠖߥ߇ࠄࠛࡦ࠲ࡊ࡜ࠗ࠭ ♽ߩᦨᣂᛛⴚࠍ↪޿ࠄࠇ‫ޔ‬഍⊛ߥࠦࠬ࠻ࡄࡈࠜ࡯ࡑࡦࠬะ. ਄߇น⢻ߣߥߞߚ‫ޕ‬ታ㓙‫ ߽ߢ♽࠭ࠗ࡜ࡊ࠲ࡦࠛޔ‬Linux ߿ Windows ߪᄢ᏷ߦណ↪ߐࠇ‫ޔ‬x86 ♽ߩᕈ⢻࡮ᯏ⢻ะ਄ߪ‫ޔ‬ ᄙߊߩࡂࠗࠛࡦ࠼ RISC ࡊࡠ࠮࠶ࠨࠍ߶߷⛘Ṍߦㅊ޿߿ߞ ߚ‫ޕ‬ ߣߎࠈ߇‫߇ࠊߦ․ޔ‬࿖ࠍਛᔃߣߒߡ‫ ߪࡦࠦࡄࠬޔ‬80 ᐕ ઍߩ⇣ᯏ⒳࡮⇣ⅣႺߩ࡟ࠟࠪ࡯߇‫ߩߤࠎߣ߶ޔ‬ᄢቇ╬ߩ࠮ ࡦ࠲࡯ߦዉ౉ߐࠇࠆࠬࡄࠦࡦߦ߅޿ߡ੹ߢ߽ᱷࠅ⛯ߌߡ ޿ࠆ‫⚿ޕ‬ᨐߣߒߡ‫ޔ‬એਅߦઍ⴫ߐࠇࠆࠃ߁ߥ⁁ᴫߣߥߞߡ ޿ࠆ㧦 z Window, Linux ╬ߣ⇣ߥࠆ OS ߿ࡒ࠼࡞‫࠼ࡦࡑࠦޔ‬ ૕♽‫⟲࡞࡯࠷ޔ‬ z ࡈࠔࠗ࡞౒᦭߿ߘߩઁߩ᭽‫࠺ࠆߌ߅ߦࠬࡆ࡯ࠨߥޘ‬ ࠬࠢ࠻࠶ࡊࡄ࠰ࠦࡦߣࠬࡄࠦࡦߩ㕖౒᦭࡮㕖ធ⛯ᕈ z ․ᱶߥࡑࠪࡦߢߩ㊀ⷐߥ ISV ࠕࡊ࡝ߩᰳᅤ‫ޔ‬㕖ኻᔕ‫ޔ‬ 㜞ࠦࠬ࠻ൻ z ࡊࡠࠣ࡜ࡓ⸒⺆߿ᦨᣂߩ㐿⊒ⅣႺ࠷࡯࡞(Visual Studio ߿)ߥߤߩᰳᅤ ᒰὼߎࠇߢߪࠪࠬ࠹ࡓో૕ߩࠦࠬ࠻ࡄࡈࠜ࡯ࡑࡦࠬߪ ૐߊߥࠅ‫߇ࠬ࡯ࡌࠩ࡯࡙ߚ߹ޔ‬ኦභ⁁ᘒߦ޽ࠆㅢᏱߩⅣႺ ߆ࠄ⒖ⴕߒߦߊ޿ߩߢ‫⚿ޔ‬ᨐߣߒߡࠬࡄࠦࡦߣ޿߁ࡑ࡯ࠤ ࠶࠻ో૕ߩ❗ዊࠍ↢ࠎߢ޿ࠆ‫ޕ‬ ㅒߦ৻⥸ߩࠛࡦ࠲࡯ࡊ࡜ࠗ࠭ࠗࡦࡈ࡜‫ࠍࡃ࡯ࠨߦ․ޔ‬㐓 ߺࠆߣ‫ᤨߩࡓ࡯࡟ࡈࡦࠗࡔߦߢߔޔ‬ઍߪㆊ߉‫ޔ‬x86 + Linux/Windows ߪ 50%એ਄ߩ㊄㗵ࡌ࡯ࠬࠍභ߼ࠆ[2]ᄙᄢ ߥࠆᚑഞࠍ෼߼‫↪ࠬࡀࠫࡆߟ߆ޔ‬ㅜߦߣߞߡ߽චಽߥା㗬 ᕈࠍ߽ߚࠄߒߡ߅ࠅ‫ࡊ࠶࠻ࠢࠬ࠺ޔ‬ⅣႺߣߩ㜞޿ⷫ๺ᕈࠍ ታ⃻ߒߡ޿ࠆ‫ޔ߽߆ߒޕ‬ㄭᐕߩਗ೉ಣℂߦ߅޿ߡߪ‫߆޿ޔ‬ ߦല₸ߩࠃ޿ਗ೉Ṷ▚࡙࠾࠶࠻ࠍ቟ଔߦਗߴ⋧੕⚿วߔ ࠆ߆߇ᕈ⢻ࠍ᳿ቯߒߡ߅ࠅ‫ޔ‬x86 ߩࡂ࡯࠼߆ࠄࠕࡊ࡝ࠤ࡯ ࡚ࠪࡦߦ⥋ࠆ߹ߢߩᄢ㊂↢↥࡮ᵴ↪ߦࠃࠆ‫ޟ‬ᨗࠇߚ‫࡜ࡊޠ‬ ࠶࠻ࡈࠜ࡯ࡓߩᵴ↪ߪᄢᄌᛛⴚ⊛ߦ᦭↪ߣߥࠆ‫ޕ‬ ㅒߦ‫ޔ‬IT ᛩ⾗ߩⷰὐ߆ࠄ㐓ߺࠆߣ‫ޔ‬ฦ࠮ࡦ࠲࡯ߩࠬࡄࠦ ࡦߩᐕ㑆੍▚ࠍࠬ࡯ࡄ࡯ࠦࡦࡇࡘ࡯࠲ߦ‫ޔ‬ ‫⸳᦭౒ޟ‬஻‫ߩޠ‬ ฬ⋡ߢታ㓙ߦߪᢙචฬ⒟ᐲߩ࡙࡯ࠩࡌ࡯ࠬߦᚑᨐߩ࠴ࠚ ࠶ࠢᯏ⢻ߥߒߦᛩ౉ߒ⛯ߌࠆวᗧࠍ੹ᓟᓧࠆߩߪ㔍ߒ޿‫ޕ‬ ߻ߒࠈ‫ޔ‬ቇౝߩᄙᢙߩ࡙࡯ࠩߦଏߒ‫ߣࡊ࠶࠻ࠢࠬ࠺ߟ߆ޔ‬ ㅪ⛯ߒߚⅣႺߢ‫ޔ‬ᄙᢙߩ৻⥸ࠨ࡯ࡆࠬ߿ࠕࡊ࡝ࠤ࡯࡚ࠪࡦ ࠍࠨࡐ࡯࠻ߒߡ޿ߊᔅⷐ߇޽ࠆ‫(ߪࠇߎޕ‬ᛛⴚ਎ઍߪోߊ㆑ ߁߇)ࡔࠗࡦࡈ࡟࡯ࡓᤨઍߣ౒ㅢߔࠆᕁᗐߢ߽޽ࠆ‫ޕ‬ એ਄ߦࠃࠅ‫᧲ޔ‬Ꮏᄢߦ߅ߌࠆᣂ਎ઍߩࠬࡄࠦࡦߪ‫ޔ‬ᓥ᧪ ߩࠃ߁ߦᄢⷙᮨߥ⸘▚࡮ࠬ࠻࡟࠶ࠫ࡮ࡀ࠶࠻ࡢ࡯ࠢ⢻ജࠍ ↢߆ߒߚࡂࠗࠛࡦ࠼ߥࠪࡒࡘ࡟࡯࡚ࠪࡦߩᯏ⢻ࠍታ⃻ߒ ߥ߇ࠄ‫ޔ‬หᤨߦ޽ࠅ૛ࠆߘࠇࠄߩ⾗Ḯࠍ↢߆ߒߡ⃻ઍߩ IT ⅣႺߦࠪ࡯ࡓ࡟ࠬߦធวߒ‫ޔ‬᭽‫ࠍࠬࡆ࡯ࠨߥޘ‬ឭଏߔࠆḮ ߣߥߞߡ‫ޔ‬ቇౝ߿⚵❱ౝߩᄙᢙߩ࡙࡯ࠩߩ IT ࠾࡯࠭ࠍๆ ෼ߒ‫ޔ‬ᄢቇߦ߅ߌࠆᢎ⢒࡮⎇ⓥࠕ࡯ࠞࠗࡉߥߤߩᢎ⢒⎇ⓥ ᬺോ‫߿࡞ࠗࡔߪߦࠄߐޔ‬੐ോಣℂߥߤߩᣣᏱᬺോߥߤߩ‫ޔ‬ ⛔ว⊛ߥࡎࠬ࠹ࠖࡦࠣࠍⴕ߁ߎߣߣߒߚ‫ߘޔࠅࠃߦࠇߎޕ‬ ࠇߙࠇߩ⎇ⓥ⠪࡙࡯ࠩߦ⛔ว⊛ߥ IT ⅣႺࠍឭଏߔࠆߎߣ ߇น⢻ߣߥࠅ‫ޔ‬ቇㇱ↢߆ࠄᄢቇ㒮↢‫ޔ‬ᢎຬ♽߆ࠄ੐ോ♽⚵ ‫ޠࡦࠦࡄࠬߩߥࠎߺޟ‬ⅣႺ߇ ❱߹ߢోຬ߇ᣣᏱߢ೑↪ߔࠆ‫ޟ‬ ታ⃻ߐࠇߟߟ޽ࠆ‫ޔߕࠄߥߺߩޕ‬ቇ↢߇ᣣᏱ⊛ߦࠬࡄࠦࡦ ⅣႺߦ⸅ࠇ‫ޔ‬೑↪ߩࡂ࡯࠼࡞ࠍ㕖Ᏹߦૐߊߔࠆߎߣߢ‫ޔ‬ᰴ. −37−.

(2) ਎ઍߩࠪࡒࡘ࡟࡯࡚ࠪࡦ࡙࡯ࠩࠍᄙᢙ↢ߺ಴ߒ‫ ߪߡ޿߭ޔ‬z CPU ߪ㜞ᕈ⢻࡮64bit ߢ‫ ߟ߆ޔ‬x86 ੕឵ᕈߩ㜞޿ࡊࡠ࠮ ⑼ቇᛛⴚߩ⊒ዷߦᄢ᏷ߦነਈߔࠆߎߣ߇ᦼᓙߐࠇߡ޿ࠆ‫ޕ‬ ࠶ࠨ‫⹏ޕ‬ଔߩⷰὐߪ‫ޔ‬ᕈ⢻࡮࠰ࡈ࠻࠙ࠚࠕߩ᳢↪ᕈ‫ߦ․ޔ‬ Linux ߿ߘߩઁ᳢↪࠰ࡈ࠻࠙ࠚࠕߩ૞േ࡮ૐᶖ⾌㔚ജ࡮ૐ 2. TSUBAME ߩ⸳⸘ⷐઙ ࠦࠬ࠻ߥߤߢ޽ࠆ‫ޔߦ․ޕ‬ ¾ 㜞޿ FP ᕈ⢻ࠍឭଏߔࠆࡑ࡞࠴ࠦࠕ CPU ߦࠃࠆ TSUBAME ߩ⸳⸘ߦ޽ߚࠅ‫ࠆߥߣ࡯ࠠ߆ߟߊ޿ޔ‬ᛛⴚ 㜞ࠦࠬ࠻ࡄࡈࠜ࡯ࡑࡦࠬߣ㜞ା㗬ߩ⏕଻ ⷐ⚛߇ታ⾰⊛ߦߪ 2002 ᐕ߆ࠄᬌ⸛ߐࠇߡ޿ߚ‫ޕ‬೨࿁ߩ⺞ ¾ ᳢↪㜞ᕈ⢻ࡊࡠ࠮࠶ࠨߦࠃࠆᦨవ┵ߩ⸳⸘ߣࡊࡠ ㆐ߢ 2000 ᐕ 1 ᦬ߦ GSIC ࠮ࡦ࠲࡯ߩ೨りߢ޽ࠆ✚วᖱႎ ࠮ࠬᛛⴚߦࠃࠆ㜞ᕈ⢻߆ߟૐᶖ⾌㔚ജ ಣℂ࠮ࡦ࠲࡯ߦዉ౉ߐࠇߡ޿ߚࠬࡄࠦࡦ⟲ߪ‫ဳ࡞࠻ࠢࡌޔ‬ ¾ x86 ੕឵ CPU ߦࠃࠆ OS ߿ Web࡮ࠣ࡝࠶࠼ࡒ࠼ ߢ޽ࠆ NEC SX-5 (16CPU‫ޔ‬128GFlops), ਗ೉౒᦭ࡔࡕ࡝ ࡞ࠍ฽߻࠰ࡈ࠻࠙ࠚࠕߩ࠺ࠬࠢ࠻࠶ࡊߣߩ੕឵ᕈ‫ޔ‬ ဳߢ޽ࠆ SGI Origin 2000 (256CPU‫ޔ‬ 202GFlops), ਗ߮ߦ ਗ೉ⅣႺࠍ฽߻ฦ⒳ࠦࡦࡄࠗ࡜࡮࡜ࠗࡉ࡜࡝╬ߩ Compaq GS320 (64CPU‫ޔ‬128GFlops)ߢ‫ޔ‬ว▚ࡇ࡯ࠢᕈ ࡊࡠࠣ࡜ࡒࡦࠣⅣႺߩሽ࿷‫ޔ‬ฦ⒳ ISV ࠕࡊ࡝ߩᦨ ⢻ߪ⚂ 448GFlops‫ࠍࡊ࡯࠹ߪࠫ࠶࡟࠻ࠬޔ‬วࠊߖߡ߽ ᣂ ߩឭଏ 50TByte ⒟ᐲߢ޽ߞߚ‫ޔߚ߹ޕ‬OS ߽⁛⥄⦡ߩᒝ޿‫߆ߒޔ‬ ߇㊀ⷐߥࡐࠗࡦ࠻ߣߥߞߚ‫ޕ‬ ࡁ࡯࠼ߩ‛ℂ⊛ߥ᭴ᚑߪ‫ޔ‬ ߽ࡑࠪࡦߏߣߦ⇣ߥࠆ Unix ♽ߩ OS ߢ޽ࠅ‫ࠩ࡯࡙ޔ‬ⅣႺ z ߹ߚ‫ޔ‬ㅢᏱߩࠬࡄࠦࡦߦ⠌޿‫ࡁޔ‬ ߥࠆߴߊᄙߊߩ CPU ࠍ‛ℂ⊛ߥࡁ࡯࠼ߩࡄ࠶ࠤ࡯ࠫߦ฽ ߣߩࡈࠔࠗ࡞౒᦭ߪ⸒߁ߦ෸߫ߕ‫ࡦࠪࡑޔ‬㑆ߢ߽޽߹ࠅࡈ ߻޿ࠊࠁࠆ FAT Node ߩࠕ࡯ࠠ࠹ࠢ࠴ࡖࠍ㜞ߊ⹏ଔߒߚ‫ޕ‬ ࠔࠗ࡞߿ⅣႺߩ౒᦭߇ߢ߈ߡ޿ߥ߆ߞߚ(NFS ࠨ࡯ࡃߪሽ ᄙߊߩ MPP ဳߩࠬࡄࠦࡦߪ‫ޔ‬ㄭᐕߪ߶ߣࠎߤ 8-32CPU ࿷ߒߚ߇‫ޔ‬ૐᕈ⢻ߢ޽ߞߚ)‫ޕ‬ એ਄‫࡝ࡕࡔޔ‬ᢙච GB એ਄(1-4GByte/CPU FLOP)એ਄ߩ ߘߎߢ‫᧲ޔ‬Ꮏᄢߩ࠮ࡦ࠲࡯߇ GSIC ߦ⴩ᦧ߃ߒߚ 2001 FAT Node ဳߢ޽ࠆ‫ޔߪࠇߘޕ‬એਅߩℂ↱ߦࠃࠆߣߎࠈ߇ ᐕߩ 1 ᐕᓟߩ 2002 ᐕ 4 ᦬ࠃࠅ‫ޔ‬PC ࠢ࡜ࠬ࠲ࠍਛᔃߣߒ ᄢ߈޿㧦 ߚࠢ࡜ࠬ࠲࡮ࠣ࡝࠶࠼ߩㆇ↪ታ㛎ߢ޽ࠆ‫᧲ޟ‬Ꮏᄢࠠࡖࡦࡄ ¾ ᄢⷙᮨ SMP ߢߩਗ೉ࡊࡠࠣ࡜ࡒࡦࠣߩኈᤃᕈ ࠬࠣ࡝࠶࠼‫[࠻ࠢࠚࠫࡠࡊޠ‬3]߇㐿ᆎߐࠇ‫ޔ‬2004 ᐕߦߪ✚ ¾ ᄢⷙᮨࡂ࠶ࠪࡘ߿࠺࡯࠲ࡌ࡯ࠬߥߤߩࠗࡦࠦࠕൻ ⸘ߢ 1000CPU ࠍ⿥߃ࠆᄢⷙᮨߥ PC ࠢ࡜ࠬ࠲⟲㧗ᓥ᧪ߩ ߦࠃࠆᬌ⚝♽ࠕࡊ࡝ࠤ࡯࡚ࠪࡦߩ㜞ㅦൻ ࠬࡄࠦࡦⅣႺߣߥࠅ‫ ߡߒߣ࡯࠲ࡦ࠮ޔ‬4 ᐕ޽߹ࠅ᭽‫ߥޘ‬ㆇ ¾ ࡁ࡯࠼ᢙߩ೥ᷫߦࠃࠆ▤ℂߩ⋭ജൻ࡮ା㗬ᕈߩะ ↪⚻㛎ࠍⓍߺ‫ߦࠩ࡯࡙ߚ߹ޔ‬ਗ೉ⅣႺ߳ߩᲑ㓏⊛ߥ⒖ⴕࠍ ਄࡮⋧੕⚿ว✂ߩන⚐ൻ࡮ᶖ⾌㔚ജߩ೥ᷫ ଦߒߚ‫ޕ‬หᤨᦼߦ‫ޔ‬2006 ᐕ 4 ᦬ߦዉ౉ߐࠇࠆᣂࠬࡄࠦࡦ ໧㗴ߪ‫ޔ‬x86 ࡃࠗ࠽࡝ࠍታⴕߢ߈ࠆࠕ࡯ࠠ࠹ࠢ࠴ࡖߦ߅ ߩᛛⴚ⋡ᮡߣ‫ࠍࠇߘޔ‬ḩߚߔ࠺ࠩࠗࡦߦ⌕ᚻߒߚ‫ޕ‬ ޿ߡ‫ޔ‬HPC ߦㆡߒߚ㜞ኒᐲ߆ߟ㜞ᕈ⢻ߩ 64bit SMP ߇ ᣂࠬࡄࠦࡦ TSUBAME ߩᄢ߈ߥᛛⴚ⋡ᮡߪ‫ޔ‬ ‫ߩߥࠎߺޟ‬ ሽ࿷ߔࠆ߆‫੍⟎⸳ޕߚߞ޽ߢޔ‬ቯߢ޽ߞߚ 2006 ᐕ 3 ᦬ ࠬࡄࠦࡦ‫ߩߡߒߣޠ‬᏷ᐢ޿࡙࡯ࠩጀ₪ᓧ‫ޔ‬ቇౝ⎇ⓥ೑ଢᕈ ߩᲑ㓏ߢߪ‫ޔ‬Intel Itanium ᰴ਎ઍ࠺ࡘࠕ࡞ࠦࠕߩ ะ਄㧒ᄢⷙᮨࠪࡒࡘ࡟࡯࡚ࠪࡦ⸘▚࡙࡯ࠩߩⷐ᳞ࠍหᤨ Montecito ࡌ࡯ࠬߩ߽ߩߣ‫ޔ‬AMD Opteron 800 ࠪ࡝࡯ ߦḩߚߔᣂ਎ઍ⸘▚⑼ቇࠗࡦࡈ࡜᭴▽ߢ޽ࠆ߇‫ޔ‬એਅߩⷐ ࠭ߩ࠺ࡘࠕ࡞ࠦࠕࡌ࡯ࠬߩ߽ߩ߇ㆬᛯ⢇ߣߒߡᱷߞߚ‫ޕ‬ ઙߦ⚦ಽൻߐࠇߚ㧦 z ⋧੕⚿ว✂ߦ߅޿ߡ߽‫࡮ࠖ࠹࡝ࡆ࡜࡯ࠤࠬޔ‬㜞ࡃࡦ࠼᏷࡮ ૐ࡟࡯࠹ࡦࠪ࡮㜞ࠦࠬ࠻ࡄࡈࠜ࡯ࡑࡦࠬ࡮㜞ା㗬‫ޔ‬ਗ߮ߦ (a) 2006 ᐕ㧟᦬ߩ᭴▽ᤨὐߢᚒ࿖ No.1 ߣߥࠆ‫(ޔ‬1) 㧞ࡈࡠࠕߦ〙ࠆ⸳⟎ߦ⠴߃ࠆ㐳〒㔌㈩✢ߥߤߩⷐ᳞㗄⋡ 40TFlops ⿥ߩ✚วṶ▚ᕈ⢻‫(ޔ‬2) 㧝PByte ⿥ࠝࡦ࡜ ࠗࡦࠬ࠻࡟࠶ࠫ‫(ޔ‬3)ߘࠇࠄࠍᢙ Tbit ⚖ߢធ⛯ߔࠆ⋧ ߇ᵞ޿಴ߐࠇߚ‫ߪࠄࠇߎޕ‬ᄢⷙᮨߥਗ೉ࡑࠪࡦߦⷐ᳞ߐࠇ ੕⚿ว✂⚿ว‫ࠖ࠹ࠖ࠺ࡕࠦࠍޔ‬ᛛⴚࠍ↪޿ߡታ⃻ ࠆᒰὼߩ㗄⋡ߢ޽ࠆ߇‫ߦࠄࠇߘߦࠄߐޔ‬ട߃ߡ‫ޔ‬એਅߩⷐ (b) ߎࠇࠄ߇ోࠠࡖࡦࡄࠬ࡮(ઁᄢቇ߿ડᬺߥߤᄖㇱ⚵❱ ઙࠍ㊀ⷐߣߒߚ㧦 ዁᧪ߩᕈ⢻ะ਄࡮ࠕ࠶ࡊࠣ࡟࡯࠼น⢻ᕈ㧦 ੹ᓟ⸘▚ ࠍ฽߻)ᄖㇱߩ઒ᗐ⊛⎇ⓥ⚵❱߆ࠄࠕࠢ࠮ࠬ߇ࠪ࡯ࡓ ¾ ߿ࠬ࠻࡟࠶ࠫࡁ࡯࠼ߩᕈ⢻ࠍะ਄ߐߖߡⴕߊߦߟࠇ‫ޔ‬ ࡟ࠬߦน⢻ߦߥࠆࠃ߁ߥࠣ࡝࠶࠼ࠍ᭴▽‫ޔ‬ㆇ༡ ࡀ࠶࠻ࡢ࡯ࠢ⥄りߩᕈ⢻ะ਄߇቟ଔ߆ߟᲧセ⊛ኈᤃ (c) ࡋࡆ࡯࡙࡯ࠩ(Capability)ะߌߩᖱႎࠨ࡯ࡆࠬߩߺߥ ߦ࿑ࠇࠆߎߣߣߒߚ‫ޕ‬ ࠄߕ‫ోޔ‬ቇߩᄢ᏷ߥ⎇ⓥ೑ଢᕈࠍ㜞߼ࠆ࡜ࠗ࠻࡙࡯ ᮡḰⷙᩰណ↪ߦࠃࠆ᳢↪ធ⛯ᕈ㧦TSUBAME ో૕ߩ ¾ ࠩ(Capacity)ะߌࠨ࡯ࡆࠬߣߩਔ┙ ࠕ࠶ࡊࠣ࡟࡯࠼ߥߤࠍⴕ߁㓙ߦ‫ࠢ࡯ࡢ࠻࠶ࡀߩઁޔ‬ (d) 㜞޿ࠦࠬ࠻ࡄࡈࠜ࡯ࡑࡦࠬ࡮ૐᶖ⾌㔚ജ࡮቟ቯᕈࠍ ࠗࡦࡈ࡜‫ ߦ․ޔ‬WAN ߣߩ㜞ㅦߥធ⛯ᕈࠍ⏕଻ߢ߈ ታ⃻‫᧲ࠅࠃߦࠇߘޔ‬Ꮏᄢ GSIC ࠮ࡦ࠲࡯߇ᄢⷙᮨ⸘ ࠆߎߣߣߒߚ‫ޕ‬ ▚ၮ⋚ߩ਎⇇⊛࡝࡯࠺ࠖࡦࠣ࠮ࡦ࠲࡯ߣߒߡ⹺⍮ TCP/IP ࡌ࡯ࠬߥߤߩࡑ࡞࠴ࡊࡠ࠻ࠦ࡞ߩࠨࡐ࡯ ¾ ࠻㧦TSUBAME ߢߪ‫࠼࡯ࡁޔ‬㑆ߩ MPI ㅢାߩߺߥ (a)(1) ߩ 40GFlops ⿥ߪ࿾⃿ࠪࡒࡘ࡟࡯࠲ࠍ⿥߃ࠆ߽ߩߢ‫ޔ‬ ࠄߕ‫ߦࠫ࠶࡟࠻ࠬޔ‬ኻߔࠆࠕࠢ࠮ࠬߥߤ‫ࠍߡోޔ‬න ޿ࠊࠁࠆ‫ᦨࠅ߹ߟޠ࠼ࡦࠛࠗࡂ࡮࡯ࠖࡈࡠ࠻ޟ‬వ┵ߩ⸘▚ ৻ߩ㜞ㅦࡀ࠶࠻ࡢ࡯ࠢߢⴕ߁⸳⸘ߣߒߚ‫ߦߢߔޕ‬ᄙ ⢻ജߩឭଏࠍ⋡ᜰߒߚ߽ߩߢ޽ࠆ߇‫(ߣࠇߘޔ‬b)ߩ‫ߥࠎߺޟ‬ ߊߩ MPP ߢߪߣࠄࠇߡ޿ࠆᚻᴺߛ߇‫ޔ‬PC ࠢ࡜ࠬ࠲ ߩࠬࡄࠦࡦ‫ߩߡߒߣޠ‬᳢↪ߥⅣႺߣߩਔ┙‫(ߪߦࠄߐޔ‬d) ߢߪࠬ࠻࡟࠶ࠫ߳ߩធ⛯ߪኾ↪ߩ SAN ߢ޽ߞߚࠅ‫ޔ‬ ߩࠦࠬ࠻࡮⸳⟎㕙Ⓧ࡮ᤨ㑆‫ߦࠄߐޔ‬࿎㔍ߥ࠮ࡦ࠲࡯ో૕ߩ ޽ࠆ޿ߪ MPI ↪ߩࡀ࠶࠻ࡢ࡯ࠢߣߪ೎ㅜ IP ࡀ࠶࠻ 㔚ജߩ೙⚂ࠍḩߚߔߩߪ‫⸘⸳ޔ‬ᰴὐߩ࠹ࠢࡁࡠࠫߢߪή⺰ ࡢ࡯ࠢߢ޽ࠆߎߣ߇ᄙ߆ߞߚ‫੹ޕ‬࿁ TSUBAME ߢߪ‫ޔ‬ ࿎㔍ߢ޽ߞߚ‫ߩ⸘⸳ߢߎߘޕ‬ฦ⒳ࡄ࡜ࡔ࠲ߩ᳿ቯߪ 2006 TCP/IP ࠍ฽߻ࡑ࡞࠴ࡊࡠ࠻ࠦ࡞ࠍࠨࡐ࡯࠻ߒ‫ޔ‬౬㐳 ᐕೋ㗡ߦ⊓႐ߔࠆߢ޽ࠈ߁ฦ⒳ CPU ߿ઁߩࡂ࡯࠼࠙ࠚࠕ ᕈߩ޽ࠆ⿥㜞ㅦࡀ࠶࠻ࡢ࡯ࠢࠍ↪޿ࠆߎߣߢ‫ޔ‬MPI ߩ೙⚂ࠍ੍᷹ߒߡⴕࠊࠇ‫ޔ‬ᕈ⢻߿ᶖ⾌㔚ജߩ⛘ኻ୯߿ߘߩ ߿ࠬ࠻࡟࠶ࠫߩࡀ࠶࠻ࡢ࡯ࠢࠍቢో⛔วߔࠆߎߣߣ ࠻࡜ࡦࠫࠛࡦ࠻ߥ․ᕈߥߤߩၮ␆࠺࡯࠲ߣߪ⎇ⓥቶߩ ߒߚ‫ࠍࠢ࡯ࡢ࠻࠶ࡀࠫ࠶࡟࠻ࠬޔߪࠇߎޕ‬฽߻ో૕ Presto III ࠍ↪޿ߡขᓧߒ‫ޔ‬቟ቯᕈ߿ㆇ↪ᕈߩၮ␆࠺࡯࠲ ߩࠦࠬ࠻ࡄࡈࠜ࡯ࡑࡦࠬ߿ା㗬ᕈࠍ਄ߍࠆߣߣ߽ߦ‫ޔ‬ ߪ‫ߩ࠼࠶࡝ࠣࠬࡄࡦࡖࠠޔ‬ฦࠢ࡜ࠬ࠲ߩᢙᐕߦࠊߚࠆㆇ↪ ࠦࠬ࠻߿ⶄ㔀ᕈࠍਅߍࠆ‫ޕ‬ታ㓙‫᧲ޔ‬Ꮏᄢࠠࡖࡦࡄࠬ ⁁ᴫࠍෳ⠨ߣߒߚ‫⚿ߩߘޕ‬ᨐ‫ޔ‬CPU ࡁ࡯࠼ߣࠗࡦ࠲ࠦࡀ ࠣ࡝࠶࠼߿ㆊ෰ߩࠬࡄࠦࡦߩ⚻㛎߆ࠄ‫ޔ‬MPI ╬ߩ⸘ ࠢ࠻ߪએਅߩࠃ߁ߥⷐ᳞߇ᵞ޿಴ߐࠇߚ㧦. −38−.

(3) ▚࠻࡜ࡈࠖ࠶ࠢߦኻߒߡࠬ࠻࡟࠶ࠫߩ࠻࡜ࡈࠖ࠶ࠢ OK ߣߒߚ‫ߪࠇߎޕ‬ਥߦࡀ࠶࠻ࡢ࡯ࠢ߿ࠦࡦ࠻ࡠ࡯࡜ ߪࡃ࡯ࠬ࠻⊛ߢ߆ߟ࿶ୟ⊛ߦዋߥ޿‫ޕ‬ ၮ⋚ߥߤߩ‫ޔ‬ㇱຠࠬࡢ࠶ࡊߢኈᤃߦ࿁ᓳߢ߈ࠆୃℂ ࠤ࡯ࡉ࡝ࡦࠣߩዋߥ޿㑆ធ✂࡮Fat Switch ᭴ᚑ㧦Fat ¾ ࠍᗐቯߒߚ‫ޕ‬ NAS ౝߩ HDD ⥄りߪᒰೋ RAID5 ࠍ‫ޔ‬ Node ࠍណ↪ߔࠆߎߣߦࠃࠅ‫ࡦ࡯࡟࠴࡞ࡑޔ‬᭴ᚑߦࠃ ዁᧪ߪ RAID6 ࠍታ⃻ߒ‫ޔ‬1PByte ߢ߽ 4 ᐕ㑆ߢߩ࠺ ࠆ Fast and Wide ߥ⚿ว✂ߩ᭴▽߇น⢻ߣߥߞߚ‫ޕ‬ ࡯࠲៊ᄬ⏕₸ࠍ 0.25%ߣߒߡ⸳⸘ࠍⴕߞߚ‫ޕ‬ή⺰‫ޔ‬ ߎߩߚ߼‫ޔ‬᏷ᐢߊᄙߊߩࠕࡊ࡝ࠤ࡯࡚ࠪࡦߦኻᔕน ㅢᏱߩ࠹࡯ࡊࡃ࠶ࠢࠕ࠶ࡊࠍࠛࡒࡘ࡟࡯࡚ࠪࡦߔࠆ ⢻ߥૐ࡟࡯࠹ࡦࠪ࡮㜞ࡃࡦ࠼᏷࡮ဋ⾰ߥ㑆ធ✂ߩណ Ꮕಽࡃ࠶ࠢࠕ࠶ࡊ߽ disk-to-disk ߢᒰὼⴕ߁‫ޕ‬ ↪߇น⢻ߣߥߞߚ‫࠼࡯ࡁޔࠄ߇ߥߒ߆ߒޕ‬ᢙ߇ CPU ߐࠄߦ‫ޔ‬NAS ߩࡁ࡯࠼㑆ߢ዁᧪⊛ߦߪ striping ᢙߣᲧセߒߡዋߥ޿ߣߪ޿߃‫ޔ‬ᢙචࡐ࡯࠻⒟ᐲߩࠬ RAID ࠍᬌ⸛ߒߚ‫ߦߢߔޕ‬ᒰೋ߆ࠄ Lustre[4]ߥߤߩ ࠗ࠶࠴⟲ߩ FAT Tree ߿ CLOS ᭴ᚑߢߪ‫ᦨޔ‬ૐ㒢ߢ ਗ೉ࡈࠔࠗ࡞ࠪࠬ࠹ࡓ߇⩨ᄢߥ I/O ㅦᐲࠍ↢߆ߔߚ ߽ᢙචบⷙᮨߩࠬࠗ࠶࠴⟲߇ᔅⷐߣߥࠆߎߣ߇੍ᗐ ߼ߦߪᔅ㗇ߢ޽ࠆߎߣߪ᣿⊕ߢ޽ࠅ‫ޔ‬NAS 㑆 RAID ߐࠇߚ‫ޕ‬TSUBAME ߩ⸳⟎㕙Ⓧߪ 300㨙2 એ਄ߣ⹜ ߪߘࠇߩ⥄ὼߥ᜛ᒛߢ޽ࠆ‫ޔߦ߁ࠃߩߎޕ‬NAS ౝߩ ▚ߐࠇ‫࡯࠲ࡦ࠮ᧄޔ‬ౝߩࡈࡠࠕࠬࡍ࡯ࠬࠍ⠨߃ࠆߣ RAID ߣ NAS 㑆ߩ RAID‫ߩઁߪߦࠄߐޔ‬㜞ା㗬ࡈࠔ 㓏ࠍ〙ߞߡ⸳⟎ߐࠇࠆ੍ቯߛߞߚߚ߼‫ߥ߁ࠃߩߎޔ‬ ࠗ࡞ࠪࠬ࠹ࡓߥߤࠍ⚵ߺวࠊߖࠆߎߣߦࠃߞߡ‫ޔ‬㜞 ⚿ว✂ߢߪࠤ࡯ࡉ࡝ࡦࠣ߇࿎㔍ߣߥࠆߎߣ߇੍ᗐߐ ㅦᕈ࡮ၷ‗ᕈߣૐࠦࠬ࠻ࠍਔ┙ߐߖࠆߎߣߣߒߚ‫ޕ‬ ࠇߚ‫ߚ߹ޕ‬ዊⷙᮨߩࠬࠗ࠶࠴ߪ‫߫ߒ߫ߒޔ‬㔚Ḯߥߤ ¾ (2)ߦ㑐ߒߡߪ‫ߊߴࠆߥޔ‬㔚ജല₸߇㜞ߊ‫ޔ‬㜞ᕈ⢻ߢ‫ޔ‬ ߆ߟ I/O ᕈ⢻߇㜞޿(ዋᢙߩ)CPU ߦᄢ㊂ߩ HDD ߇ ߩ౬㐳ᕈ߇ਇ⿷ߒߡ߅ࠅ‫ߟ߆ޔ‬㑆ធ✂ߢߪ৻ߟߩࠬ ធ⛯ߐࠇࠆNAS ߇ᅢ߹ߒ޿ߣߒߚ‫ޕ‬ ․ߦ‫ޔ‬ Infiniband ࠗ࠶࠴ߩ᡿㓚߇(ࡁ࡯࠼ߩ᡿㓚ߣ⇣ߥࠅ)ᄙᢙߩࡁ࡯ ߿ 10GbE ߩᄢၞࠍၒ߼ࠆߚ߼ߦߪ‫ޔ‬NAS ో૕ߢ ࠼⟲ߦᄙᄢߥᓇ㗀ࠍ෸߷ߔߩߢ‫ޔ‬⠴᡿㓚ᕈߩ㕙߆ࠄ 1GB/s એ਄ߩౝㇱ RAID ࠕ࡟ࠗߩว▚ㅦᐲ߇ⷐ᳞ߐ ߽ᅢ߹ߒߊߥ޿‫್ߣޔ‬ᢿߒߚ‫ޔߢߎߘޕ‬ᢙ⊖ࡐ࡯࠻ ࠇࠆ‫ޕ‬ㅢᏱߩ 4+1 ߩ RAID5 ࠕ࡟ࠗߩ I/O ㅦᐲߪ ⷙᮨߩᄢⷙᮨࠬࠗ࠶࠴ߩߺࠍዋᢙบធ⛯ߔࠆ᭴ᚑࠍ 100MB/s~150MB/s ⒟ᐲߥߩߢ‫ޔ‬7 บ߆ࠄ 10 บߩࠕ ߣࠆߎߣߦࠃࠅ‫ߩߎޔ‬໧㗴ࠍ⸃᳿ߔࠆߎߣߣߒߚ‫ޕ‬ ࡟ࠗ‫ ࠅ߹ߟޔ‬HDD ߇ᦨૐߢ߽ 35 บ߆ࠄ 50 บ⒟ᐲ ߎࠇߦࠃࠅ‫ࠍ࠴࠶ࠗࠬޔ‬Ყセ⊛ࡁ࡯࠼ߩㄭߊߦ⟎ߊ NAS ࡁ࡯࠼ߦធ⛯น⢻ߢߥߊߡߪߥࠄߥ޿‫ޕ‬NAS ߎߣ߇ߢ߈‫ޔ‬ㅢᏱߩ⍴〒㔌↪ߩࠤ࡯ࡉ࡞ࠍ↪޿ࠆߎ ో૕ߣߒߡߪ SATA ࠴ࡖࡦࡀ࡞߇ᦨᄢߢ 50 ᧄߢ‫ޔ‬ ߣ߇ߢ߈ࠆ‫৻ޕ‬ᣇ‫࠴࠶ࠗࠬޔ‬㑆ߪࡈࡠࠕࠍ〙ߋߥߤ‫ޔ‬ 10Gbps㧔HW RAID㧕(SW RAID ߩ႐วߪᢙච%߶ 〒㔌߇㐳ߊߥࠆߩߢ‫ޔ‬ਗ೉ߩశࡈࠔࠗࡃࡃࡦ࠼࡞߇ ߤ㜞޿), ⋧੕⚿ว✂ߩ 10Gbps ߩ I/O ㅦᐲࠍട߃ࠆ ↪޿ࠄࠇࠆߎߣߣߒߚ‫ޕ‬ ߣ‫ޔ‬2GByte/s(SW RAID ߩ႐วߪ 3GByte/s)એ਄ߩ z ᧲Ꮏᄢࠠࡖࡦࡄࠬࠣ࡝࠶࠼߿ᣥࠬࡄࠦࡦ߆ࠄߩ⚻㛎ߩߺ I/O ࠬ࡞࡯ࡊ࠶࠻߇⛽ᜬߐࠇࠆᔅⷐ߇޽ࠆ‫ޕ‬ ߥࠄߕ‫੹ޔ‬࿁ᄙᢙߩ࡙࡯ࠩࠍᓥ᧪ࠃࠅ㆝߆ߦᐢ߇ߞߚ↪ㅜ ࠬ࠻࡟࠶ࠫߩ⸳⸘ߪᒰೋ߆ࠄᦨ㊀ὐ ߹ߚ‫ޔ‬NAS ߪࡊࡠ࠻ࠦ࡞ಣℂߥߤߢ㜞޿ಣℂ⢻ജ߇ ߢࠨࡐ࡯࠻ߔࠆߚ߼‫ࠬޔ‬ 㗄⋡ߣߐࠇߚ‫ޔߦ․ޕ‬ኈ㊂ߪ‫ޔ‬࿾⃿ࠪࡒࡘ࡟࡯࠲ߩ✚ว࠺ ᔅⷐߣߐࠇࠆߎߣ߇ᄙ޿‫੹ޕ‬࿁ߩࠃ߁ߦ 50 บㄭ޿ ࡯࠲ኈ㊂߿‫ޔ‬San Diego Supercomputer Center ߩࠕ࡯ࠞ HDD ߇ធ⛯ߐࠇࠆ႐วߪߥ߅ߐࠄߢ޽ࠆ‫ޕ‬ㅒߦ ᦨૐ1 ࡍ࠲ࡃࠗ࠻ߪᔅⷐߣߒߚ‫ޕ‬ ࠗࡉࠪࠬ࠹ࡓߩ೨଀߆ࠄ‫ޔ‬ HDD ߩᢙ߇ᄙߌࠇ߫‫ࠅࠃޔ‬ᶖ⾌㔚ജ߇㜞޿㜞ㅦ ৻ᣇ‫ޔ‬TSUBAME ߩ↪ㅜ߇ᄙጘߦᷰࠆߎߣ‫ޔ‬೨ㅀߩࡀ࠶ CPU ࠍ↪޿ߡ߽‫ޔ‬ᐔḰൻߐࠇࠆߩߢ‫ޔ‬ૐ㔚ജ RISC ᢙච GByte/⑽ߩ I/O ㅦᐲ߇น⢻ߣߥ ࠻ࡢ࡯ࠢ᭴ᚑߦࠃࠅᢙ ࡊࡠ࠮࠶ࠨࠍ↪޿ߚ NAS ࠃࠅᅢ߹ߒ޿‫ޕ‬ ߞߚߥߤ‫ᦨߚ߹ޔ‬ㄭߩᛛⴚ௑ะߣߒߡ‫ޔ‬MAID ᛛⴚߥߤ‫ޔ‬ એ਄ࠍ߹ߣ߼ࠆߣ‫ޔ‬50 บㄭ޿ HDD ࠍ៞タน⢻ߢ‫ߟ߆ޔ‬ HDD ࡌ࡯ࠬߩࠬ࠻࡟࠶ࠫᛛⴚ߇ㅴᱠߒߚߎߣߢ‫ޔ‬ ‫ޟ‬4 ᐕ㑆 ߘࠇߦ⷗วߞߚಣℂ⢻ജߣ਄⸥ߩ I/O ࠬ࡞࡯ࡊ࠶࠻ࠍታ⃻ ࠺࡯࠲ࠍ㜞ା㗬଻ሽน⢻ߢ‫ࠬ࠮ࠢࠕࡓ࠳ࡦ࡜ߟ߆ޔ‬ᕈߩ㜞 ߔࠆ NAS ࠍᔅⷐߣߒߚ߇‫ޔ‬ㅢᏱߩ 3U ߩ NAS ߢߪ HDD ޿᭽‫↪ߥޘ‬ㅜߦ⠴߃‫ߪߦࠄߐޔ‬ᢙච TFlops ⚖ߩᄢⷙᮨਗ ߩᢙ߇ߖ޿ߗ޿ 14 บ⒟ᐲߢ޽ࠅ‫ޔ‬೔ᐩߎߩⷐ᳞ࠍḩߚߐ ೉ಣℂߦᔅⷐߥᢙච GB/s ߩ I/O ㅦᐲߩ⏕଻ࠍ‫ࠢࡄࡦࠦޔ‬ ߥߊ‫ޔ‬໧㗴ߣߥߞߚ‫ޕ‬ ࠻߆ߟ⋭㔚ജߦታ⃻ߔࠆ HDD ࡌ࡯ࠬߩࠬ࠻࡟࠶ࠫߩ᭴ z ૐᶖ⾌㔚ജ࡮㜞ኒᐲࠕࠢ࠮࡜࡟࡯࠲ߦࠃࠆ⸘▚ߩടㅦ: ▽‫߇ޠ‬ᛛⴚ⋡ᮡߣߥߞߚ‫ޕ‬ ⃻⁁ߩ 64bit ߩ x86 ♽ߩ CPU ߩᕈ⢻ߪ‫ޔ‬SpecFP2000 ߥ ߎࠇࠍḩߚߔߦߪ‫ޔ‬ᓥ᧪ߩࠛࡦ࠲ࡊ࡜ࠗ࠭♽ SAN ࠬࠗ ߤࠍ㐓ߺߡ߽‫ޔ‬ᢙ୚߆ࠄච୚એ਄߽ࠦࠬ࠻߇߆߆ࠆࡂࠗࠛ ࠶࠴ࠍਛᔃߣߒߚࠬ࠻࡟࠶ࠫߪ‫ޔ‬⠴᡿㓚ᕈߪ㜞޿߽ߩߩ‫ޔ‬ ࡦ࠼ RISC ࡊࡠ࠮࠶ࠨߣ߶߷㆖⦡߇ήߊߥߞߡ޿ࠆ‫ࠇߘޕ‬ ᕈ⢻㕙࡮ࠦࠬ࠻㕙ߢਇㆡߢ޽ࠆߣ್ᢿߒߚ‫ޔߦ․ޕ‬వㅀߩ ߤߎࠈ߆‫ޔ‬SpecINT2000 ߦ߅޿ߡߪ‫ޔ‬x86 ߩఝ૏ᕈߪ࿶ ⋧੕⚿ว✂߇ሽ࿷ߔࠆߩߢ‫ ߣࠇߘޔ‬SAN ࡀ࠶࠻ࡢ࡯ࠢࠍ ୟ⊛ߢ޽ࠆ‫ޔߚ߹ޕ‬ㄭᐕ HyperTransport, PCI-Express ౒ሽߐߖࠆߎߣߪੑ㊀ᛩ⾗ߣߥߞߡߒ߹߁‫⋧ޔࠈߒ߻ޕ‬੕ ߥߤߦࠃߞߡ‫ޔ‬I/O ㅦᐲ߽഍⊛ߦะ਄ߒߡ߅ࠅ‫⚿ޔ‬ᨐߣߒ ⚿ว✂߇⋥ធធ⛯ߐࠇࠆ NAS ࠬ࠻࡟࠶ࠫࠍਛᔃߣߒߚ㜞 ߡࠗࡦ࠲ࠦࡀࠢ࠻ᕈ⢻߇਄߇ߞߡ޿ࠆ‫ߺ⚵ࠍࠄࠇߎޕ‬วࠊ ኒᐲࠪࠬ࠹ࡓ߇⋡⊛ߦࠃߊว⥌ߔࠆ‫ޕ‬ ߖࠆߎߣߦࠃࠅ‫ⶄޔ‬㔀ᐲߩ㜞޿ਗ೉ࠕ࡞ࠧ࡝࠭ࡓߢ߽‫ޔ‬ᓥ ߒ߆ߒߥ߇ࠄ‫ޔ‬NAS ߩ໧㗴ߪ‫(ޔ‬1) ޿ࠊࠁࠆ single point ᧪ߩࠬࡄࠦࡦએ਄ߦ㜞ല₸ߦታⴕߐߖࠆߎߣ߇น⢻ߣߥ of failure ߇ࠬ࠻࡟࠶ࠫࡁ࡯࠼߅ࠃ߮ࡀ࠶࠻ࡢ࡯ࠢߦ⊒↢ ߞߡ޿ࠆ‫ޕ‬ ߒ߿ߔ޿ߎߣ‫( ߮ࠃ߅ޔ‬2) NAS ⥄りߩ Disk I/O ߿ࡀ࠶࠻ ߒ߆ߒߥ߇ࠄ‫ޔ‬ㄭᐕ CPU ߩ⋭㔚ജൻ߇ᦨ㊀ⷐ⺖㗴ߩ৻ ࡢ࡯ࠢࡃࡦ࠼᏷ߣ HDD/CPU Ყߩࡃ࡜ࡦࠬ߿ᶖ⾌㔚ജߥ ߟߣߥࠅ‫ ߦ߆⏕ޔ‬FLOPS/W ߥߤߩᜰᮡߪะ਄ߒ⛯ߌߡ޿ ߤߩ໧㗴ߢ޽ࠆ‫ޔߪࠄࠇߎޕ‬એਅߩࠃ߁ߦ⸃᳿ߔࠆߩ߇ᦨ ࠆ߽ߩߩ‫ޔ‬100TeraFlops ⚖ߩࠬࡄࠦࡦࠗࡦࡈ࡜ߪ‫ޔ‬2006 ༀߣ್ᢿߒߚ㧦 ᐕ 3 ᦬ߩᲑ㓏ߢ 2-3MW ⚖ߣߥࠆߎߣ߇੍ᗐߐࠇߚ‫ޕ‬ ታ㓙‫ޔ‬ ৻ㇱ SAN ߢੑ㊀ൻߒߚࠬ࠻ ¾ (1) ߦ㑐ߒߡߪ‫৻ߪߕ߹ޔ‬ ⺞㆐ᓟߩ TSUBAME ߩታ᷹୯ߢߪ‫ᦨޔ‬ᄢ⽶⩄ᗐቯߩ ࡟࠶ࠫࠍ⸳ߌߡ‫ߩࠩ࡯࡙ࠍࠇߘޔ‬/home ߿ࡑࠪࡦో Linpack ታⴕߢ‫ޔ‬1 ࡁ࡯࠼޽ߚࠅ 1300W ⒟ᐲ‫ޔ‬Opteron ૕ߩേ૞ߦ㊀ⷐߥࠬ࠻࡟࠶ࠫࠍ⸳ߌࠆߎߣߣߒ‫৻ޔ‬ ㇱಽߛߌߩ 50TeraFlops ߩว▚ߢߪ 850KW ⒟ᐲߢ޽ࠆ‫ޕ‬ ᣇ NAS ߪਥߦ/work ࠛ࡝ࠕߣߒߡ‫ߪߦ⊛ᤨ৻ߟ߆ޔ‬ ߎࠇߦࠬ࠻࡟࠶ࠫ߿ⓨ⺞ࠍട߃ࠆߣ‫ޔ‬100TFlops ⚖ߢߪ⚂ unavailable ߣߥߞߡ߽‫ୃޔ‬ᓳߩᤨ㑆߇චಽ⍴޿(ᢙ 2MW ߣߥߞߡߒ߹߁‫ޕ‬ ᤨ㑆ౝ)ߢ޽ࠇ߫‫៊࠲࡯࠺ޔ‬ᄬߐ߃ߥߌࠇ߫ᒰೋߪ ߘߎߢ‫৻ޔ‬ㇱߩࡢ࡯ࠢࡠ࡯࠼ߢߪ FLOPS/W ୯߇⪺ߒߊ. −39−.

(4) 㜞޿ SIMD ࡌࠢ࠻࡞ဳߩࠕࠢ࠮࡜࡟࡯࠲ࠍ↪޿ࠆߎߣߦ ࠃࠅ‫ߊߒ⪺ࠍ࠭ࠗࠨࡦࠪࡑޔ‬ᄢ߈ߊߖߕߦ‫ޔ‬ᕈ⢻ടㅦࠍน ⢻ߣߔࠆߎߣࠍᬌ⸛ߒߚ‫ޕ‬ㄭᐕ‫⚵߿♽ࠬࠢ࠶ࠖࡈ࡜ࠣޔ‬ㄟ ߺࡑ࡞࠴ࡔ࠺ࠖࠕᒻߪ⸒߁ߦ߅ࠃ߫ߕ‫ޔ‬GRAPE[5]ߥߤ‫ޔ‬ ࠕࡊ࡝ࠤ࡯࡚ࠪࡦ↪ㅜࠍ߆ߥࠅ㒢ቯߔࠇ߫‫⚛ޔ‬᥍ࠄߒ޿ᕈ ⢻ࠍ␜ߔ߽ߩ߇ታ㓙ߦ಴ߡ޿ࠆ‫ޕ‬໧㗴ߪ‫ޔ‬ ‫ࡄࠬߩߥࠎߺޟ‬ ࠦࡦ‫ޔ߁޿ߣޠ‬ᐢ޿࡙࡯ࠩࡌ࡯ࠬߩࠦࡦ࠹ࠢࠬ࠻ߢߪ‫޽ޔ‬ ߹ࠅߦ߽↪ㅜ߿૶޿ᣇ߇㒢ቯߐࠇࠆ߽ߩߪ(ዋߥߊߣ߽ᒰ ೋߪ)‫߇࠻࠶࡝ࡔߩߡߞߣߦࠩ࡯࡙⥸৻ޔ‬ዋߥߊߥߞߡߒ߹ ߁ߎߣߦ޽ߞߚ‫ౕޕ‬૕⊛ߥⷐઙߣߒߡߪ㧦 BLAS‫ޔ‬FFTW ߥߤ‫߇ࠩ࡯࡙ߩ⥸৻ޔ‬ᄙ↪ߔࠆ 1. IEEE754 Ḱ᜚ߩ୚♖ᐲߩᢙ୯࡜ࠗࡉ࡜࡝߇࡙࡯ࠩ ߆ࠄㅘㆊߦടㅦߐࠇࠆߎߣ ໡↪ 2. Matlab, Amber ߥߤ‫ޔ‬᏷ᐢ࡙࡯ࠩࡌ࡯ࠬࠍᜬߟ໡ ߿ public domain ߩࠕࡊ࡝ࠤ࡯࡚ࠪࡦ߇ടㅦߐࠇ߁ ࠆߎߣ వㅴ⊛ߥ࡙࡯ࠩ߇⥄ಽߩࡊ 3. ߘࠇࠄએᄖߩ↪ㅜߢ߽‫ޔ‬వ ࡠࠣ࡜ࡓߩࠦࠕṶ▚ㇱಽࠍ SIMD ࡌࠢ࠻࡞ൻߔࠆߎ ߣߦࠃߞߡ‫ޔ‬᳢↪⊛ߦടㅦߢ߈߁ࠆߎߣ‫ߘޔߦ․ޕ‬ ߩࠃ߁ߥ᳢↪ߩࡊࡠࠣ࡜ࡒࡦࠣⅣႺ߿ SDK ߇ឭଏ ߐࠇࠆߎߣ ߣߒߚ‫ޕ‬ᓧߦ‫ޔ‬1, 2 ߩ↪ㅜߪහല⊛ߥലᨐࠍᦼᓙߔࠆߩ ߪ߽ߜࠈࠎߢ޽ࠆ߇‫ޔ‬ታ㓙ߪࠕࠢ࠮࡜࡟࡯࠲ߩㆡว▸࿐ߪ ᳢↪ CPU ߣᲧセߒߡ⁜޿ߩߢ‫ⶄޔ‬㔀ߥ໧㗴ߢࠬࠤ࡯࡝ࡦ ࠣߐߖࠆߩߪㅒߦ㔍ߒ޿‫߁޿ߣޔ‬੐ᘒ߇޽ࠆ‫ޕ‬ㅒߦ‫ࠢࠕޔ‬ ࠮࡜࡟࡯࠲߇ᓧᗧߥಽ㊁ߢ‫ޔ‬ㅢᏱߩ CPU ࠍ↪޿ࠆߩߪ‫ޔ‬ ᭽‫ߥޘ‬ല₸㕙ߢή㚝߇ᄙ޿‫ޕ‬ᓥߞߡ‫ߢ࠲࡯࡟࡜࠮ࠢࠕޔ‬ኈ ᤃߦࠬࠤ࡯࡝ࡦࠣߐࠇࠆࠃ߁ߥ⁁ᴫߪ‫ޔ‬ዊߐߥࠬࠤ࡯࡞ߩ ໧㗴ߥߤߢ߻ߒࠈߘࠇࠍⓍᭂ⊛ߦᵴ↪ߒߡ߽ࠄ޿‫ޔ‬᳢↪ CPU ߩࡄࡢ࡯߇ᔅⷐߥⶄ㔀ߥ໧㗴ߩࠬࠤ࡯࡝ࡦࠣᤨߦ‫ޔ‬ ޿ࠊ߫‫ߥ⊛⟵৻╙߇ߣߎ߁ࠄ߽ޠߡ޿ߤޟ‬ଔ୯ߣߒߚ‫ޕ‬ ή⺰ߎࠇߪ‫ߡ޿↪ࠍ࠲࡯࡟࡜࠮ࠢࠕޔ‬ᄢⷙᮨߥ໧㗴ߦࠬ ࠤ࡯࡝ࡦࠣߐߖࠆߎߣࠍุቯߒߡ޿ߥ޿‫ޕ‬዁᧪ࡊࡠࠣ࡜ࡒ ࡦࠣࡕ࠺࡞߿ SDK,ࠕ࡞ࠧ࡝࠭ࡓ߇ㅴᱠߔࠇ߫‫߁ࠃߩߘޔ‬ ߥࠬࠤ࡯࡝ࡦࠣߪน⢻ߢ޽ࠆߒ‫ޔߚ߹ޔ‬ታ㓙ߦᓟㅀߩ Linpack ߥߤߦ߅޿ߡ‫⎇ߥ߁ࠃߩߘޔ‬ⓥࠍㅴ߼ߡ޿ࠆ[6]‫ޕ‬ ߚߛ‫ޔ‬ᒰᐳߪ↪ㅜ 1,2 ߦ߅޿ߡ‫ޔ‬ዊߐ޿ࠬࠤ࡯࡞ߛ߇ടㅦ ߇ࠃߊലߊ໧㗴㗔ၞ߳ߩㆡวߩᣇ߇‫ޔ‬TUBAME ో૕ߣߒ ߡߩࡔ࡝࠶࠻߇ᄢ߈޿‫್ߣޔ‬ᢿߒߡ޿ࠆߩߢ޽ࠆ‫ޕ‬ 3.. z. z. z. TSUBAME ߩ⺀↢. એ਄ߩࠃ߁ߥ⸳⸘ⷐઙߩరߦ‫ޔ‬ TSUBAME ߪ NEC ߇ Sun Microsystems, AMD ␠ߥߤߣදᬺߒߡߘߩ⹦⚦⸳⸘߿⵾ ㅧ࡮⸳⟎ߩછߦ޽ߚࠅ‫ޔ‬2006 ᐕ 3 ᦬ᧃᣣߦ⺀↢ߒ‫ޔ‬⠉᦬ ߩ 4 ᦬ 3 ᣣ߆ࠄ╙৻ᰴߩ⹜㛎ㆇ↪ࠍ㐿ᆎߒߚ‫ߩߘޕ‬᭎ⷐߪ ࿑ 1 ߦ␜ߒߡ޿ࠆ‫ޕ‬ᛛⴚ⊛ߥࡐࠗࡦ࠻ߣߒߡߪ‫ޔ‬એਅߩ㗄 ⋡߇᜼ߍࠄࠇࠆ㧦 z 5120 ࠰ࠤ࠶࠻ߦ‫ޔ‬Dual Core CPU ណ↪ߦࠃࠆ 10480 ୘ߩ AMD Opteron ࠦࠕ‫ޔ‬2.4Ghz (৻ㇱ 2.6Ghz)‫ޕ‬ z 8 ࠰ࠤ࠶࠻ࠍ Coherent HyperTransport ߢធ⛯ߒ‫ޔ‬ 16 core ߩ߶߷ SMP ߦㄭ޿౒᦭ࡔࡕ࡝࡮Fat Node ࠍ 4U ߩࠦࡦࡄࠢ࠻ߥࠨࠗ࠭ߢታ⃻ߒߚࠨ࡯ࡃࡑࠪࡦ Sun X4600 ߇ 655 ࡁ࡯࠼‫ ⚂ޔ‬50.4TeraFllops z ࡔ ࡕ ࡝ ߪ 1 ࡁ࡯࠼ 32GB ( ৻ㇱ 64GB) ߢ ว ⸘ 21.4TByte (࿾⃿ࠪࡒࡘ࡟࡯࠲ߩ⚂ 2 ୚)ߢ޽ࠆ‫ࠇߎޕ‬. z. −40−. ߦࠃࠅ‫߆⚦ߩ࠼ࡦࡑࠦ࡮࡝࡜ࡉࠗ࡜߿ࠣࡦ࠾࡯ࡘ࠴ޔ‬ ޿Ꮕ⇣ߪ೎ߣߒߡ‫ޔ‬࿾⃿ࠪࡒࡘ࡟࡯࠲ߢേ૞ߔࠆࡊࡠ ࠣ࡜ࡓߪ߶ߣࠎߤ TSUBAME ߢേ૞ߔࠆ㧔ߘߩ߹߹ ߩࠕ࡞ࠧ࡝࠭ࡓߢ߽ࡔࡕ࡝ਇ⿷ߦ⥋ࠄߥ޿)‫ޕ‬ ⋧੕⚿ว✂ߪ‫ޔ‬Infiniband 4x ߩ Dual Lane ᭴ᚑߢ‫ޔ‬ 1 ࡁ࡯࠼޽ߚࠅ 20Gbps ߢ޽ࠆ (ࠬ࠻࡟࠶ࠫߩ Thumper ߪ single lane)‫ ߪ࠴࠶ࠗࠬޕ‬288 ࡐ࡯࠻ߩ Voltaire ISR 9288 ߢ‫ ߡߒߣ࠴࠶ࠗࠬࠫ࠶ࠛޔ‬6 บ‫ޔ‬ ࠦࠕࠬࠗ࠶࠴߇ 2 บߢ޽ࠆ‫ࠬࠕࠦߣ࠴࠶ࠗࠬࠫ࠶ࠛޕ‬ ࠗ࠶࠴ߪ 24 ᧄߕߟߩࠕ࠶ࡊ࡝ࡦࠢ(ว⸘ 48 ᧄ)ߢ⚿߫ ࠇߡ޿ࠆߩߢ‫࠼ࡦࡃࡦ࡚ࠪࠢ࠮ࠗࡃޔ‬᏷ߪ(1.44Tbps + 1.44Tbps)ߢ޽ࠆ‫ޕ‬ ࠬ࠻࡟࠶ࠫߪ‫ޔ‬ੑߟߩࠪࠬ࠹ࡓߦࠃࠅ᭴ᚑߐࠇߡ޿ࠆ‫ޕ‬ ৻ߟߪ Sun ߩ Thumper ࠪࠬ࠹ࡓ⟲ߢ‫৻ޔ‬บ޽ߚࠅ 4U ߢ 48 บߩ 500GB SATA HDD ࠍ஻߃‫ޔ‬ว▚ኈ㊂ 24TByte ࠍ஻߃ࠆ‫ ߪ࡜࡯ࡠ࠻ࡦࠦࠫ࠶࡟࠻ࠬޕ‬Dual Core / Dual Socket Opteron ߢ޽ࠆ߇‫↪ࠫ࠶࡟࠻ࠬޔ‬ ߦ HyperTransport ⚻↱ߢᄙᢙߩ SATA ࡉ࡝࠶ࠫ߇ ធ⛯ߐࠇߡ߅ࠅ‫ޔ‬48 บಽߦචಽߥ I/O ㅦᐲࠍ⏕଻ߒ ߡ޿ࠆ‫ޕ‬TSUBAME ߢߪ‫ޔ‬Single Lane ߩ Infiniband ߢធ⛯ߒߡ‫ޔ‬RAID5 ᭴ᚑߢో૕ߢ 1GB/s એ਄ߩࠪ࡯ ࠤࡦࠪࡖ࡞ࠕࠢ࠮ࠬߩᄖㇱࡃࡦ࠼᏷ࠍ㆐ᚑߒߡ޿ࠆ‫ޕ‬ TSUBAME ో૕ߢ 42 บߢ‫ోޔ‬ኈ㊂ 1PByte, ోࠬ࠻ ࡟࠶ࠫࡃࡦ࠼᏷ 40GByte/s ߣߥࠆ߇‫ߩߘޔ‬㜞ㅦᕈࠍ ↢߆ߔߚ߼‫ޔ‬/work ࠺ࠖ࡟ࠢ࠻࡝ߢߪ Lustre ਗ೉ࡈ ࠔࠗ࡞ࠪࠬ࠹ࡓࠍേ૞ߐߖ‫ޔ‬ਗ೉ൻߦࠃࠆ㜞ㅦ I/O ࠍ ታ⃻ߒߡ޿ࠆ‫੹ޕ‬ᓟ‫ࠇߘޔ‬એᄖߦ߽ࡃ࠶ࠢࠕ࠶ࡊ߿‫ޔ‬ WebDAV ߥߤ‫ޔ‬᭽‫߽ߦࠬࡆ࡯ࠨࠫ࠶࡟࠻ࠬ⥸৻ߥޘ‬ ᵴべߔࠆ੍ቯߢ޽ࠆ ੑߟ⋡ߪNEC ߩiStorarge S1800AT ࠪࠬ࠹ࡓߢ޽ ࠅ‫ޔ‬SATA ࠍ↪޿ߥ߇ࠄ‫ޔ‬RAID6+౬㐳 SAN ᭴ᚑߦ ࠃࠅ‫ޔ‬ 㜞޿ା㗬ᕈࠍ⏕଻ߒߡ޿ࠆ‫ޕ‬ ోኈ㊂ߪ 100TByte ߢ‫ޔ‬ਥߦ /home ߦ↪޿ࠄࠇߡ޿ࠆ‫ޕ‬ ࠕࠢ࠮࡜࡟࡯࠲ߪ‫ޔ‬ClearSpeed ␠ߩ SIMD ࡌࠢ࠻࡞ ဳߩ࠴࠶ࡊ CSX600 ੑ୘ߕߟ៞タߒߚ PCI-X ߩࡏ࡯ ࠼ࠍ↪޿ߚ(࿑ 1)‫[ߪ⚦⹦ޕ‬6]ߦ⼑ࠆ߇‫৻ޔ‬ᨎ޽ߚࠅߩ ࡇ࡯ࠢᕈ⢻ߪ 96GFlops‫ޔ‬ ࡇ࡯ࠢᶖ⾌㔚ജߪ⚂ 25W ߢ‫ޔ‬ ⃻⁁ߢߪ BLAS ߩᦨ㜞ᕈ⢻߇ 50GFlops ߢ޽ࠅ‫ޔ‬዁᧪ ߐࠄߦᡷༀߩ੍ቯ߇޽ࠆ‫ోޕ‬૕ߩࡏ࡯࠼ᢙߪ⃻⁁ߢߪ 360 ᨎߢ‫ޔ‬ว▚ࡇ࡯ࠢᕈ⢻ߪ 34.6TFlops ߢ޽ࠅ‫ࠞޔ‬ ࡯࠼ߣࡔࠗࡦ CPU 㑆ߩォㅍㅦᐲࠍ㐓ߺߡ‫ޔ‬1 ࡁ࡯࠼ (৻ㇱ)ߏߣߦ 1 ᨎߕߟⵝ⌕ߐࠇߡ޿ࠆ‫ోޕ‬૕ߩᶖ⾌㔚 ‫ޕ‬ ജߪ 9KW એਅ㧔TSUBAME ߩ 1 ࡜࠶ࠢએਅ㧕 ClearSpeed ߩ೑↪ᴺߪ೨ㅀߩ೑↪ࡕ࠺࡞ࠍᗐቯߒ ߡ߅ࠅ‫ޔ‬ᄢⷙᮨߥਗ೉⸘▚߳ߩㆡ↪ߪߎࠇ߆ࠄߛ߇‫ޔ‬ ੹ᓟߩ HPC ߩᣇะᕈߣߒߡ‫ޔ‬ 㜞޿ᦼᓙࠍᛴ޿ߡ޿ࠆ‫ޕ‬ TSUBAME ߩ⸳⟎㕙Ⓧߪࠨ࡯ࡆࠬࠛ࡝ࠕࠍ฽߼ߡ⚂ 350m2 (GSIC ࠮ࡦ࠲࡯ߩ⸘▚ᯏቶో૕ߢ600m2 ⒟ᐲ) ߢ޽ࠅ‫(ࠫ࠶࡟࠻ࠬޔ‬10 ࡜࠶ࠢ)߿ࡀ࠶࠻ࡢ࡯ࠢࠍ฽߼ 76 ࡜࠶ࠢߢ᭴ᚑߐࠇࠆ‫ߩࠢ࠶࡜ߪ࠼࡯ࡁ▚⸘ޕ‬㜞ߐ ߦࠃߞߡ 10 บ߹ߚߪ 11 บᩰ⚊ߐࠇ‫ࠍ࠴࠶ࠗࠬޔ‬฽߼ ߡ 65 ࡜࠶ࠢࠍභ߼‫ޔ‬ᱷࠅ߇ࠬ࠻࡟࠶ࠫ߿೙ᓮ࡮▤ℂ ࡁ࡯࠼‫ޔ‬ᄖㇱធ⛯ࡀ࠶࠻ࡢ࡯ࠢߥߤߩ࡜࠶ࠢߢ޽ࠆ‫ޕ‬ ߎࠇߦ‫ޔ‬32 บߩ಄ළ࡙࠾࠶࠻߇ടࠊࠆ‫ోޕ‬㊀㊂ߪ಄ ළེࠍ฽߼ࠆߣ⚂ 60 ࠻ࡦߢ޽ࠅ‫ޔ‬2F ߣ 1F ߩว⸘ 3 ㇱደߦ〙ߞߡ⸳⟎ߐࠇߡ޿ࠆ‫ޕ‬.

(5) ᧲Ꮏᄢ䇸䉂䉖䈭䈱䉴䊌䉮䊮䇹TSUBAME2006 (NEC/Sun) Fat Nodeဳ䊊䉟䉣䊮䊄PC䉰䊷䊋䋫䉝䉪䉶䊤䊧䊷䉺. Sun Fire X4600 655nodes 16 AMD Opteron cores /Node 10480 Cores/50.4TFlops Memory: 21.4TB. ClearSpeed CSX600 360nodes. type. nodes. CPU clock. MEM/node. A. 639. 2.4GHz. 32GB. B. 16. 2.6GHz. 64GB. 㬍655 nodes (ClearSpeed 360 nodes) = 85 TeraFlops Peak. 96GFlops/Node. 34.6TFlops Dual Lane (20Gbps) x 655. 2-1. InfiniBand Network Voltaire ISR 9288 x 8 (6 Edge, 2 Core). 䊁䊤䊎䉾䊃⚖䊈䉾䊃䊪䊷䉪ⵝ⟎. 10Gbps ( ᣇะ) ᄖㇱធ⛯↪NW ⵝ⟎䈻. 24Gbps ( ᣇะ). 䊶䊶䊶 42บ. ᄖㇱ䊈䉾䊃 ᄖㇱ䊈䉾䊃䊪䊷䉪䊪䊷䉪. NEC SX-8i 䊔䉪䊃䊦⸘▚ᯏ. FileServer FileServer. 500GB 48disks. 500GB 48disks. 500GB 48disks. 䉴䊃䊧䉾䉳䉰䊷䊋A Sun Thumper 1䊉䊷䊄24TB x 42䊉䊷䊄 ‛ℂኈ㊂ 1PB, 40GB/s. (䊧䉧䉲䊷䊶⒖ᬀ⹜㛎╬). Total 1.1PetaBytes. 䊕䉺䊋䉟䊃⚖䉴䊃䊧䉾䉳䉰䊷䊋. C C. 䉴䊃䊧䉾䉳䉰䊷䊋B NEC iStorage S1800AT ‛ℂኈ㊂ 96TB RAID6 ⿥㜞ା㗬. ࿑ 1: TSUBAME ߩ᭎ⷐ᭴ᚑ. z. z. z. TSUBAME ߩᶖ⾌㔚ജߪ‫ޔ‬ቯᩰߢߪ 1153kVA‫ޔ‬಄ළ ⵝ⟎ࠍ฽߻ߣ 1630kVA ߢ޽ࠆ߇‫ޔ‬ታ㓙ߩ᷹ⷰ࿾ߢߪ High Performance Linpack േ૞ᤨ‫ߟ߆ޔ‬಄ᚱེࠍᦨ ᄢࡄࡢ࡯ߢേ૞ߐߖߡ⚂ 1.2MW ⒟ᐲߢ޽ࠆ(5 ᦬ߏ ࠈ)‫ޕ‬ታ㓙‫ޔ‬25 ᐲๆ౉ߦ߅ߌࠆන૕ࡁ࡯࠼ߩ HPL ታ ⴕߦ߅ߌࠆᶖ⾌㔚ജߪ 1330W ߣ⸘᷹ߐࠇߡ߅ࠅ‫ࠃޔ‬ ߞߡ TSUBAME ߩ⸘▚ㇱಽߩታ㓙⊛ߥᦨᄢᶖ⾌㔚ജ ߪ 900KW એਅߣផቯߐࠇࠆ‫⃻ޕ‬࿷‫ޔ‬Opteron ߩ DVS ߦࠃࠆ⋭㔚ജᯏ⢻ PowerNow! ࠍࠝࡦߦߔߴߊ‫ޔ‬ㅊട ߩ㔚ജ⸘᷹߿‫ޔ‬಄ᚱེߩ಴ജߩ࠴ࡘ࡯࠾ࡦࠣ࡮࠳ࠢ࠻ ㈩⟎ߩะ਄࡮࡜࠶ࠢ㑆㓒ოߩㅊട‫ޕࠆ޿ߡߞⴕࠍߤߥޔ‬ ⹦⚦ߪ೎㗄ߦ⼑ࠆ߇‫ޔ‬TSUBAME ߇⚂ 480 ࡁ࡯࠼⟎ ޿ߡ޽ࠆ 2F ߩࡔࠗࡦ⸘▚ᯏቶߪ‫ᦨޔ‬ᣂߩ࠺࡯࠲࠮ࡦ ࠲࡯ߢ↪޿ࠄࠇࠆ‫ޔ‬ๆ᳇஥ߩ಄᳇ߣឃ᳇஥ߩᥦ᳇ߣࠍ ቢోಽ㔌(Cold Row vs. Hot Row Separation)ߒߡ‫߆ޔ‬ ߟᥦ᳇ࠍṛ⇐ߐߖߕߦߔߋߦ಄ළⵝ⟎ߢๆ᳇ߒߡ಄ ߿ߒ‫ޔ‬㜞࿶ജߢๆ౉஥ߦ಄᳇ࠍឃ಴ߔࠆߎߣߦࠃߞߡ 㜞޿಄ළല₸߇ᓧࠄࠇࠆᣂߒ޿ᚻᴺࠍߣߞߡ޿ࠆ[7]‫ޕ‬ ߎࠇߦኻߒ‫ޔ‬ᣥ GSIC ࠍ฽߻ࠊ߇࿖ߩᄙߊߩࠬࡄࠦࡦ ࠮ࡦ࠲࡯߇‫ޔ‬ᣥ᧪ࠬࡄࠦࡦߩ࡟ࠟࠪ࡯ߢ޽ࠆ಄ᥦ᳇ߩ ᡬᜈߦࠃࠆㇱደో૕ߩᐔဋ᷷ᐲࠍਅߍߡᚻᴺࠍ↪޿ ߡ޿ࠆ߇‫ߩߎޔ‬ᚻᴺߪ․ߦ㜞޿ᾲḮ߇޽ࠆ႐วߪᄢᄌ 㕖ല₸ߢ޽ࠆߎߣ߇⍮ࠄࠇߡ޿ࠆ‫ޕ‬TSUBAME ߢߪ‫ޔ‬ ᣂ಄ළᣇᑼታ⃻ߩߚ߼ߦ‫ޔ‬಄ළⵝ⟎ࠍㇱደߩ⌀ਛߩᥦ ᳇೉ߩߔߋᓟࠈߦ߽⸳⟎ߒ‫ޔ‬ᄤ੗ߩ࠳ࠢ࠻ࠍㅢߒߡᥦ ᳇ߣᷙวߖߕߦๆ౉೉ߦ಄᳇ࠍଏ⛎ߔࠆߣ޿߁‫ޔ‬ኾ↪ ߩ㈩⟎⸳⸘࡮ታⵝࠍⴕߞߡ޿ࠆ‫ޕ‬ TUBAME ߩ OS ߪ Linux Suse 9 ࠍ⃻⁁ߢߪోࡁ࡯ ࠼ߢ↪޿ߡ߅ࠅ‫ޔ‬ฦࡁ࡯࠼ߦߪ Boot & Swap ↪ߩ 2.5inch HDD ࠍⵝ஻ߒߡ޿ࠆ‫▤ޕ‬ℂ&࡚ࠫࡉࠬࠤࠫࡘ ࡝ࡦࠣߪ‫ޔ‬Sun N1 Grid Engine ࠍ↪޿ߡ޿ࠆ߇‫ޔ‬዁ ᧪ߎࠇߪ NAREGI ߩࠣ࡝࠶࠼ࡒ࠼࡞ߣធ⛯ߐࠇ‫߆ޔ‬ ߟ Condor [www.cs.wisc.edu/condor/] ߥߤߩઁߩࠫ. ࡚ࡉࠬࠤࠫࡘ࡜ߥߤߣᷙวߐࠇࠆ੍ቯߢ޽ࠆ‫ޕ‬ ή⺰ TSUBAME ߩᔃ⤳ㇱߪ x86-64bit ࡌ࡯ࠬߩࠕ ࡯ࠠ࠹ࠢ࠴ࡖߥߩߢ‫ޔ‬዁᧪ߪ Suse 10 ߳ߩࡃ࡯࡚ࠫࡦ ࠕ࠶ࡊߪ⸒߁ߦ෸߫ߕ‫⁁ޔ‬ᴫߦᔕߓߡ Sun Solaris ߿ Windows Cluster Computing Server ࠍㇱಽ⊛ߦណ ↪ߔࠆߎߣ߽ᬌ⸛ߒߡ޿ࠆ‫ߩࠄࠇߘޕ‬ㆇ↪ߩ㓙ߦߪ‫ޔ‬ OS ࠗࡔ࡯ࠫࡌ࡯ࠬߩേ⊛ߥࡊࡠࡆ࡚ࠫ࠾ࡦࠣ࡮࠺ࠖ ࡊࡠࠗࡔࡦ࠻࠷࡯࡞߿‫ޔ‬઒ᗐᯏ᪾ᛛⴚߦࠃࠆ OS ࡎࠬ ࠹ࠖࡦࠣߥߤߦࠃࠆታ⃻ࠍᨐߚߔ੍ቯߢ޽ࠆ‫ޕ‬ એ਄ߩࠃ߁ߦ‫ޔ‬TSUBAME ߪೋᦼߩ⸳⸘ᕁᗐࠍ߶߷෻ᤋ ߒߚࡑࠪࡦߣߥߞߡ޿ࠆ‫ޕ‬ 4.. TSUBAME ߩ㘧⠍ – ࡌࡦ࠴ࡑ࡯ࠢߣೋᦼㆇ↪. ᐔᚑ18 ᐕ 7 ᦬ 3 ᣣ⃻࿷‫ޔ‬ TSUBAME ߪThe 27th Top500 ߩ Linpack ᕈ⢻ߢ‫߇ࠊޔ‬࿖߅ࠃ߮ࠕࠫࠕ৻‫ޔ‬਎⇇ߢߪ㧣૏ ߢ޽ࠆ 38.18TFlops ࠍ㆐ᚑߒ‫⛘ߩߘޔ‬ኻᕈ⢻߿ኈ㊂߽޽޿ ߹ߞߡ‫ߩࠕࠫࠕޔ‬ઍ⴫⊛ߥࠬࡄࠦࡦߣߥߞߚ[6]‫ޔߚ߹ޕ‬ Rmax/Rpeak ല₸߽ኾ↪⸳⸘ߩࠬ࡯ࡄ࡯ࠦࡦࡇࡘ࡯࠲ߦ Ყ⢋ߔࠆ 76㧚56%ࠍ㆐ᚑߒߚ‫߇ࠊޕ‬࿖ߩࠬࡄࠦࡦ߇ Top10 ߦ౉ࠆߩߪ⃟ߒ޿ߎߣߢߪߥߊ‫ ࠈߒ߻ޔ‬Top500 ߩ㐿ᆎએ ᧪૗ࠄ߆ߩࡑࠪࡦ߇ᔅߕ Top10 ౉ࠅߒߡ޿ߚ߇‫ޔ‬ᤓ੹ߩᄢ ᏷ߦ࡟ࡌ࡞߇਄߇ߞߚ⁁ᴫߢ੹࿁ߩᚑ❣߇㆐ᚑߢ߈ߚߩ ߪ৻ߟߩᚑᨐߣ⸒߃ࠃ߁(10 ૏߇࿾⃿ࠪࡒࡘ࡟࡯࠲)‫ޕ‬ ⃻⁁ߢߪ TSUBAME ߩㆇ↪▸࿐ߪᲑ㓏⊛ߦ᜛ᄢߒ‫⃻ޔ‬ ⁁ߢߪ⚂ 300 ࡁ࡯࠼‫ޔ‬ 4800CPU ㄭߊ߇৻⥸ㆇ↪ߦଏߐࠇ‫ޔ‬ Ⓙ௛₸ߪ 60-80%⒟ᐲߢ޽ࠆ‫ޕ‬ᱷࠅߩ⚂ඨಽᒝߩࡁ࡯࠼ߪ‫ޔ‬ ࿾⃿ࠪࡒࡘ࡟࡯࠲ߩᄢⷙᮨਗ೉ࠦ࡯࠼ߥߤ‫৻ޔ‬ㇱߩవㅴ⊛ ߥ࡙࡯ࠩߩࠦ࡯࠼ࠍ 1000CPU ⚖ߦࡐ࡯࠹ࠖࡦࠣ࡮࠴ࡘ࡯ ࠾ࡦࠣߒߚࠅ‫ޔ‬HPL ࠍ฽߻ ClearSpeed ߩ೑↪ታ㛎ߦଏߐ ࠇߚࠅ‫ޔߩߤߥ߁ⴕࠍࠢ࡯ࡑ࠴ࡦࡌߩ⥸৻ޔ‬᭽‫࡞ࡌ࡟ߥޘ‬ ߢߩ࠹ࠬ࠻ߦᣣ‫੹ޕࠆ޿ߡࠇࠄ޿↪ޘ‬ᓟ࠹ࠬ࠻߿ࡌࡦ࠴ࡑ ࡯ࠢࠍ➅ࠅ㄰ߒ‫ޔ‬㔚ജ߿಄ළࠍ฽߻ㆇ↪૕೙ߩࡈࠔࠗࡦ࠴. −41−.

(6) 5㧚߅ࠊࠅߦ– TSUBAME ߪ‫߳ޠࡦࠦࡄࠬߩߥࠎߺޟ‬. ࿑ 2: TSUBAME ߩ৻ㇱ ࡘ࡯࠾ࡦࠣࠍⴕߞߚ߁߃ߢ‫ޔ‬10 ᦬ࠍ⋡ಣߦ‫৻ޔ‬ㇱߩ࠹ࠬ࠻ ࡁ࡯࠼ࠍ㒰޿ߡ߶߷ోࡁ࡯࠼ࠍቇౝో૕‫߮ࠃ߅ޔ‬ቇᄖߣߩ ౒ห೑↪ߦ౏㐿ߔࠆ੍ቯߢ޽ࠆ‫ޕ‬ ߹ߚ‫ޔ‬TSUBAME ߪ੹ᓟ᭽‫ޔ޿ⴕࠍࠢ࡯ࡑ࠴ࡦࡌߥޘ‬ ߘߩ⚿ᨐࠍ৻⥸ߦᐢߊ౏㐿ߒߡ޿ߊ੍ቯߢ޽ࠆ (http://www.gsic.titech.ac.jp/~ccwww/tgc/bm/)‫ߪߢ⁁⃻ޕ‬ HPL ߪ൩⺰ߛ߇‫ޔ‬MPI ߩฦ⒳ microbenchmark, HPC Challenge Benchmark 㧔 ⚂ ඨ ᢙ ߩ ࡁ ࡯ ࠼ 㧕 (http://icl.cs.utk.edu/hpcc/) ‫ ޔ‬NPB 2.3 (Class B/C), Gaussian‫ޔ‬Amber, ߥߤߢ޽ࠅ‫੹ޔ‬ᓟ߽Ⴧടߔࠆ‫ߢߎߎޕ‬ ߪ‫․߆ߟߊ޿ޔ‬ᓽ⊛ߥ࠺࡯࠲ࠍ⚫੺ߔࠆ‫ޕ‬ z MPI ߩㅢାᕈ⢻ߪ‫࠼࡯ࡁޔ‬㑆ߢߩ࡟࡯࠹ࡦࠪߪ 4.7~5.7Ǵ⑽⒟ᐲ‫ޔ‬ ࡃࡦ࠼᏷ߪ 1.10~1.15GB/s‫ޔ‬ B1/2(ᦨ 㜞 ࡃ ࡦ ࠼ ᏷ ߩ 1/2 ߩ ᕈ ⢻ ࠍ ␜ ߔ ࠺ ࡯ ࠲ 㐳 ) ߇ 16384~32768 ࡃࠗ࠻⒟ᐲߢ‫ߩ࠼࡯ࡁࠆߥߣࠕࡍޔ‬㈩ ⟎ߦ߆߆ࠊࠄߕ߶߷቟ቯߒߚᕈ⢻ࠍ␜ߔ‫ޔߪࠇߎޕ‬ SGI Columbia, Cray Redstorm‫ޔ‬BG/L ߥߤߩหⷙᮨ ߩࠪࠬ࠹ࡓߣห⒟ᐲߩᢙ୯ߢ޽ࠆ‫ޕ‬ z NPB Class C ߢߪ‫ޔ‬ ߶߷ోߡߩࡌࡦ࠴ࡑ࡯ࠢߦࠊߚߞ ߡ‫ࠍ࠼࡯ࡁޔ‬ಽᢔߐߖߡ 128CPU ⒟ᐲ߹ߢ⸘᷹ࠍⴕ ߞߚ߇‫ޔ‬CPU Ⴧടߦ઻߁ Mops/s/CPU ߪ߶߷৻ቯߢ ޽ߞߚ‫ ߪࠇߎޔࠅ߹ߟޕ‬TSUBAME ߩࡀ࠶࠻ࡢ࡯ࠢ ߇㜞ㅦߢࠬࠤ࡯࡜ࡉ࡞ߢ޽ࠆߎߣࠍᗧ๧ߒߡ޿ࠆ‫৻ޕ‬ ᣇ‫ޔ‬16CPU ߹ߢࡁ࡯࠼ౝߢࠬࠤ࡯࡞ߐߖࠆߣ‫ޔ‬ૐਅ ߇⷗ࠄࠇߚ‫ߩߎޕ‬ේ࿃ߪ߹ߛቯ߆ߢߪߥ޿߇‫࡝ࡕࡔޔ‬ ๟ࠅߩਇㆡಾߥࠕࡠࠤ࡯࡚ࠪࡦߦ઻߁ࡃࡦ࠼᏷೙⚂ ߦࠃࠆࠝ࡯ࡃ࡯ࡋ࠶࠼߇ේ࿃ߣߒߡ⠨߃ࠄࠇࠆ‫ޕ‬ z Gaussian ࡌࡦ࠴ࡑ࡯ࠢߪ‫ޔ‬test397 ߢ Linda ਗ೉ൻ ߢᦨᄢ 1024CPU ߹ߢ⹜ߺߚ‫╩ߪࠇߎޕ‬⠪ߩ⍮ࠆ㒢ࠅ ߢߪ੹߹ߢߢᦨᄢߩ CPU ᢙߢ޽ࠆ‫⚿ޕ‬ᨐߣߒߡ‫ޔ‬ 16CPU ߣᲧセߒߡ‫ޔ‬ 48CPU ߹ߢߪᲧセ⊛⦟ߊࠬࠤ࡯ ࡞ߔࠆ߇ 2.02 ୚)‫ࠇߘޔ‬એ㒠ߪടㅦ߇ߥ߹ࠅ‫ޔ‬256CPU ߹ߢࠬࠤ࡯࡞(2.78 ୚)ߒߚ޽ߣ‫ࠇߘޔ‬એ਄ߩ CPU ᢙ ߢߪㅦᐲૐਅߒߚ‫ࠅࠃ(ޔࠅࠃࠇߎޕ‬ේሶᢙߩᄙ޿)㜞 ಽሶߦ߅޿ߡߪ‫ޔ‬ᓥ᧪੍᷹ߐࠇߡ޿ߚࠃࠅᄙ޿ᢙච CPU એ਄ߢߩࠬࠤ࡯࡝ࡦࠣ߇ᒝߊᦼᓙߐࠇࠆ‫ޕ‬ z 38.18TFlops Linpack ߦ߅ߌࠆታⴕᤨ㑆ߪ⚂ 11 ᤨ㑆 ඨߢ޽ࠆ‫ޔߪࠇߎޕ‬Rmax, Nmax ߆ࠄផቯߐࠇࠆ Top500 ਄ߩ਄૏ࡑࠪࡦߩߤߩታⴕᤨ㑆ࠃࠅ߽㐳޿ (Top10 ߢߪ Columbia ߩ⚂ 7 ᤨ㑆 40 ಽ߇ᰴὐ)‫ߎޕ‬ ߩℂ↱ߪ᭽‫ߦޘ‬⠨߃ࠄࠇࠆ߇‫ޔ‬ዋߥߊߣ߽ TSUBAME ߪ Top500 ߩਛߢᱧผ਄߽ߞߣ߽቟ቯߦ Linpack ࠍታⴕߒߚࡑࠪࡦߢ޽ࠆߣ⸒߃ࠃ߁‫ޕ‬. TSUBAME ߪන⚐ߦᓥ᧪ဳߩࠬࡄࠦࡦߢߪߥߊ‫ޔ‬ᰴ਎ઍ ߩ⸘▚⑼ቇ⠪ࠍၭ߁ᢎ⢒߆ࠄᣣᏱߩ⎇ⓥ‫ߪߦࠄߐޔ‬੐ോ♽ ߩࠨ࡯ࡆࠬࡎࠬ࠹ࠖࡦࠣ߹ߢ‫ޔ‬ᢎ⢒⎇ⓥᦼ㑆ߣߒߡߩ޽ࠄ ࠁࠆ IT ࠾࡯࠭ߩਛᔃߣߥࠆߴߊ‫ޔ‬ ‫ޠࡦࠦࡄࠬߩߥࠎߺޟ‬૕ ೙ࠍ⋡ᜰߔᣂߚߥ೑↪ᴺ࡮ᵴ↪ᴺࠍታᣉߒࠃ߁ߣߒߡ޿ࠆ‫ޕ‬ ⃻⁁ߢߪ‫ޔ‬หߓߊ 2006 ᐕ 4 ᦬ࠃࠅዉ౉ߐࠇߚ‫ࡄࡦࡖࠠޟ‬ ࠬ౒ㅢ⹺⸽࡮⹺นࠪࠬ࠹ࡓ‫ߩ߳࡞࠲࡯ࡐ⸽⹺ߩޠ‬ធ⛯߇⹜ 㛎⊛ߦⴕࠊࠇߡ߅ࠅ‫ోޔ‬ቇ߳ߩࠕࠞ࠙ࡦ࠻ઃਈߣ SSO ߇ ታ⃻ߐࠇࠆ‫ޕ‬ታߪߎߩ⹺⸽ࠪࠬ࠹ࡓ⥄り‫৻ޔ‬ㇱ TSUBAME ߩ⾗Ḯࠍ↪޿ߚ߽ߩߢ޽ࠆ‫ޔߦࠄߐޕ‬OCW (Open Courseware)‫ోޔ‬ቇࠬ࠻࡟࠶ࠫࠨ࡯ࡆࠬ‫ޔ‬Windows ߩ࡝ࡕ ࡯࠻࠺ࠬࠢ࠻࠶ࡊߥߤ߇‫ޔ‬TSUBAME ਄ߢ઒ᗐࡑࠪࡦߥ ߤߩᛛⴚࠍ↪޿ߡࡎࠬ࠹ࠖࡦࠣߐࠇࠃ߁ߣߒߡ޿ࠆ‫ࡄࠬޕ‬ ࠦࡦߣ޿߁ⷰὐ߆ࠄ㐓ߺࠇ߫‫߇ࠄࠇߎޔ‬೑↪ߔࠆ⾗Ḯߪో ૕ߢߪᓸ‫ోޔ߇ߛߩ߽ࠆߚޘ‬ቇߩ IT ⾗Ḯߩ TCO ߩ೥ᷫ‫ޔ‬ ߐࠄߦߪᖱႎࠨ࡯ࡆࠬߩ㓸⚂ൻ߿ဋ⾰ൻߦࠃࠆ೑ଢᕈߩ ะ਄ߩലᨐߪᄢᄌᄢ߈޿ߣᦼᓙߒߡ޿ࠆ‫ޕ‬ ᦨᓟߦ‫ޔ‬TSUBAME ߩ੹ᓟߩ⊒ዷߩ⸘↹ࠍㅴ߼ߡ޿ࠆ‫ޕ‬ ᛛⴚ⊛ߦߪ 2008 ᐕߏࠈߦ 300TFlops ⚖߿‫ޔ‬ᢙࡍ࠲ࡃࠗ࠻ ߩࡑࠪࡦ߳‫⃻ޔ‬࿷ߩ⸳⟎㕙Ⓧ࡮ᶖ⾌㔚ജ࡮ㆇ↪૕೙ࠍ⛽ᜬ ߒߥ߇ࠄࠕ࠶ࡊࠣ࡟࡯࠼ߔࠆߩߪኈᤃߢ޽ࠅ‫ߪߣ޽ޔ‬ᛩ⾗ ᰴ╙ߢ޽ࠆ‫ޔߦࠄߐޕ‬TSUBAME ߩ⸳⸘࡮ᄾ⚂਄ߩ‫ޟ‬ኼ ๮‫ ߪޠ‬2010 ᐕ 3 ᦬߹ߢߢ޽ࠆ߇‫ߩߘޔ‬ᓟ⛮ߣߒߡߪ‫ޔ‬ 1PFlops ⚖ߩࡑࠪࡦࠍ⠨ኤਛߢ޽ࠆ‫ޕ‬ ⻢ㄉ TSUBAME ߦ‫ޟ‬㑐ࠊߞߚ‫ੱޠ‬ᢙߪᧄቇ࠻࠶ࡊ߆ࠄ GSIC ߿੐ോᣇ߹ߢߩฦ㑐ଥ⠪࡮࡙࡯ࠩߪ⸒߁ߦ෸߫ߕ‫ޔ‬ฦࡌࡦ ࠳࡯ߩᄙᢙߩᣇ‫ޔޘ‬ᢥㇱ⑼ቇ⋭‫ߪߦࠄߐޔ‬Ᏹᣣ㗃 HPC ߦ 㑐ߒߡ⼏⺰࡮౒ห⎇ⓥߒߡ޿ࠆᣇ‫ߩߘޔߢ߹ޘ‬ᢙߪシߊ⷗ Ⓧ߽ߞߡ߽ 100 ੱන૏ߣߥࠆ‫⚕ޕ‬㕙߇⿷ࠅߥ޿ߩߢ୘‫ੱޘ‬ ߳ߩᓮ␞߇ߢ߈ߥ޿ߩ߇ᱷᔨߢ޽ࠆ߇‫ߩߎߕ߹ߣ߭ޔ‬႐ࠍ ୫ࠅߡᷓߊᓮ␞ࠍ↳ߒ਄ߍ‫੹ޔ‬ᓟ߽ TSUBAME ߩ⊒ዷ߳ ߩߏදജࠍ߅㗿޿ߐߖߡ޿ߚߛߌࠇ߫ᄢᄌᐘ޿ߢ޽ࠆ‫ޕ‬ ෳ⠨ᢥ₂ [1] Thomas Sterling et. al. How to Build a Beowulf: A. Guide to the Implementation and Application of PC Clusters, The MIT Press, May, 1999. [2] IDC Worldwide Quarterly Server Tracker Press release 1Q 2006, IDC, http://www.idc.com/ getdoc.jsp?containerId=prUS20180706, May, 2006. [3] ᧲ Ꮏ ᄢ ࠠ ࡖ ࡦ ࡄ ࠬ ࠣ ࡝ ࠶ ࠼ ࡊ ࡠ ࠫ ࠚ ࠢ ࠻ ‫ޔ‬ http://www.gsic.titech.ac.jp/TITechGrid/ [4] Cluster Filesystems Inc. Whitepaper, "Lustre: A Scalable, High-Performance File System", Nov. 2002., http://www.lustre.org/docs/whitepaper.pdf [5] Junichiro Makino, et. al. "A 1.349 Tflops Simulation of Black Holes in a Galaxy Center on GRAPE-6", Proc. IEEE Supercomputing 2000, IEEE Press. Nov. 2000. [6] ㆙⮮ᢅᄦ, ᧻ጟ⡡, ᯅῪା᣿, 㐳ဈ⌀〝, ᓟ⮮๺⨃: ‫࠲࡯ࡘࡇࡦࠦ࡯ࡄ࡯ࠬဳࡠ࠹ࡋޟ‬TSUBAME ߩLinpack ߦࠃࠆᕈ⢻⹏ଔ‫ޠ‬ᖱႎಣℂቇળࡂࠗࡄࡈࠜ࡯ࡑࡦࠬࠦࡦࡇ ࡘ࡯࠹ࠖࡦࠣ⎇ⓥળ੍Ⓜ㓸(SWoPP2006), 2006 ᐕ 8 ᦬. [7] Chandrakant D. Patel et. al. "Thermal Considerations in Cooling Large Scale High Compute Density Data Centers", Itherm2002---8th Intersociety Conf. on Thermal and Thermomechanical Phenomena in Electronic Systems, San Diego, 2002.. −42−.

(7)