advertisement

4th RICC workshopのご案内

71 %
29 %
advertisement
Information about 4th RICC workshopのご案内
Technology

Published on February 20, 2014

Author: reokashiwazaki

Source: slideshare.net

Description

第15回さくらの夕べin札幌のLT内容です。ちょっと補っております。
advertisement

4th RICC workshopの ご案内 An invitation for 4th RICC workshop 第15回さくらの夕べ in 札幌 柏崎 礼生 Hiroki Kashiwazaki

小 市桂岡町から きました

4th RICC workshop @Okinawa 2014/3/27(Thu)∼28(Fri)

RICC

俵屋宗達: 風神雷神図 (1624ころ?) Soutatsu Tawaraya: Fujin Raijin-zu

R 地域間 I インタークラウド C 分科会 C

雲内放電 Inter Cloud Lightening

RICC 4th RICC workshop 4th RICC workshopの ご案内 @Okinawa 2014/3/27(Thu)∼28(Fri) An invitation for 4th RICC workshop 第15回さくらの夕べ in 札幌 柏崎 礼生 俵屋宗達: 風神雷神図 (1624ころ?) Soutatsu Tawaraya: Fujin Raijin-zu Hiroki Kashiwazaki R 地域間 I インタークラウド C 分科会 C 90- 00 2001.9.11 the Internet September 11 attacks live migration of VM between distributed areas 雲内放電 広域分散 仮想化環境 after Migration 82p/5min Inter Cloud Lightening TOYAMA site 2003.8.14 Northeast blackout of 2003 TOKYO site before Migration 2011.3.11 in Japan 群馬 Copy to DR-sites Copy to DR-sites OSAKA site 石狩 The aftermath of the 2011 Tohoku earthquake and tsunami Copy to DR-sites real time and active-active features seem to be just a simple "shared storage". Live migration is also possible between DR sites (it requires common subnet and fat pipe for memory copy, of course) DR Distcloud 1978 Disaster Recovery Sun Information Systems Gunmma prefecture BCP Business Continuity Plan 2つで 十分ですよ? Ishikari city 82p/5min 琉球大学 40 0 10MB 0 64 16 random write 40000 20000 Global VM migration is also available by sharing "storage space" by VM host machines. Real time availability makes it possible. Actual data copy follows. (VM operator need virtually common Ethernet segment and fat pipe for memory copy) backend (core servers) File block block block block block block block block 40000 20000 0 16384 4096 256 1024 409616384 65536 262144 16 1.04858e+06 4.1943e+06 File size in 2^n KBytes 1.67772e+07 4 6.71089e+07 64 1024 256 Record size in 2^n Kbytes POSIX準拠 TOYAMA site NFS, CIFS, iSCSI Copy to DR-sites TOKYO site before Migration OSAKA site propos ed metho d Copy to DR-sites real time and active-active features seem to be just a simple "shared storage". Live migration is also possible between DR sites (it requires common subnet and fat pipe for memory copy, of course) NFS CIFS iSCSI r=2 e=0 ACK r=1 block redundancy =3 r=0 VM 広島大学 1GB redundancy =3 10GB File size bkwd read record rewrite 60 40 20 0 60 40 20 10MB 100MB 1GB 0 10GB Throughput (MB/sec) 100 80 80 60 40 100MB 1GB 0 10GB 60 40 20 20 10MB File size 80 10MB 100MB File size 1GB 10GB 0 10MB 40 Throughput (MB/sec) 100 60 80 60 40 20 10MB 100MB 1GB 10GB 0 1GB 10GB File size fread 120 100 80 100MB File size fwrite 120 legend 従来方式 Exage/Storage 広域対応 Exage/Storage 80 SINET4 Kanazawa University EXAGE L3VPN 60 40 20 10MB 100MB 1GB 10GB 0 10MB File size 100MB 1GB 10GB File size SC2013 当初の予定 2013/11/17∼22 We have been developing a widely distributed cluster storage system and evaluating the storage along with various applications. The main advantage of our storage is its very fast random I/O performance, even though it provides a POSIX compatible file system interface on the top of distributed cluster storage. @Colorado Convention Center NFS 本番 r = -1 e=2 external Hypervisor shared write hash 100MB r=0 e=1 r=1 e=0 r=2 ACK consistent Meta Data after Migration Copy to DR-sites 10MB Read (before migration) Read (after migration) Write (before migration) Write (after            migration)              live migration of VM between distributed areas interface protocl SINET4 Hiroshima University EXAGE L3VPN 40 ) 064 60000 60 0 10GB 120 Throughput (MB/sec) File size in 2^n KBytes t (MB/sec Kbytes/sec 60000 High Random R/W Performance 80000 1GB File size 100 Throughpu requirement 80000 100000 100MB 100 File size 120000 80 20 10MB 120 0 100000 reread 40 120 4 256 1024 4096 1638465536 1.04858e+06 262144 4.1943e+066.71089e+07 1.67772e+07 下條真司 Shinji Shimojo @Osaka Univ, NICT 面白く ないよね! 国際回線を 国際回線上での 本番 RTT=244ms 1Gbps 金沢大学 iozone -aceI problems 100 60 0 10GB 100 20 120000 1GB 120 80 stride read 64 Throughput (MB/sec) 16384 4096 1024 256 64 Record size in 2^n Kbytes 100MB Throughput (MB/sec) 256 20000 256 1024 409616384 65536 262144 16 1.04858e+06 4.1943e+06 File size in 2^n KBytes 1.67772e+07 4 6.71089e+07 CloudStack 4.0.0 120 80 20 10MB File size Throughput (MB/sec) 1024 40000 40000 064 40 100 Throughput (MB/sec) 60000 20000 60 0 10GB 120 4096 80000 60000 1GB random read 16384 100000 80000 100MB File size 120000 100000 read 100 80 20 20 Throughput (MB/sec) 60 Throughput (MB/sec) Throughput (MB/sec) 80 XenServer 6.0.2 CloudStack 4.0.0 120 100 100 Record size in 2^n Kbytes Distributed Storage rewrite 120 120 Kitami Institute of Technology XenServer 6.0.2 write write 120000 SINET 最長 University of the Ryukyus 国立情報学研究所 Throughput (MB/sec) point of sales RTT > 100ms ≒50ms shared storage POS Realtime Processing Kbytes/sec 80- 90 mainframe hot site 北見工大 DCダウン時の 今年は 折り返し

live migration of VM between distributed areas after Migration 広域分散 仮想化環境 TOYAMA site Copy to DR-sites TOKYO site Copy to DR-sites OSAKA site Copy to DR-sites real time and active-active features seem to be just a simple "shared storage". Live migration is also possible between DR sites (it requires common subnet and fat pipe for memory copy, of course) before Migration

Distcloud

DR Disaster Recovery

1978

Sun Information Systems

mainframe hot site

80- 90

Realtime Processing

POS point of sales

90- 00

the Internet

2001.9.11 September 11 attacks

2003.8.14 Northeast blackout of 2003

in Japan

2011.3.11 The aftermath of the 2011 Tohoku earthquake and tsunami

BCP Business Continuity Plan

群馬 Gunmma prefecture

石狩 Ishikari city

2つで 十分ですよ?

国立情報学研究所

北見工大 University of the Ryukyus 琉球大学 SINET 最長 Kitami Institute of Technology

XenServer 6.0.2 CloudStack 4.0.0 CloudStack 4.0.0 XenServer 6.0.2

problems

shared storage

≒50ms

RTT > 200ms

分散ストレージ distributed storage

要求性能 required quality

120000 120000 Kbytes/sec 100000 80000 60000 40000 20000 064 100000 High Random R/W Performance 80000 60000 40000 20000 0 16384 4096 1024 256 1024 409616384 65536 262144 16 1.04858e+06 4.1943e+06 File size in 2^n KBytes 1.67772e+07 4 6.71089e+07 256 64 Record size in 2^n Kbytes

POSIX準拠 interface protocl NFS, CIFS, iSCSI

Con$idential Global VM migration is also available by sharing "storage space" by VM host machines. Real time availability makes it possible. Actual data copy follows. (VM operator need virtually common Ethernet segment and fat pipe for memory copy) live migration of VM between distributed areas after Migration TOYAMA site Copy to DR-sites TOKYO site before Migration Copy to DR-sites OSAKA site Copy to DR-sites real time and active-active features seem to be just a simple "shared storage". Live migration is also possible between DR sites (it requires common subnet and fat pipe for memory copy, of course)

backend (core servers) block File block block block block block block block block Meta Data consistent hash

NFS CIFS iSCSI

r=2 ACK r=1 write r=0 redundancy =3

r=2 e=0 r=0 e=1 r=1 e=0 r = -1 e=2 ACK dundancy =3 external

VM Hypervisor 10Gbps 1/4U server x4 Cisco UCS

広島大学 大阪大学 金沢大学 国立情報学研究所

iozone -aceI a: full automatic mode c: Include close() in the timing calculations e: Include flush (fsync,fflush) in the timing calculations I: Use DIRECT IO if possible for all file operations.

write 120000 16384 100000 120000 Kbytes/sec 100000 60000 1024 40000 80000 256 20000 60000 0 64 40000 20000 064 16 16384 4096 1024 256 1024 409616384 65536 262144 16 1.04858e+06 4.1943e+06 File size in 2^n KBytes 1.67772e+07 4 6.71089e+07 64 64 4 256 1024 4096 1638465536 1.04858e+06 262144 4.1943e+066.71089e+07 1.67772e+07 256 Record size in 2^n Kbytes File size in 2^n KBytes Record size in 2^n Kbytes 4096 80000

write rewrite read reread 100 100 100 80 60 40 60 40 20 20 0 80 10MB 100MB 1GB 0 10GB Throughput (MB/sec) 120 Throughput (MB/sec) 120 Throughput (MB/sec) 120 100 Throughput (MB/sec) 120 80 60 40 20 10MB 100MB 1GB 0 10GB random read 60 40 20 10MB 100MB File size File size 80 1GB 0 10GB random write bkwd read 1GB 10GB record rewrite 100 100 100 80 60 40 20 0 80 60 40 20 10MB 100MB 1GB 0 10GB Throughput (MB/sec) 120 Throughput (MB/sec) 120 Throughput (MB/sec) 120 100 Throughput (MB/sec) 100MB File size 120 80 60 40 10MB 100MB 1GB 0 10GB 10MB 100MB File size stride read fwrite 1GB 10GB 100 0 Throughput (MB/sec) 100 Throughput (MB/sec) 100 20 80 60 40 20 10MB 100MB 1GB File size 10GB 0 100MB 1GB File size 10MB 100MB 1GB legend 従来方式 Exage/Storage 広域対応 Exage/Storage 80 60 40 20 10MB 0 File size 120 40 40 fread 120 60 60 File size 120 80 80 20 20 File size Throughput (MB/sec) 10MB File size 10GB 0 10MB 100MB 1GB File size 10GB 10GB

SINET4 Hiroshima University EXAGE L3VPN SINET4 Kanazawa University EXAGE L3VPN

Read (before migration) Read (after migration) Write (before migration) Write (after            migration)              Through put (MB/sec ) propo sed metho d shared NFS

SC2013 2013/11/17∼22 @Colorado Convention Center

We have been developing a widely distributed cluster storage system and evaluating the storage along with various applications. The main advantage of our storage is its very fast random I/O performance, even though it provides a POSIX compatible file system interface on the top of distributed cluster storage.

当初の予定

下條真司 Shinji Shimojo @Osaka Univ/JGN-X Leader

面白く ないよね!

本番

本番 折り返し RTT=244ms 1Gbps

国際回線を 使用した マイグレーション

国際回線上での 広域分散ストレージ のアクセス試験

DCダウン時の DR実現検証

今年は 拠点を 米国に

Future Works

Big Data Analysis

モバイルデバイス からの行動データ behavior data from mobile devices

電源非供給地域で 収集されるデータ data from non-electrification area

mobile devices high latency power consumption sensor devices personal data aggregation service

mobile devices regional data center low latency regional exchange wide-area distributed platform personal data aggregation service regional data center regional exchange sensor devices

経路最適化

【今後の展開】仮想計算機の流動性向上に向けて VM VM migration VM 18

拠点間マイグレーションにおける経路最適化の実現 Layer VM L2 + L2 VPLS, IEEE802.1ad PB(Q-in-Q), IEEE802.1ah(Mac-in-Mac) L2 over L3 IP VXLAN, OTV, NVGRE ( L3 IP L3 SDN ID/Locator OpenFlow ID Locator LISP IP L4 L7 IP MAT, NEMO, MIP(Kagemusha) mSCTP SCTP DNS + Reverse NAT IP ( L2 / L3 SCTP Dynamic DNS VM Reverse NAT L2 / L3 IP 21

2011.3.11 The aftermath of the 2011 Tohoku earthquake and tsunami

Japan Taiwan Indonesia New Zealand

4th RICC workshop @Okinawa 2014/3/27(Thu)∼28(Fri)

http://ricc.itrc.net

そういえば任期が 2014/3/31まで なので… Cybermedia Center Osaka University

転職先 探しています

おあとが よろしい ようで

go to next stage

Add a comment

Comments

当店限界 | 06/06/15
なぜ視聴者まだを使用するの新聞を読むことをするとき、この技術で地球 全体のことはであるが提示 ウェブネットの? [url=http://www.dkkozmetik.com]当店限界底値で大放出[/url]
特別価格 | 07/06/15
私は、こんにちは たいこのためにサブスクライブするには WebサイトWebサイト 取る 最新更新は、したがってここで、私にできること、それは支援助けます。 [url=http://eastbayneurosurgery.com]特別価格[/url]
正規品 送 | 08/06/15
グループ群衆 優秀 仕事ともたらす配信発生 維持し続けてください! [url=http://www.zincdetails.com]正規品 送料無料[/url]

Related presentations

Presentación que realice en el Evento Nacional de Gobierno Abierto, realizado los ...

In this presentation we will describe our experience developing with a highly dyna...

Presentation to the LITA Forum 7th November 2014 Albuquerque, NM

Un recorrido por los cambios que nos generará el wearabletech en el futuro

Um paralelo entre as novidades & mercado em Wearable Computing e Tecnologias Assis...

Microsoft finally joins the smartwatch and fitness tracker game by introducing the...

Related pages

カンバシのご案内 プレスリリース - Documents

4th RICC workshopのご案内 第15回さくらの夕べin札幌のLT内容です。 ... OpenStack 4th Birthday PartyでのLT資料です。 8/7 ...
Read more

ロシアの声日本語放送70周年記念 ...

4th RICC workshopのご案内 第15回さくらの夕べin札幌のLT内容です。ちょっと補っております。 131114 ...
Read more