No09 Handson OpenStack Internal

(1)

基盤構築演習

Cloud Infrastructure Design and Deployment

9. _{内部構造の探索演習}

2017.v1

(2)

 本演習 ^All-in-One 構築 ^OpenStack 環境上複数仮想ソー

配置仮想ソーう技術実現い確認

 ン環境構築

 Nova

 Cinder

 Neutron

 ン演習

2

(3)

演習環境について

(4)

演習環境の概要

 演習用 OpenStack環境上各自割当ン内演習行い

o _{各環境生徒} _独立 _い

 最初演習実施前共通演習環境構築実施必要あ

 前回演習環境残い場合演習環境削除方法実施い

4 openstack

tenant-XX / student-XX tenant-YY / student-YY _・・・

物理ーーワー装置ー

資源層

抽象化層

ン

( )

仮想ーー

内部ワー

192.168.199.0/24

共通演習環境

演習環境 _演習環境

共通演習環境構築実施

構築：第N回演習環境構築作成

削除：演習環境削除方法実施

各自端末操作行う

(5)

演習環境の削除方法

各演習回の前に前回の環境を削除すために実施

(6)

演習環境を削除

 前回演習環境残い場合環境削除

6 [centos@console ~]$ nova delete openstack-single

Request to delete server openstack-single has been accepted.

[centos@console ~]$ nova list --field name

+---+---+

| ID | Name |

+---+---+

| 4aa81ca5-caa8-484c-aa34-1a9754528127 | console | +---+---+

[centos@console ~]$ PORTID1=`neutron port-list --fixed-ips ip_address=192.168.199.100 -c id -f csv --quote none | grep -v id`

[centos@console ~]$ PORTID2=`neutron port-list --fixed-ips ip_address=172.16.100.100 -c id -f csv --quote none | grep -v id`

[centos@console ~]$ neutron port-delete $PORTID1 && neutron port-delete $PORTID2

Deleted port: 6b5dcb28-899a-43fc-950f-35ae26d3a99b

Deleted port: 023dc50d-cd1c-489f-b7f0-ad65c3eb8880

[centos@console ~]$ neutron router-interface-delete Ext-Router floating-subnet

Removed interface from router Ext-Router.

[centos@console ~]$ neutron net-delete floating-net

Deleted network: floating-net

[centos@console ~]$ neutron net-list

+---+---+---+

| id | name | subnets |

+---+---+---+

| 1cc16a31-cf1d-436f-8b7f-bc463e58db88 | public | 592f49ed-2387-4cb1-8cc9-1f66bd956265 |

| 051318d6-e77b-4f9a-97fa-9735393ca32d | work-net | 2d76e242-5c1d-4759-b40c-167a0e4e1dc3 192.168.199.0/24 | +---+---+---+

[centos@console ~]$ nova keypair-delete key-for-console

[centos@console ~]$ nova keypair-delete my-key

[centos@console ~]$ nova keypair-list

+---+---+

| Name | Fingerprint | +---+---+ +---+---+

[centos@console ~]$ exit

仮想ーー削除

console _削除 _{コン}

ン使え削除

論理ー削除

仮想ーー仮想

ワー接続解除

キー削除

環境演習共通利用

削除

(7)

演習環境を削除

 残演習用ーー関連ソー削除

ンン削除

Floating IP _削除

キー削除

(8)

演習環境を構築す前の状態

 各演習環境構築前以下状態い事確認い

o _default _以外 _存在 _{いい}

 ^default 共通演習環境作成

o _キ _{ー以外} _ソー _存在 _{いい}

 以下 3 画面確認い

o _何 _{ソーや} _残 _{い場合} _{次項手順削除} _い

8 default

存在い

Security Groups _以

外消費いい

3 _存在

い

(9)

Stacks _の確認

 以下確認

o Orchestration _{→ Stacks} default _{以外存在} _{いい}

 ^default 以外存在い場合対象削除

o _削除 _default _以外 _選択 Delete Stacks _押下

default

存在い

例 ^hands-on-3 選

択

(10)

ソー消費量の確認

 以下確認

o _Compute _{→ Overview} Limit Summary Security Groups _{以外消費}

0 _状態 _い

 ソー残い場合前項手順 ^Stacks 確認不要

削除い

 ソー残い場合次項手順個別ソー削除

い

10 Security Groups _{以外消費}

いい ⁰ 状態確認

(11)

個別のソー削除

 ー一覧表示残いソー削除

o _{以下削除例}

ンン削除

Floating IP _削除

キー削除

(12)

ネッワーの状態

 以下確認

o _Network → Network Topology [public] - [Ext-Router] - [work-net] _状態

い

 余分ソー作成い場合個別削除

い

12 3 _存在

い

(13)

第9回演習環境の構築

(14)

タッの起動

 左ー Orchestration _{→ Stacks} _選択

 後 Launch Stack _押下

14 第9回

(15)

ンプーの指定

 Template Source URL _指定

 Template URL http://<<repo_ip>>/hands-on/09_handson.yaml _指定

o <<repo_ip>> _{部分講師} _{値指定あ}

 値設定 ^Next 押下

URL _選択

http://<<repo_ip>>/hands-on/09_handson.yaml

第9回

(16)

ーターの指定

 ^{Stack Name} ^hands-on-9 入力

 ^Password 自分 OpenStack ワー入力

 hands-on repository server _{ーー IP} _入力

o _IP _講師 _{指示あ}

16 hands-on-9

自分 OpenStack ワー

入力

ーー IP

起動ーー

ワー設定

後ン使用

第9回

(17)

正常終了の確認

 10分前後作成完了 Create Complete

o _{設定完了待間} _{後演習進方} _い _キ _確認 _い _い

 失敗場合 ^hands-on-9 選択 Delete Stack _押下 _削除

 後再度作成や直い

第9回

(18)

環境の確認

 ^Network → Network Topology 選択作成ワー環

境確認

 正常作成完了以下状態い

18 第9回

(19)

サーーの確認

 ^Compute → Instances 選択作成 ¹ 台ーー情報確

認

o handson9-openstack-single _{前回演習作成} _{環境同一環境構成} _い

o _{環境上演習行い}

第9回

(20)

ン情報の確認

 作成ーーン情報確認

 Orchestration → Stacks → hands-on-9 → Overview 選択

い

o _情報 _{後演習何回必要} _新規 _ン _開い _演習

ー進

20 第9回

(21)

ン情報

 ^Overview 必要

情報確認

o _instance

 ーー IP

 ーー名

 Floating IP

 各自ー PC ^IP

対 ^SSH 行い

o _password

 上記ーーンワー

 ーー名 ^centos

 ワー自分設定値

表示

o private_key

 各ンン利用

秘密鍵

 ワー認証行え各PC

SSH _ン _設定

ワー入力ン

可能

第9回

(22)

サンプ環境の構築

22

(23)

サンプ環境の論理構成図

 All-in-One 環境上以下ン環境構築

 ン環境 ^OpenStack 上う実現い確認

外部ネッワー public

10.10.10.0/24 10.20.20.0/24 10.30.30.0/24 10.10.10.254 10.20.20.254 10.30.30.254

test-vm-1 test-vm-2 test-vm-3

boot-vol 10GB

Ext-Router Closed-Router

copy-snap-vol 10GB

OpenStack

・Libvirt/KVM

・LVM/iSCSI

・Open vSwitch/vxlan

Boot From Volume 起動他 test-vm-1,2 同一

(24)

サンプ環境の構築

 起動い All-in-One環境上ン環境構成い

 準備いンー実行

o _{興味あ方} _{中確認} _い

24 [sysuser@cn01060802 ~]$ ssh [email protected]

The authenticity of host '157.1.141.201 (157.1.141.201)' can't be established.

ECDSA key fingerprint is 5c:9c:eb:ee:cf:11:e3:a9:32:63:3f:31:29:55:72:af.

Are you sure you want to continue connecting (yes/no)? yes

Warning: Permanently added '157.1.141.201' (ECDSA) to the list of known hosts.

[email protected]'s password:

[centos@handson9-openstack-single ~]$ sudo -i

[root@handson9-openstack-single ~]# source keystonerc_admin

[root@handson9-openstack-single ~(keystone_admin)]#

[root@handson9-openstack-single ~(keystone_admin)]# nova list

[root@handson9-openstack-single ~(keystone_admin)]# neutron net-list

[root@handson9-openstack-single ~(keystone_admin)]# cinder list

[root@handson9-openstack-single ~(keystone_admin)]# openstack image list

[root@handson9-openstack-single ~(keystone_admin)]# wget reposerver/hands-on/09_handson_build_example.sh

[root@handson9-openstack-single ~(keystone_admin)]# bash ./09_handson_build_example.sh

#### waiting to boot instance ...

| status | ACTIVE |

## associating FIP

#########

## done !

#########

handson9-openstack-single _ン

root _ー _{切替え}

コンー出い事確認

い

ンー実行

(25)

サンプ環境の構築

 実行完了以下状態

o _{環境構築う} _行 _{い場合以下} _{ンー} _実行 _再度手順

実行い

 wget reposerver/hands-on/09_handson_delete_example.sh

 bash ./reposerver/hands-on/09_handson_delete_example.sh

[root@handson9-openstack-single ~(keystone_admin)]# nova list

+---+---+---+---+---+---+

+---+---+---+---+---+---+

+---+---+---+---+---+---+

[root@handson9-openstack-single ~(keystone_admin)]# neutron net-list

+---+---+---+

| id | name | subnets |

+---+---+---+

| bed720f0-1f22-4037-b8f7-e85426076031 | 3rd-net | 63d57072-58fe-43b5-b6a2-e6870c59cce9 10.30.30.0/24 |

| 5451f498-658c-47eb-a0e5-39d027d67f1c | public | 8ec6b1f6-6f4d-4f3f-8432-6b2939fc19da 172.16.100.0/24 |

| 238177bf-002d-4dcf-a533-0a616c927bd1 | work-net | b91f57c1-6110-47f0-8613-2d849be6ac96 10.10.10.0/24 |

| d945c4af-1f7e-4a9f-8b5f-8639dfe3cb3f | 2nd-net | 64e14f83-4ac8-4a45-8e37-f42096d39d75 10.20.20.0/24 | +---+---+---+

[root@handson9-openstack-single ~(keystone_admin)]# neutron router-list

+---+---+---+---+---+

+---+---+---+---+---+

| 33412777-4ae4-4dfe-a578-6d21e535df96 | Ext-Router | {"network_id": "5451f498-658c-47eb-a0e5-39d027d67f1c", | False | False |

| | | "enable_snat": true, "external_fixed_ips": [{"subnet_id": | | |

| | | "8ec6b1f6-6f4d-4f3f-8432-6b2939fc19da", "ip_address": | | |

| | | "172.16.100.101"}]} | | |

+---+---+---+---+---+

[root@handson9-openstack-single ~(keystone_admin)]# cinder list

+---+---+---+---+---+---+---+

+---+---+---+---+---+---+---+

ンン

ー

ーー

4 _ワー

public _含

(26)

allowed-address-pairs _の設定

26

[root@handson9-openstack-single ~(keystone_admin)]# neutron router-list

+---+---+---+---+---+

+---+---+---+---+---+

| d71ce8ae-f8a4-42fb-a79d-bce151e64ef7 | Ext-Router | {"network_id": "28af33bb-8836-48b6-bb93-7410ba85c35e", | False | False |

| | | "enable_snat": true, "external_fixed_ips": [{"subnet_id": | | |

| | | "7cc8bea6-32a8-4215-96c6-ac0145ed9e90", "ip_address": | | |

| | | "172.16.100.101"}]} | | |

+---+---+---+---+---+ [root@handson9-openstack-single ~(keystone_admin _]#ip netns

qrouter-fa0b71a6-33fb-4c0d-b605-0df78e352581 qdhcp-de4a41f7-072c-45d3-8966-b05a1ca5bee3 qdhcp-1c24f13a-11c1-4d0c-a1d9-a6d15c73f591 qdhcp-f1cb2c6c-1f5d-4294-84f5-208d27307905 qrouter-d71ce8ae-f8a4-42fb-a79d-bce151e64ef7

[root@handson9-openstack-single ~(keystone_admin)]# ip netns exec qrouter-d71ce8ae-f8a4-42fb-a79d-bce151e64ef7 ip addr 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1

link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo

valid_lft forever preferred_lft forever inet6 ::1/128 scope host

valid_lft forever preferred_lft forever

8: qg-b4d03d80-17: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UNKNOWN qlen 1000 link/ether fa:16:3e:fc:52:1e brd ff:ff:ff:ff:ff:ff

inet 172.16.100.101/24 brd 172.16.100.255 scope global qg-b4d03d80-17 valid_lft forever preferred_lft forever

inet6 fe80::f816:3eff:fefc:521e/64 scope link valid_lft forever preferred_lft forever

10: qr-3e08908f-80: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UNKNOWN qlen 1000 link/ether fa:16:3e:59:8b:8f brd ff:ff:ff:ff:ff:ff

inet 10.10.10.254/24 brd 10.10.10.255 scope global qr-3e08908f-80 valid_lft forever preferred_lft forever

inet6 fe80::f816:3eff:fe59:8b8f/64 scope link valid_lft forever preferred_lft forever

12: qr-d0dc8764-d5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc noqueue state UNKNOWN qlen 1000 link/ether fa:16:3e:b3:c3:22 brd ff:ff:ff:ff:ff:ff

inet 10.20.20.254/24 brd 10.20.20.255 scope global qr-d0dc8764-d5 valid_lft forever preferred_lft forever

inet6 fe80::f816:3eff:feb3:c322/64 scope link valid_lft forever preferred_lft forever

Ext-Router UUID _確認

Ext-Router _対応 _ー

ー確認

ーー内

172.16.100.xx IP

持ンーー ^MACULAR

確認

MAC _い

い

(27)

allowed-address-pairs _の設定

 ーー切替え演習 OpenStack 操作

[root@handson9-openstack-single ~(keystone_admin)]# su - centos

[centos@handson9-openstack-single ~]$ wget reposerver/hands-on/openrc

[centos@handson9-openstack-single ~]$ vi openrc

[centos@handson9-openstack-single ~]$ source openrc

[centos@handson9-openstack-single ~]$ neutron port-list -F id -F fixed_ips

+---+---+

| id | fixed_ips |

+---+---+

| 4ed1d937-4387-4418-87c9-3d616aa9fb56 | {"subnet_id": "ed249599-7370-411e-8f86-72f0b9083f17", "ip_address": "172.16.100.100"} |

| | {"subnet_id": "ed249599-7370-411e-8f86-72f0b9083f17", "ip_address": "172.16.100.101"} |

| 871a9b6b-40ac-42ea-a9e5-ca0fa38c3edb | {"subnet_id": "cafe729e-832c-4dcc-98b3-766ad33daa4e", "ip_address": "192.168.199.100"} |

| ba017b39-4ae2-4578-a7c7-edf1522e063a | {"subnet_id": "cafe729e-832c-4dcc-98b3-766ad33daa4e", "ip_address": "192.168.199.1"} |

| df823b95-9473-42ae-a461-95bc6ac73b81 | {"subnet_id": "ed249599-7370-411e-8f86-72f0b9083f17", "ip_address": "172.16.100.254"} |

| e3107018-691d-4da8-a3ff-94f98a903092 | {"subnet_id": "cafe729e-832c-4dcc-98b3-766ad33daa4e", "ip_address": "192.168.199.254"} | +---+---+

[centos@console ~]$ neutron port-update 4ed1d937-4387-4418-87c9-3d616aa9fb56 \

--allowed-address-pairs type=dict list=true \

mac_address=fa:16:3e:fc:52:1e,ip_address=172.16.100.0/24

[centos@handson9-openstack-single ~]$ exit

前回演習同様編集

い

(28)

Nova

28

(29)

nova _{のプセとサービ}

 起動い nova 確認

o _同 _複数起動 _い _{コ・} _CPU _環境 _{処理効率上}

 同時い起動設定 ^worker 決定

[root@openstack-single ~(keystone_admin)]# ps -ef | grep nova

nova 1038 1 0 04:26 ? 00:00:46 /usr/bin/python2 /usr/bin/nova-scheduler nova 1042 1 0 04:26 ? 00:03:59 /usr/bin/python2 /usr/bin/nova-api

nova 1065 1 0 04:26 ? 00:00:12 /usr/bin/python2 /usr/bin/nova-novncproxy --web /usr/share/novnc/ nova 1070 1 0 04:26 ? 00:00:42 /usr/bin/python2 /usr/bin/nova-cert

nova 1078 1 0 04:26 ? 00:03:57 /usr/bin/python2 /usr/bin/nova-conductor nova 1092 1 0 04:26 ? 00:00:41 /usr/bin/python2 /usr/bin/nova-consoleauth nova 2757 1 0 04:26 ? 00:01:44 /usr/bin/python2 /usr/bin/nova-compute nova 3519 1078 0 04:27 ? 00:01:36 /usr/bin/python2 /usr/bin/nova-conductor nova 3520 1078 0 04:27 ? 00:01:38 /usr/bin/python2 /usr/bin/nova-conductor nova 4084 1042 0 04:27 ? 00:00:16 /usr/bin/python2 /usr/bin/nova-api nova 4085 1042 0 04:27 ? 00:00:13 /usr/bin/python2 /usr/bin/nova-api nova 4148 1042 0 04:27 ? 00:00:00 /usr/bin/python2 /usr/bin/nova-api nova 4149 1042 0 04:27 ? 00:00:00 /usr/bin/python2 /usr/bin/nova-api root 13797 13688 0 12:55 pts/0 00:00:00 grep --color=auto nova

qemu 32174 1 1 11:16 ? 00:01:24 /usr/libexec/qemu-kvm -name instance-00000008 -S -machine ^省略 qemu 32346 1 1 11:16 ? 00:01:24 /usr/libexec/qemu-kvm -name instance-00000009 -S -machine ^省略

[root@openstack-single ~(keystone_admin)]# systemctl | grep nova

openstack-nova-api.service loaded active running OpenStack Nova API Server openstack-nova-cert.service loaded active running OpenStack Nova Cert Server openstack-nova-compute.service loaded active running OpenStack Nova Compute Server openstack-nova-conductor.service loaded active running OpenStack Nova Conductor Server openstack-nova-consoleauth.service loaded active running OpenStack Nova VNC console auth Server

起動い

確認

OS _ー _登

録い nova ー

確認

(30)

仮想ンの起動状態

 nova 操作 libvirt/kvm _環境 _{い確認} _い

 virsh コンや ^nova 起動仮想ン確認可能

o _環境 _既 _ン _ン _起動 _い _{以下情報確認}

30 [root@openstack-single ~(keystone_admin)]# virsh list --all

Id Name State

---

2 instance-00000017 running

3 instance-00000018 running

4 instance-00000019 running

[root@openstack-single ~(keystone_admin)]# ps -ef |grep qemu-kvm

qemu 6795 1 5 04:10 ? 00:13:44 /usr/libexec/qemu-kvm -name instance-00000017 -S -machine pc-i440fx-rhel7.0.0,accel=kvm,usb=off -cpu host -m 2048 -realtime mlock=off - smp 2,sockets=2,cores=1,threads=1 -uuid dc1e3695-db8a-449c-833f-7dc21af09529 -smbios type=1,manufacturer=Fedora Project,product=OpenStack Nova,version=2015.1.1-1.el7,serial=0af04d3c- 78a9-43ae-8f3c-c26602e374f2,uuid=dc1e3695-db8a-449c-833f-7dc21af09529 -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/instance-

00000017.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=utc,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive file=/var/lib/nova/instances/dc1e3695-db8a-449c-833f-7dc21af09529/disk,if=none,id=drive-virtio-

disk0,format=qcow2,cache=none -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x4,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -netdev tap,fd=25,id=hostnet0,vhost=on,vhostfd=26 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=fa:16:3e:36:1a:f1,bus=pci.0,addr=0x3 -chardev file,id=charserial0,path=/var/lib/nova/instances/dc1e3695-db8a-449c-833f-

7dc21af09529/console.log -device isa-serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1 -device isa-serial,chardev=charserial1,id=serial1 -device usb-tablet,id=input0 - vnc 0.0.0.0:0 -k ja -vga cirrus -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5 -msg timestamp=on

qemu 7081 1 5 04:10 ? 00:13:50 /usr/libexec/qemu-kvm -name instance-00000018 -S -machine pc-i440fx-rhel7.0.0,accel=kvm,usb=off -cpu host -m 2048 -realtime mlock=off - smp 2,sockets=2,cores=1,threads=1 -uuid 37e82cb6-badc-4ad3-8c31-d44f0db182cf -smbios type=1,manufacturer=Fedora Project,product=OpenStack Nova,version=2015.1.1-1.el7,serial=0af04d3c- 78a9-43ae-8f3c-c26602e374f2,uuid=37e82cb6-badc-4ad3-8c31-d44f0db182cf -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/instance-

00000018.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=utc,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive file=/var/lib/nova/instances/37e82cb6-badc-4ad3-8c31-d44f0db182cf/disk,if=none,id=drive-virtio-

disk0,format=qcow2,cache=none -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -netdev tap,fd=25,id=hostnet0,vhost=on,vhostfd=27 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=fa:16:3e:77:7c:70,bus=pci.0,addr=0x3 -netdev tap,fd=28,id=hostnet1,vhost=on,vhostfd=29 -device virtio-net-

pci,netdev=hostnet1,id=net1,mac=fa:16:3e:8f:eb:a4,bus=pci.0,addr=0x4 -chardev file,id=charserial0,path=/var/lib/nova/instances/37e82cb6-badc-4ad3-8c31-d44f0db182cf/console.log -device isa-serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1 -device isa-serial,chardev=charserial1,id=serial1 -device usb-tablet,id=input0 -vnc 0.0.0.0:1 -k ja -vga cirrus - device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x6 -msg timestamp=on

qemu 7441 1 6 04:11 ? 00:16:07 /usr/libexec/qemu-kvm -name instance-00000019 -S -machine pc-i440fx-rhel7.0.0,accel=kvm,usb=off -cpu host -m 2048 -realtime mlock=off - smp 2,sockets=2,cores=1,threads=1 -uuid e315087d-d258-4441-ae1e-8c39563d0880 -smbios type=1,manufacturer=Fedora Project,product=OpenStack Nova,version=2015.1.1-1.el7,serial=0af04d3c- 78a9-43ae-8f3c-c26602e374f2,uuid=e315087d-d258-4441-ae1e-8c39563d0880 -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/instance-

00000019.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=utc,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive file=/dev/disk/by-path/ip-192.168.100.10:3260-iscsi-iqn.2010-10.org.openstack:volume-c871554c-ad7e-4917-8945- c2e1725fa577-lun-0,if=none,id=drive-virtio-disk0,format=raw,serial=c871554c-ad7e-4917-8945-c2e1725fa577,cache=none -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x4,drive=drive- virtio-disk0,id=virtio-disk0,bootindex=1 -netdev tap,fd=25,id=hostnet0,vhost=on,vhostfd=28 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=fa:16:3e:9d:c7:be,bus=pci.0,addr=0x3 - chardev file,id=charserial0,path=/var/lib/nova/instances/e315087d-d258-4441-ae1e-8c39563d0880/console.log -device isa-serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1 -device isa-serial,chardev=charserial1,id=serial1 -device usb-tablet,id=input0 -vnc 0.0.0.0:2 -k ja -vga cirrus -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5 -msg timestamp=on

libvirtd _経由 _仮想

ン起動い事確認

起動い情報確認

細情報確認

(31)

仮想ンの定義情報

 定義い仮想ン実体確認

 仮想ン実体 /var/lib/nova/instances 保存い

[root@openstack-single instances(keystone_admin)]# cd /var/lib/nova/instances/

[root@openstack-single instances(keystone_admin)]# ls -alF

total 8

drwxr-xr-x. 2 nova nova 80 Nov 24 08:05 _base

-rw-r--r--. 1 nova nova 49 Nov 25 10:09 compute_nodes

drwxr-xr-x. 2 nova nova 69 Nov 25 04:10 37e82cb6-badc-4ad3-8c31-d44f0db182cf

drwxr-xr-x. 2 nova nova 69 Nov 25 04:10 dc1e3695-db8a-449c-833f-7dc21af09529

drwxr-xr-x. 2 nova nova 42 Nov 25 04:11 e315087d-d258-4441-ae1e-8c39563d0880

drwxr-xr-x. 2 nova nova 4096 Nov 24 08:05 locks

drwxr-xr-x. 2 nova nova 6 Nov 21 05:50 snapshots

[root@openstack-single instances(keystone_admin)]# nova list --fields name

+---+---+

| ID | Name |

+---+---+

| dc1e3695-db8a-449c-833f-7dc21af09529 | test-vm-1 |

| 37e82cb6-badc-4ad3-8c31-d44f0db182cf | test-vm-2 |

| e315087d-d258-4441-ae1e-8c39563d0880 | test-vm-3 |

+---+---+

nova _{割当} UUID _同

名前作成

ンン

実体情報格納い

(32)

仮想ンの定義情報

 実際仮想ン定義い確認

o libvirt.xml _仮想 _{ン定義保存}

 名前通 ^libvirt 用 xml

 仮想ーー演習 virt-install や virt-manager 利用仮想ン作成い同

仮想ン作成い

32 [root@openstack-single instances(keystone_admin)]# ls -alF

total 12

drwxr-xr-x. 8 nova nova 4096 Nov 25 04:11 ./

drwxr-xr-x. 9 nova nova 103 Nov 20 12:57 ../

drwxr-xr-x. 2 nova nova 69 Nov 25 04:10 37e82cb6-badc-4ad3-8c31-d44f0db182cf/

drwxr-xr-x. 2 nova nova 80 Nov 24 08:05 _base/

-rw-r--r--. 1 nova nova 49 Nov 25 11:32 compute_nodes

drwxr-xr-x. 2 nova nova 69 Nov 25 04:10 dc1e3695-db8a-449c-833f-7dc21af09529/

drwxr-xr-x. 2 nova nova 42 Nov 25 04:11 e315087d-d258-4441-ae1e-8c39563d0880/

drwxr-xr-x. 2 nova nova 4096 Nov 24 08:05 locks/

drwxr-xr-x. 2 nova nova 6 Nov 21 05:50 snapshots/

[root@openstack-single instances(keystone_admin)]# cd dc1e3695-db8a-449c-833f-7dc21af09529/

[root@openstack-single dc1e3695-db8a-449c-833f-7dc21af09529(keystone_admin)]# ls -alF

total 148408

drwxr-xr-x. 2 nova nova 69 Nov 25 04:10 ./

drwxr-xr-x. 8 nova nova 4096 Nov 25 04:11 ../

-rw-rw----. 1 qemu qemu 40475 Nov 25 04:19 console.log

-rw-r--r--. 1 qemu qemu 151912448 Nov 25 11:29 disk

-rw-r--r--. 1 nova nova 79 Nov 25 04:09 disk.info

-rw-r--r--. 1 nova nova 2623 Nov 25 04:10 libvirt.xml

[root@openstack-single dc1e3695-db8a-449c-833f-7dc21af09529(keystone_admin)]# cat libvirt.xml

出力次ペーへ

中身確認

test-vm-1 _{定義確認}

nova boot UUID _同

名前移

動

(33)

libvirt.xml

<name>instance-00000017</name>

<nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.0">

<nova:package version="2015.1.1-1.el7"/>

<nova:name>test-vm-1</nova:name>

<nova:creationTime>2015-11-25 04:10:24</nova:creationTime>

<nova:flavor name="my.standard">

<nova:memory>2048</nova:memory>

<nova:disk>10</nova:disk>

<nova:swap>0</nova:swap>

<nova:ephemeral>0</nova:ephemeral>

<nova:vcpus>2</nova:vcpus>

</nova:flavor>

<nova:owner>

<nova:user uuid="c473d119c2ac41a88a7a88762caf9696">admin</nova:user>

<nova:project uuid="75e4fcce5a0c4ee88a4ae35eebc5e24e">admin</nova:project>

</nova:owner>

<nova:root type="image" uuid="95dcd698-bbba-48c8-a117-e14434eefed8"/>

</nova:instance>

</metadata>

<entry name="manufacturer">Fedora Project</entry>

<entry name="product">OpenStack Nova</entry>

</system>

</sysinfo>

<os>

</os>

<acpi/>

<apic/>

</features>

</cputune>

(^続 )

</cpu>

<disk type="file" device="disk">

<driver name="qemu" type="qcow2" cache="none"/>

<source file="/var/lib/nova/instances/dc1e3695-db8a-449c-833f-7dc21af09529/disk"/>

<target bus="virtio" dev="vda"/>

</disk>

<interface type="bridge">

<mac address="fa:16:3e:36:1a:f1"/>

<model type="virtio"/>

<source bridge="qbra27766f4-0c"/>

<target dev="tapa27766f4-0c"/>

</interface>

<serial type="file">

<source path="/var/lib/nova/instances/dc1e3695-db8a-449c-833f-7dc21af09529/console.log"/>

</serial>

<serial type="pty"/>

<input type="tablet" bus="usb"/>

<graphics type="vnc" autoport="yes" keymap="ja" listen="0.0.0.0"/>

<video>

<model type="cirrus"/>

</video>

<memballoon model="virtio">

<stats period="10"/>

</memballoon>

</devices>

</domain>

情報記載い

次項確認

他ワーやコンソー

VNC _{等重要情報確認}

 仮想ーー構成様々情報記述い

 ^Nova 自動生成い

(34)

ーフの実体

 ンン実体同 UUID名配置 ^disk

o /var/lib/nova/instances/_base _格納 _ー _ー

ー

o _{_base} _保存 _glance _取得 _ー _実体

o _nova _同 _ー _起動 _ン _ー _{う管理} _容

量節約や再ンー遅延無う設計い

 正確同ー同ーー起動

34 [root@openstack-single dc1e3695-db8a-449c-833f-7dc21af09529(keystone_admin)]# ls -alF

total 148408

drwxr-xr-x. 2 nova nova 69 Nov 25 04:10 ./

drwxr-xr-x. 8 nova nova 4096 Nov 25 04:11 ../

-rw-rw----. 1 qemu qemu 40475 Nov 25 04:19 console.log

-rw-r--r--. 1 qemu qemu 151912448 Nov 25 11:29 disk

-rw-r--r--. 1 nova nova 79 Nov 25 04:09 disk.info

-rw-r--r--. 1 nova nova 2623 Nov 25 04:10 libvirt.xml

[root@openstack-single dc1e3695-db8a-449c-833f-7dc21af09529(keystone_admin)]# qemu-img info disk

image: disk

file format: qcow2

virtual size: 10G (10737418240 bytes)

disk size: 145M

cluster_size: 65536

backing file: /var/lib/nova/instances/_base/2a1810f919f9dd0532222c51101f4209ea072952

Format specific information:

compat: 1.1

lazy refcounts: false

内容確認

別ーー

あ確認

(35)

ーフの実体

 他仮想ン情報確認

o test-vm-1,2 _同 _ー _起動 _い disk _同 _キン

持い

o _test-vm-3 _{情報出力} _い _ン _ン _{boot from}

volume _起動 _ー _ー _持 _い

[root@openstack-single instances(keystone_admin)]# cd /var/lib/nova/instances/ [root@openstack-single instances(keystone_admin)]# nova list --fields name +---+---+

| ID | Name | +---+---+

| dc1e3695-db8a-449c-833f-7dc21af09529 | test-vm-1 |

| 37e82cb6-badc-4ad3-8c31-d44f0db182cf | test-vm-2 |

| e315087d-d258-4441-ae1e-8c39563d0880 | test-vm-3 | +---+---+

[root@openstack-single instances(keystone_admin)]# grep -R "source file" */*.xml

37e82cb6-badc-4ad3-8c31-d44f0db182cf/libvirt.xml: <source file="/var/lib/nova/instances/37e82cb6-badc-4ad3-8c31-d44f0db182cf/disk"/> dc1e3695-db8a-449c-833f-7dc21af09529/libvirt.xml: <source file="/var/lib/nova/instances/dc1e3695-db8a-449c-833f-7dc21af09529/disk"/> [root@openstack-single instances(keystone_admin)]# qemu-img info /var/lib/nova/instances/37e82cb6-badc-4ad3-8c31-d44f0db182cf/disk image: /var/lib/nova/instances/37e82cb6-badc-4ad3-8c31-d44f0db182cf/disk

file format: qcow2

virtual size: 10G (10737418240 bytes) disk size: 145M

cluster_size: 65536

backing file: /var/lib/nova/instances/_base/2a1810f919f9dd0532222c51101f4209ea072952 Format specific information:

compat: 1.1

lazy refcounts: false

[root@openstack-single instances(keystone_admin)]# qemu-img info /var/lib/nova/instances/dc1e3695-db8a-449c-833f-7dc21af09529/disk image: /var/lib/nova/instances/dc1e3695-db8a-449c-833f-7dc21af09529/disk

file format: qcow2

virtual size: 10G (10737418240 bytes) disk size: 145M

同キン

持い

(36)

Boot From Volume _{ンタンの定義}

 test-vm-3 cinder ー起動い実体所持

い

o _libvirt _定義 _cinder _提供 _ー _{今回 iSCSI} _接続 _い

確認

o _ー _{接続後演習確認}

36 [root@openstack-single instances(keystone_admin)]# cd /var/lib/nova/instances/

[root@openstack-single instances(keystone_admin)]# nova list --fields name

+---+---+

| ID | Name |

+---+---+

| dc1e3695-db8a-449c-833f-7dc21af09529 | test-vm-1 |

| 37e82cb6-badc-4ad3-8c31-d44f0db182cf | test-vm-2 |

| e315087d-d258-4441-ae1e-8c39563d0880 | test-vm-3 |

+---+---+

[root@openstack-single instances(keystone_admin)]# ls -alF e315087d-d258-4441-ae1e-8c39563d0880

total 48

drwxr-xr-x. 2 nova nova 42 Nov 25 04:11 ./

drwxr-xr-x. 8 nova nova 4096 Nov 25 04:11 ../

-rw-rw----. 1 nova qemu 40618 Nov 25 04:21 console.log

-rw-r--r--. 1 nova nova 2662 Nov 25 04:11 libvirt.xml

[root@openstack-single instances(keystone_admin)]# less e315087d-d258-4441-ae1e-8c39563d0880/libvirt.xml

抜粋

<source dev="/dev/disk/by-path/ip-192.168.100.10:3260-iscsi-iqn.2010-10.org.openstack:volume-c871554c-ad7e-4917-8945-c2e1725fa577- lun-0"/>

</disk> 抜粋

test-vm-1 定義比較

</disk>

test-vm-3 disk

所持いい事確認

接続 iscsi

直接指定い

(37)

nova-compute _{プセと仮想} _ン

 nova-compute 起動各仮想ン独立い

o nova-compute _停止 _仮想 _{ン影響受}

o _{新い仮想} _{ン作成や削除} _際 _{ー等発生}

 管理者 virshコンやkillコン利用 ^nova 経由仮想

ン操作可能

o _緊急時や _{行う際手法} _原則的 _nova _経由 _全 _操作

行う必要あ

o _nova _持 _ー _ー _{実際状態異} _nova _正 _動作

(38)

nova _{の構成ータベー}

 nova 全情報ーー保存い

o _ー _ー _停止 _{状態取得含} _{一切操作行え}

o _前述 _う既動いい機能停止あ

 以下手順ー一部確認

38 [root@openstack-single ~ keystone_admin ]# ^mysql -uroot nova

MariaDB [nova]> show tables;

+---+

| Tables_in_nova |

+---+

| agent_builds |

| aggregate_hosts |

| aggregate_metadata |

| aggregates |

| block_device_mapping |

| bw_usage_cache |

| cells |

| certificates |

| compute_nodes |

| console_pools |

| consoles |

| dns_domains |

| fixed_ips |

省略

MariaDB [nova]> ^select * from services;

MariaDB [nova]> ^select * from compute_nodes;

MariaDB [nova]> select uuid,created_at,hostname,deleted from instances;

nova _ー _ー _接

続

所持ー一覧確

認

いーー

確認う

(39)

nova _{のータベー} _ー

 nova ーーー削除い設計い

 不要ー削除ー残続

 長期わ運用場合不要ー定期的削除必

要あ

MariaDB [nova]> select uuid,created_at,hostname,deleted from instances;

+---+---+---+---+

+---+---+---+---+

| 53391918-e4b1-40e9-ad1d-75b7c408b74b | 2015-11-20 14:50:42 | test-vm-1 | 1 |

| 02f782b3-975a-4314-927b-a446900210ad | 2015-11-21 04:33:57 | test-vm-1 | 2 |

| cafad1d4-99e7-4f64-b417-c06bdd03197c | 2015-11-21 04:34:03 | test-vm-2 | 3 |

| 3b181581-0c32-4a72-baf0-e94755d33a4d | 2015-11-21 04:35:13 | test-vm-3 | 4 |

| a216d8b0-bfa0-41ce-8389-e63b4be0fd5c | 2015-11-21 04:41:51 | test-vm-4 | 5 |

| 6d97c09b-bc0c-421b-b36f-4bb652d1b282 | 2015-11-21 05:48:17 | test-vm-3 | 6 |

| 95715a93-4926-443c-81d7-f43f0d61918e | 2015-11-21 05:51:26 | test-vm-4 | 7 |

| 3c23815e-a2f5-4751-9025-d44e488a8489 | 2015-11-22 09:31:34 | test-vm-1 | 8 |

| 8d975aa7-8fee-44c4-a9b3-2b2e019fd0c0 | 2015-11-22 09:31:44 | test-vm-2 | 9 |

| ac0770f2-ee80-4e1c-a75b-a32b9bc9d88e | 2015-11-22 11:19:28 | test-vm-1 | 10 |

| 37d0f512-a2ad-45ca-ba28-f262af9fa4e0 | 2015-11-22 11:33:39 | vol-vm-1 | 11 |

| f576e4ae-8d7f-4f56-a1b1-ce6803295f46 | 2015-11-22 11:40:31 | vol-vm-2 | 12 |

| 6093309d-d949-44ad-8bd8-0184441fa23f | 2015-11-24 08:05:32 | test-vm-1 | 13 |

| 9fa056d2-ba28-468c-9ff1-4e67e9f7e4e9 | 2015-11-24 08:05:39 | test-vm-2 | 14 |

| 46392d9a-9416-49a5-966e-50011d3dd5d1 | 2015-11-24 17:19:20 | test-vm-1 | 15 |

| 74e1d4bb-2193-4dcc-9d01-cd473104376c | 2015-11-24 17:19:23 | test-vm-2 | 16 |

| 2a16ff12-3e11-4343-b101-baf1a6351136 | 2015-11-24 17:35:41 | test-vm-3 | 17 |

| fc1839bc-324d-4cef-91c6-007fc7cfa152 | 2015-11-24 18:11:23 | test-vm-1 | 18 |

| 9323f787-9373-4d69-bb66-c706acfd5d7d | 2015-11-24 18:12:11 | test-vm-2 | 19 |

| 2b624361-5b4f-4e13-baa6-6fbf0f8c7512 | 2015-11-24 18:12:39 | test-vm-3 | 20 |

| 374817b0-3e95-4348-8258-038ac94ebcf7 | 2015-11-25 03:50:39 | test-vm-1 | 21 |

| ab8449bf-1a70-416e-ac86-240610c43571 | 2015-11-25 03:50:50 | test-vm-2 | 22 |

| dc1e3695-db8a-449c-833f-7dc21af09529 | 2015-11-25 04:09:49 | test-vm-1 | 0 |

既削除ンン

情報確認

(40)

Cinder

40

(41)

Cinder _{プセとサービ}

 起動い cinder 確認

 nova 比コンソー機能等少い数少い

 既 2 ー ¹ 作成い

o _ー ₁ _作成 _い

[root@openstack-single ~ keystone_admin ]# ^ps -e |grep cinder

0 ? 00:0 : cinder-api

0 ? 00:0 : cinder-volume 0 ? 00:00: cinder-schedule

? 00:00:0 cinder-api ? 00:00:0 cinder-api 0 ? 00:00:0 cinder-api ? 00:00: cinder-api ? 00:00: cinder-volume

[root@openstack-single ~ keystone_admin ]# ^systemctl |grep cinder

openstack-cinder-api.service loaded active running OpenStack Cinder API Server openstack-cinder-scheduler.service loaded active running OpenStack Cinder Scheduler Server openstack-cinder-volume.service loaded active running OpenStack Cinder Volume Server openstack-losetup.service loaded active exited Setup cinder-volume loop device

[root@openstack-single ~ keystone_admin ]# cinder list

+---+---+---+---+---+---+---+

[root@openstack-single ~ keystone_admin ]# cinder snapshot-list

(42)

LVM _{状態の確認}

 今回 cinder LVM(iSCSI) 構成い

 ^LVM 状態確認

o _論理 _ー _作成 _い _確認

42 [root@openstack-single ~ keystone_admin ]# ^pvs

PV VG Fmt Attr PSize PFree

/dev/loop0 cinder-volumes lvm2 a-- 30.90g 920.00m

[root@openstack-single ~ keystone_admin ]# vgs

VG #PV #LV #SN Attr VSize VFree

cinder-volumes wz--n- 30.90g 920.00m

[root@openstack-single ~ keystone_admin ]# lvs

LV VG Attr LSize Pool Origin Data% _snapshot-bf96668c-3a8e-4e86-86fd-29fbf22076c1 cinder-volumes swi-a-s--- 10.00g volume-c871554c-ad7e-4917-8945-c2e1725fa577 0.26 volume-b6a1872e-c626-4747-b95f-246d7ff1dd15 cinder-volumes -wi-a--- 10.00g

volume-c871554c-ad7e-4917-8945-c2e1725fa577 cinder-volumes owi-aos--- 10.00g

packstack _設定 _指定

領域作成い

例ー

作成ー

確認

ATTR _部分 _{読取事} ATTR _関

次項参照い

(43)

補足：LVM Attributes (man lvsよ )

# Attributes Descriptions

1 Volume type (C)ache, (m)irrored, (M)irrored without initial sync, (o)rigin, (O)rigin with merging snapshot, (r)aid, (R)aid without initial sync, (s)napshot, merging (S)napshot, (p)vmove,(v)irtual, mirror or raid (i)mage, mirror or raid (I)mage out-of-sync, mirror (l)og device, under (c)onversion, thin (V)olume, (t)hin pool, (T)hin pool data, raid or pool m(e)tadata or pool metadata spare.

2 Permissions (w)riteable, (r)ead-only, (R)ead-only activation of non-read-only volume

3 Allocation policy (a)nywhere, (c)ontiguous, (i)nherited, c(l)ing, (n)ormal This is capitalised if the volume is currently locked against allocation changes, for example during pvmove(8).

4 fixed (m)inor

5 State (a)ctive, (s)uspended, (I)nvalid snapshot, invalid (S)uspended snapshot, snapshot (m)erge failed, suspended snapshot (M)erge failed, mapped (d)evice present without tables, mapped device present with (i)nactive table, (X) unknown

6 device (o)pen, (X) unknown

7 Target type (C)ache, (m)irror, (r)aid, (s)napshot, (t)hin, (u)nknown, (v)irtual. This groups logical volumes related to the same kernel target together. So, for example, mirror images, mirror logs as well as mirrors themselves appear as (m) if they use the original device-mapper mirror kernel driver; whereas the raid equivalents using the md raid kernel driver all appear as (r). Snapshots using the original device-mapper driver appear as (s); whereas snapshots of thin volumes using the new thin provisioning driver appear as (t).

8 Newly-allocated data blocks are overwritten with blocks of (z)eroes before use.

-

9 Volume Health (p)artial, (r)efresh needed, (m)ismatches exist, (w)ritemostly, (X) unknown. (p)artial signifies that one or more of the Physical Volumes this Logical Volume uses is missing from the system. (r)efresh signifies that one or more of the Physical Volumes this RAID Logical Volume uses had suffered a write error. The write error could be due to a temporary failure of that Physical Volume or an indication that it is failing. The device should be refreshed or replaced. (m)ismatches signifies that the RAID logical volume has portions of the array that are not coherent. Inconsistencies are detected by initiating a "check" on a RAID logical volume. (The scrubbing operations, "check" and "repair", can be performed on a RAID logical volume via the

'lvchange' command.) (w)ritemostly signifies the devices in a RAID 1 logical volume that have been marked write-mostly.

(44)

補足：LVM & Device Mapper

 Linux LVM Device Mapper(DM) 実現い

 DM 複数別見仕組

Linux _{重要機能}

 ン追う間確認可能

44 [root@openstack-single ~ keystone_admin ]# dmsetup table

cinder --volumes-volume--b6a1872e--c626--4747--b95f--246d7ff1dd15: 0 20971520 linear :0 0

cinder --volumes-_snapshot--bf96668c--3a8e--4e86--86fd--29fbf22076c1-cow: 0 20971520 linear :0 0

cinder --volumes-_snapshot--bf96668c--3a8e--4e86--86fd--29fbf22076c1: 0 20971520 snapshot : : P

cinder --volumes-volume--c871554c--ad7e--4917--8945--c2e1725fa577-real: 0 20971520 linear :0 0

cinder--volumes-volume--c871554c--ad7e--4917--8945--c2e1725fa577: 0 20971520 snapshot-origin :

[root@openstack-single ~ keystone_admin ]# ^{dmsetup ls}

cinder --volumes-volume--b6a1872e--c626--4747--b95f--246d7ff1dd15 (252:4)

cinder--volumes-_snapshot--bf96668c--3a8e--4e86--86fd--29fbf22076c1-cow (252:2)

cinder --volumes-_snapshot--bf96668c--3a8e--4e86--86fd--29fbf22076c1 (252:3)

cinder--volumes-volume--c871554c--ad7e--4917--8945--c2e1725fa577-real (252:1)

cinder --volumes-volume--c871554c--ad7e--4917--8945--c2e1725fa577 (252:0)

[root@openstack-single ~ keystone_admin ]# ^{dmsetup ls} --tree

cinder--volumes-volume--b6a1872e--c626--4747--b95f--246d7ff1dd15 (252:4)

└─ :0

cinder--volumes-_snapshot--bf96668c--3a8e--4e86--86fd--29fbf22076c1 (252:3)

├─cinder--volumes-_snapshot--bf96668c--3a8e--4e86--86fd--29fbf22076c1-cow (252:2)

│ └─ :0

└─cinder--volumes-volume--c871554c--ad7e--4917--8945--c2e1725fa577-real (252:1)

└─ :0

cinder --volumes-volume--c871554c--ad7e--4917--8945--c2e1725fa577 (252:0)

└─cinder--volumes-volume--c871554c--ad7e--4917--8945--c2e1725fa577-real (252:1)

└─ :0

(45)

cinder _{ューとLVMの対応}

 cinder 生成ーや付与 ^UUID ^LVM

側命名反映

 cinder 作成ー実体対応 ^LVM ー

[root@openstack-single ~(keystone_admin)]# cinder list

+---+---+---+---+---+---+---+

[root@openstack-single ~(keystone_admin)]# cinder snapshot-list

+---+---+---+---+---+

[root@openstack-single ~(keystone_admin)]# lvs

LV VG Attr LSize Pool Origin Data% _snapshot-bf96668c-3a8e-4e86-86fd-29fbf22076c1 cinder-volumes swi-a-s--- 10.00g volume-c871554c-ad7e-4917-8945-c2e1725fa577 0.26 volume-b6a1872e-c626-4747-b95f-246d7ff1dd15 cinder-volumes -wi-a--- 10.00g

volume-c871554c-ad7e-4917-8945-c2e1725fa577 cinder-volumes owi-aos--- 10.00g

cinder UUIDni _対応 _論理 _ー

作成い

(46)

cinder ューとンタンの接続

 nova 項目確認い ^cinder ー ^nova ンン接続

iSCSI _行わ _い

o LVM & iSCSI _使 _{場合接続方式}

 接続う実現い確認

46 [root@openstack-single ~(keystone_admin)]# targetcli ls

o- / ... [...] o- backstores ... [...]

| o- block ... [Storage Objects: 1]

| | o- iqn.2010-10.org.openstack:volume-c871554c-ad7e-4917-8945-c2e1725fa577 [/dev/cinder-volumes/volume-c871554c-ad7e-4917-8945-c2e1725fa577 (10.0GiB) write-thru activated]

| o- fileio ... [Storage Objects: 0]

| o- pscsi ... [Storage Objects: 0]

| o- ramdisk ... [Storage Objects: 0] o- iscsi ... [Targets: 1]

| o- iqn.2010-10.org.openstack:volume-c871554c-ad7e-4917-8945-c2e1725fa577 ... [TPGs: 1]

| o- tpg1 ... [no-gen-acls, auth per-acl]

| o- acls ... [ACLs: 1]

| | o- iqn.1994-05.com.redhat:2bf21e3cca8c ... [1-way auth, Mapped LUNs: 1]

| | o- mapped_lun0 ... [lun0 block/iqn.2010-10.org.openstack:volume-c871554c-ad7e-4917-8945-c2e1725fa577 (rw)]

| o- luns ... [LUNs: 1]

| | o- lun0 [block/iqn.2010-10.org.openstack:volume-c871554c-ad7e-4917-8945-c2e1725fa577 (/dev/cinder-volumes/volume-c871554c-ad7e-4917-8945-c2e1725fa577)]

| o- portals ... [Portals: 1]

| o- 192.168.199.100:3260 ... [OK] o- loopback ... [Targets: 0]

[root@openstack-single ~(keystone_admin)]# iscsiadm --mode node

192.168.199.100:3260,-1 iqn.2010-10.org.openstack:volume-c871554c-ad7e-4917-8945-c2e1725fa577

現在 1 ー接続い状

態公開いー ¹

(47)

cinder ューとンタンの接続

 未接続ーンン接続状態変化確認

o _ー _接続 _iSCSI _{状態変化} _い

[root@openstack-single ~(keystone_admin)]# cinder list

+---+---+---+---+---+---+---+

[root@openstack-single ~(keystone_admin)]# nova volume-attach test-vm-1 b6a1872e-c626-4747-b95f-246d7ff1dd15

[root@openstack-single ~(keystone_admin)]# targetcli ls

o- / ... [...] o- backstores ... [...]

| o- block ... [Storage Objects: 2]

| | o- iqn.2010-10.org.openstack:volume-b6a1872e-c626-4747-b95f-246d7ff1dd15 [/dev/cinder-volumes/volume-b6a1872e-c626-4747-b95f-246d7ff1dd15 (10.0GiB) write-thru activated]

| | o- iqn.2010-10.org.openstack:volume-c871554c-ad7e-4917-8945-c2e1725fa577 [/dev/cinder-volumes/volume-c871554c-ad7e-4917-8945-c2e1725fa577 (10.0GiB) write-thru activated]

| o- fileio ... [Storage Objects: 0]

| o- pscsi ... [Storage Objects: 0]

| o- ramdisk ... [Storage Objects: 0] o- iscsi ... [Targets: 2]

| o- iqn.2010-10.org.openstack:volume-b6a1872e-c626-4747-b95f-246d7ff1dd15 ... [TPGs: 1]

| | o- tpg1 ... [no-gen-acls, auth per-acl]

| | o- acls ... [ACLs: 1]

| | | o- iqn.1994-05.com.redhat:2bf21e3cca8c ... [1-way auth, Mapped LUNs: 1]

| | | o- mapped_lun0 ... [lun0 block/iqn.2010-10.org.openstack:volume-b6a1872e-c626-4747-b95f-246d7ff1dd15 (rw)]

| | o- luns ... [LUNs: 1]

| | | o- lun0 [block/iqn.2010-10.org.openstack:volume-b6a1872e-c626-4747-b95f-246d7ff1dd15 (/dev/cinder-volumes/volume-b6a1872e-c626-4747-b95f-246d7ff1dd15)]

| | o- portals ... [Portals: 1]

| | o- 192.168.199.100:3260 ... [OK]

| o- iqn.2010-10.org.openstack:volume-c871554c-ad7e-4917-8945-c2e1725fa577 ... [TPGs: 1]

| o- tpg1 ... [no-gen-acls, auth per-acl]

| o- acls ... [ACLs: 1]

| | o- iqn.1994-05.com.redhat:2bf21e3cca8c ... [1-way auth, Mapped LUNs: 1]

| | o- mapped_lun0 ... [lun0 block/iqn.2010-10.org.openstack:volume-c871554c-ad7e-4917-8945-c2e1725fa577 (rw)]

| o- luns ... [LUNs: 1]

| | o- lun0 [block/iqn.2010-10.org.openstack:volume-c871554c-ad7e-4917-8945-c2e1725fa577 (/dev/cinder-volumes/volume-c871554c-ad7e-4917-8945-c2e1725fa577)]

| o- portals ... [Portals: 1]

| o- 192.168.199.100:3260 ... [OK] o- loopback ... [Targets: 0]

[root@openstack-single ~(keystone_admin)]# iscsiadm --mode node

test-vm-1

copy-snap-vol

接続

新い設定追加

確認

(48)

Neutron

48

(49)

Neutron _{プセとサービ}

 起動い Neutron 確認

o _{非常多数} _起動 _い _確認

[root@openstack-single ~(keystone_admin)]# ps -e | grep neutron

1045 ? 00:00:18 neutron-metadat

1057 ? 00:00:21 neutron-lbaas-a

1066 ? 00:00:36 neutron-meterin

1118 ? 00:01:14 neutron-server

2756 ? 00:00:38 neutron-l3-agen

2758 ? 00:00:37 neutron-dhcp-ag

2774 ? 00:02:39 neutron-openvsw

2887 ? 00:00:03 neutron-metadat

2888 ? 00:00:03 neutron-metadat

3288 ? 00:00:18 neutron-rootwra

3495 ? 00:00:00 neutron-rootwra

4013 ? 00:00:39 neutron-server

4014 ? 00:00:18 neutron-server

4015 ? 00:01:26 neutron-server

4016 ? 00:01:19 neutron-server

4017 ? 00:00:25 neutron-server

15792 ? 00:00:00 neutron-rootwra

15885 ? 00:00:00 neutron-ns-meta

16046 ? 00:00:00 neutron-rootwra

[root@openstack-single ~(keystone_admin)]# systemctl | grep neutron

neutron-dhcp-agent.service loaded active running OpenStack Neutron DHCP Agent

neutron-l3-agent.service loaded active running OpenStack Neutron Layer 3 Agent

neutron-lbaas-agent.service loaded active running OpenStack Neutron Load Balancing as a Service Agent

neutron-metadata-agent.service loaded active running OpenStack Neutron Metadata Agent

(50)

Neutron が構成すネッワーの構成図

 Neutron 構成ワー複雑状態把握困難

 いー使現状ワー状態可視化

 plotnetcfg, graphviz _利用

50 [root@handson9-openstack-single ~(keystone_admin)]# plotnetcfg > netmap.dot

[root@handson9-openstack-single ~(keystone_admin)]# dot -Tpng netmap.dot > netmap.png

[root@handson9-openstack-single ~(keystone_admin)]# cp netmap.png /var/www/html/

Note 以降図見進い

現在設定いワー情報

収集

収集情報図変換

生成画像

httpd _{配下コー}

自分端末

http://xxx.xxx.xxx.xxx/netmap.png

い

xxx _部分 openstack-single _{割当} い Floating IP

(51)

Neutron が構成すネッワーの構成図

 演習解説上標準描画扱いい見や編集以下図利用

(52)

 仮想ワー実体 Linux ワー機能組合構成

o _Linux _各種 _{ワー操作コン} _利用状況確認や設定変更行

う事可能

o _{以下コン} _実行 _{情報確認} _{ワー図見比} _い

 時ワー図存在全ンーー確認

o _ワー _ー _ー _隔離 _い _あ

52 [root@openstack-single ~]# ip link

[root@openstack-single ~]# ip addr

[root@openstack-single ~]# brctl show

[root@openstack-single ~]# ovs-vsctl show

Linux _認識 _い _{ンー}

ー一覧表示

Linux _構成

一覧表示

Linux _構成 OVS _{構成表}

示

(53)

隔離さたンターフー

 OVS Linux側ンー差異確認

 差異 Network Namespace機能 ^OS 上ワー環境隔離

い事原因発生い

[root@openstack-single ~]# ovs-vsctl show | grep qr-

Port "qr-e471c6b6-4f"

Interface "qr-e471c6b6-4f"

[root@openstack-single ~]# ip addr | grep qr-

OVS _{上構成} _い

Linux _側 _認識 _{いい}

(54)

Network Namespace _内の確認

 隔離ワー環境確認

o _演習環境 ₅ _Namespace _存在 _確認

54

[root@openstack-single ~]# ip netns | sort qdhcp-0386bd97-1f81-490b-883f-2412502ec979 qdhcp-3ecdf516-e588-439d-9185-55b1b1eb7c8c qdhcp-6699b802-2038-432a-a453-60f7e9bf29ad qrouter-80e309a5-7ae1-4cdb-b4ec-a9f3a9234b24 qrouter-8d7b1023-0c4c-4546-9f38-3bdcc0432aad

[root@openstack-single ~]# ip netns exec qrouter-80e309a5-7ae1-4cdb-b4ec-a9f3a9234b24 ip addr |grep qr- 12: qr-e471c6b6-4f: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN

inet 10.20.20.254/24 brd 10.20.20.255 scope global qr-e471c6b6-4f

[root@openstack-single ~]# ovs-vsctl show |grep qr- Port "qr-e471c6b6-4f"

Interface "qr-e471c6b6-4f"

No09 Handson OpenStack Internal

基盤構築演習

Cloud Infrastructure Design and Deployment

9. 内部構造の探索演習

2017.v1

Table of contents

 本演習 All-in-One 構築 OpenStack 環境上 複数 仮想 ソー

配置 仮想 ソー う技術 実現 い 確認

 ン 環境 構築

 Nova

 Cinder

 Neutron

 ン演習

2

演習環境について

演習環境の概要

 演習用 OpenStack環境上 各自割 当 ン 内 演習 行い

o 各環境 生徒 独立 い

 最初 演習 実施 前 共通演習環境 構築 実施 必要 あ

 前回 演習環境 残 い 場合 演習環境 削除方法 実施 い

4

openstack

tenant-XX / student-XX tenant-YY / student-YY ・・・

物理 ー ー ワー 装置 ー

資源層

抽象化層

ン

( )

共通演習環境

演習環境 演習環境

共通演習環境 構築 実施

構築： 第N回 演習環境 構築 作成

削除： 演習環境 削除方法 実施

各自 端末 操作 行う

演習環境の削除方法

各演習回の前に 前回の環境を削除す ために実施

演習環境を削除

 前回 演習環境 残 い 場合 環境 削除

6

[centos@console ~]$ nova delete openstack-single

Request to delete server openstack-single has been accepted.

[centos@console ~]$ nova list --field name

[centos@console ~]$ PORTID1=`neutron port-list --fixed-ips ip_address=192.168.199.100 -c id -f csv --quote none | grep -v id`

[centos@console ~]$ PORTID2=`neutron port-list --fixed-ips ip_address=172.16.100.100 -c id -f csv --quote none | grep -v id`

[centos@console ~]$ neutron port-delete $PORTID1 && neutron port-delete $PORTID2

Deleted port: 6b5dcb28-899a-43fc-950f-35ae26d3a99b

Deleted port: 023dc50d-cd1c-489f-b7f0-ad65c3eb8880

[centos@console ~]$ neutron router-interface-delete Ext-Router floating-subnet

Removed interface from router Ext-Router.

[centos@console ~]$ neutron net-delete floating-net

Deleted network: floating-net

[centos@console ~]$ neutron net-list

[centos@console ~]$ nova keypair-delete key-for-console

[centos@console ~]$ nova keypair-delete my-key

[centos@console ~]$ nova keypair-list

[centos@console ~]$ exit

仮想 ー ー 削除

console 削除 コ ン

ン 使え 削除

論理 ー 削除

仮想 ー ー 仮想

ワー 接続 解除

キー 削除

環境 演習共通 利用

削除

演習環境を削除

 残 演習用 ー ー 関連 ソー 削除

ン ン 削除

Floating IP 削除

キ ー 削除

演習環境を構築す 前の状態

 各演習環境 構築 前 以下 状態 い 事 確認 い

o default 以外 存在 い い

 default 共通演習環境 作成

o キ ー 以外 ソー 存在 い い

 以下 3 画面 確認 い

o 何 ソー や 残 い 場合 次項 手順 削除 い

8

default

存在 い

9. _{内部構造の探索演習}

 本演習 ^All-in-One 構築 ^OpenStack 環境上複数仮想ソー

配置仮想ソーう技術実現い確認

 ン環境構築

 演習用 OpenStack環境上各自割当ン内演習行い

o _{各環境生徒} _独立 _い

 最初演習実施前共通演習環境構築実施必要あ

 前回演習環境残い場合演習環境削除方法実施い

tenant-XX / student-XX tenant-YY / student-YY _・・・

物理ーーワー装置ー

演習環境 _演習環境

共通演習環境構築実施

構築：第N回演習環境構築作成

削除：演習環境削除方法実施

各自端末操作行う

各演習回の前に前回の環境を削除すために実施

 前回演習環境残い場合環境削除

仮想ーー削除

console _削除 _{コン}

ン使え削除

論理ー削除

仮想ーー仮想

ワー接続解除

キー削除

環境演習共通利用

 残演習用ーー関連ソー削除

ンン削除

Floating IP _削除

キー削除

演習環境を構築す前の状態

 各演習環境構築前以下状態い事確認い

o _default _以外 _存在 _{いい}

 ^default 共通演習環境作成

o _キ _{ー以外} _ソー _存在 _{いい}

 以下 3 画面確認い

o _何 _{ソーや} _残 _{い場合} _{次項手順削除} _い

存在い

Security Groups _以

外消費いい

3 _存在

Stacks _の確認

 以下確認

o Orchestration _{→ Stacks} default _{以外存在} _{いい}

 ^default 以外存在い場合対象削除

o _削除 _default _以外 _選択 Delete Stacks _押下

存在い

例 ^hands-on-3 選

ソー消費量の確認

 以下確認

o _Compute _{→ Overview} Limit Summary Security Groups _{以外消費}

0 _状態 _い

 ソー残い場合前項手順 ^Stacks 確認不要

削除い

 ソー残い場合次項手順個別ソー削除

Security Groups _{以外消費}

いい ⁰ 状態確認

個別のソー削除

 ー一覧表示残いソー削除

o _{以下削除例}

ンン削除

Floating IP _削除

キー削除

ネッワーの状態

 以下確認

o _Network → Network Topology [public] - [Ext-Router] - [work-net] _状態

 余分ソー作成い場合個別削除

3 _存在

第9回演習環境の構築

タッの起動

 左ー Orchestration _{→ Stacks} _選択

 後 Launch Stack _押下

ンプーの指定

 Template Source URL _指定

 Template URL http://<<repo_ip>>/hands-on/09_handson.yaml _指定

o <<repo_ip>> _{部分講師} _{値指定あ}

 値設定 ^Next 押下

URL _選択

 ^{Stack Name} ^hands-on-9 入力

 ^Password 自分 OpenStack ワー入力

 hands-on repository server _{ーー IP} _入力