一、簡介
什么是openstack?它是干嘛用的？
簡單說openstack是云計算管理平臺，主要對云環(huán)境中的虛擬機做增刪查改；它能夠?qū)⒍嗯_物理設(shè)備的資源（cpu/內(nèi)存等）整合成一個大的資源池，然后根據(jù)openstack提供的api接口向用戶提供使用；用戶可以根據(jù)openstack提供的資源池接口來啟動虛擬機，管理虛擬機；openstack 主要組成由控制節(jié)點和計算節(jié)點組成；其中控制節(jié)點由多個組件組成，每個組件都是以api的形式向外提供服務，這多個組件共同組成了控制節(jié)點，所以控制節(jié)點上運行了很多服務；計算節(jié)點通常是指提供物理硬件，用于啟動虛擬機的物理設(shè)備；
二、架構(gòu)
提示：openstack主要把底層的多臺server的資源分為了三類，計算，網(wǎng)絡和存儲；用戶可以通過openstack提供的web界面直接在openstack上啟動虛擬機實例；
三、openstack基礎(chǔ)環(huán)境準備
本次實驗是以openstack R版為例，其中各服務器角色如下
主機名角色ip地址
node01控制節(jié)點192.168.0.41/24
node02數(shù)據(jù)庫服務器192.168.0.42/24
node03計算節(jié)點192.168.0.43/24
1、各server上的基礎(chǔ)環(huán)境配置
1）時間同步
[root@node01 ~]# grep server /etc/chrony.conf# Use public servers from the pool.ntp.org project.server time.test.org iburst# Serve time even if not synchronized to any NTP server.[root@node01 ~]# scp /etc/chrony.conf node02:/etc/chrony.conf 100% 1141 992.7KB/s 00:00 [root@node01 ~]# scp /etc/chrony.conf node03:/etc/chrony.conf 100% 1141 663.6KB/s 00:00 [root@node01 ~]# chronyc sources 210 Number of sources = 1MS Name/IP address Stratum Poll Reach LastRx Last sample ===============================================================================^* time.test.org 3 6 377 40 -15us[ -86us] +/- 20ms[root@node01 ~]# ssh node02 'chronyc sources'210 Number of sources = 1MS Name/IP address Stratum Poll Reach LastRx Last sample ===============================================================================^* time.test.org 3 6 377 49 -6552ns[ -15us] +/- 20ms[root@node01 ~]# ssh node03 'chronyc sources' 210 Number of sources = 1MS Name/IP address Stratum Poll Reach LastRx Last sample ===============================================================================^* time.test.org 3 6 377 52 -30us[ -103us] +/- 20ms[root@node01 ~]#
2）主機名解析
[root@node01 ~]# cat /etc/hosts127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4::1 localhost localhost.localdomain localhost6 localhost6.localdomain6192.168.0.99 time.test.org time-node192.168.0.41 node01.test.org node01 controller 192.168.0.42 node02.test.org node02192.168.0.43 node03.test.org node03192.168.0.44 node04.test.org node04192.168.0.45 node05.test.org node05192.168.0.46 node06.test.org node06[root@node01 ~]# scp /etc/hosts node02:/etc/hosts 100% 423 29.5KB/s 00:00 [root@node01 ~]# scp /etc/hosts node03:/etc/hosts 100% 423 46.5KB/s 00:00 [root@node01 ~]#
3）關(guān)閉selinux、iptables和NetworkManager
[root@node01 ~]# sed -i 's@SELINUX=enforcing@SELINUX=disabled@g' /etc/selinux/config [root@node01 ~]# setenforce 0[root@node01 ~]# getenforce Permissive[root@node01 ~]# ssh node02 'sed -i 's@SELINUX=enforcing@SELINUX=disabled@g' /etc/selinux/config'[root@node01 ~]# ssh node02 'setenforce 0 && getenforce'Permissive[root@node01 ~]# ssh node03 'sed -i 's@SELINUX=enforcing@SELINUX=disabled@g' /etc/selinux/config' [root@node01 ~]# ssh node03 'setenforce 0 && getenforce' Permissive[root@node01 ~]# systemctl stop firewalld NetworkManager[root@node01 ~]# systemctl disable firewalld NetworkManager Removed symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service.Removed symlink /etc/systemd/system/dbus-org.freedesktop.NetworkManager.service.Removed symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service.[root@node01 ~]# ssh node02 'systemctl stop firewalld NetworkManager && systemctl disable firewalld NetworkManager'Removed symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service.Removed symlink /etc/systemd/system/dbus-org.freedesktop.NetworkManager.service.Removed symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service.[root@node01 ~]# ssh node03 'systemctl stop firewalld NetworkManager && systemctl disable firewalld NetworkManager' Removed symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service.Removed symlink /etc/systemd/system/dbus-org.freedesktop.NetworkManager.service.Removed symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service.[root@node01 ~]#
提示：如果你的系統(tǒng)是最小化安裝，這里還需要安裝一些基礎(chǔ)的包；yum install -y vim wget tree lrzsz gcc gcc-c++ automake pcre pcre-devel zlib zlib-devel openssl openssl-devel iproute net-tools iotop lsof ntpdate telnet bridge-utils；
4）各服務器配置阿里云的base倉庫和epel倉庫包
[root@node01 ~]# rm -rf /etc/yum.repos.d/*.repo[root@node01 ~]# wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo--2020-10-27 22:43:42-- http://mirrors.aliyun.com/repo/Centos-7.repoResolving mirrors.aliyun.com (mirrors.aliyun.com)... 118.116.3.238, 118.123.164.244, 118.123.164.119, ...Connecting to mirrors.aliyun.com (mirrors.aliyun.com)|118.116.3.238|:80... connected.HTTP request sent, awaiting response... 200 OKLength: 2523 (2.5K) [application/octet-stream]Saving to: '/etc/yum.repos.d/CentOS-Base.repo’100%[====================================================================================>] 2,523 --.-K/s in 0s 2020-10-27 22:43:42 (180 MB/s) - '/etc/yum.repos.d/CentOS-Base.repo’ saved [2523/2523][root@node01 ~]# wget -O /etc/yum.repos.d/epel.repo http://mirrors.aliyun.com/repo/epel-7.repo--2020-10-27 22:43:51-- http://mirrors.aliyun.com/repo/epel-7.repoResolving mirrors.aliyun.com (mirrors.aliyun.com)... 118.116.3.248, 118.123.164.120, 125.64.102.239, ...Connecting to mirrors.aliyun.com (mirrors.aliyun.com)|118.116.3.248|:80... connected.HTTP request sent, awaiting response... 200 OKLength: 664 [application/octet-stream]Saving to: '/etc/yum.repos.d/epel.repo’100%[====================================================================================>] 664 --.-K/s in 0s 2020-10-27 22:43:51 (95.0 MB/s) - '/etc/yum.repos.d/epel.repo’ saved [664/664][root@node01 ~]# ll /etc/yum.repos.d/total 8drwxr-xr-x. 2 root root 219 Oct 27 22:42 bak-rw-r--r--. 1 root root 2523 Jun 16 2018 CentOS-Base.repo-rw-r--r--. 1 root root 664 May 11 2018 epel.repo[root@node01 ~]#
提示：在node02和node03上都要做以上操作；
2、在各節(jié)點上配置openstack R版的yum倉庫
[root@node01 ~]# yum install centos-release-openstack-rocky -y
提示：以上操作會在/etc/yum.repos.d/目錄下生成很多repo文件；
驗證：查看/etcyum.repos.d/目錄下是否多了很多repo文件？
[root@node01 ~]# ll /etc/yum.repos.d/total 56drwxr-xr-x. 2 root root 219 Oct 27 22:42 bak-rw-r--r--. 1 root root 2523 Jun 16 2018 CentOS-Base.repo-rw-r--r--. 1 root root 850 Jul 31 2018 CentOS-Ceph-Luminous.repo-rw-r--r--. 1 root root 1309 Apr 8 2020 CentOS-CR.repo-rw-r--r--. 1 root root 649 Apr 8 2020 CentOS-Debuginfo.repo-rw-r--r--. 1 root root 314 Apr 8 2020 CentOS-fasttrack.repo-rw-r--r--. 1 root root 630 Apr 8 2020 CentOS-Media.repo-rw-r--r--. 1 root root 1186 Aug 29 2018 CentOS-OpenStack-rocky.repo-rw-r--r--. 1 root root 612 Feb 1 2019 CentOS-QEMU-EV.repo-rw-r--r--. 1 root root 1331 Apr 8 2020 CentOS-Sources.repo-rw-r--r--. 1 root root 353 Jul 31 2018 CentOS-Storage-common.repo-rw-r--r--. 1 root root 7577 Apr 8 2020 CentOS-Vault.repo-rw-r--r--. 1 root root 616 Apr 8 2020 CentOS-x86_64-kernel.repo-rw-r--r--. 1 root root 664 May 11 2018 epel.repo[root@node01 ~]#
提示：這里面的repo文件倉庫地址都是指向centos的官方倉庫，如果國內(nèi)下載速度慢，可以把對應的地址指向阿里云；
把centos-openstack-rocky.repo地址指向阿里云
提示：這里只需要改第一個就行，后面的倉庫都是禁用了的，不用更改；
把node01上的centos-openstack-rocky.repo文件復制給node02和node03
[root@node01 ~]# scp /etc/yum.repos.d/CentOS-OpenStack-rocky.repo node02:/etc/yum.repos.d/CentOS-OpenStack-rocky.repoCentOS-OpenStack-rocky.repo 100% 1261 832.6KB/s 00:00 [root@node01 ~]# scp /etc/yum.repos.d/CentOS-OpenStack-rocky.repo node03:/etc/yum.repos.d/CentOS-OpenStack-rocky.repoCentOS-OpenStack-rocky.repo 100% 1261 387.4KB/s 00:00 [root@node01 ~]#
提示：復制要在后兩個節(jié)點都裝了centos-release-openstack-rocky這個包以后，以免后續(xù)裝包覆蓋倉庫地址文件；
3、在各節(jié)點安裝python-openstackclient和openstack-selinux包
[root@node01 ~]# yum install -y python-openstackclient openstack-selinux
4、在node02上部署mariadb-server
先查看mariadb-server這個包是否來自openstack-rocky這個倉庫
提示：如果能夠看到mariadb-server這個包來自centos-openstack-rocky這個倉庫，說明我們配置的倉庫沒有問題；這里建議盡量使用openstacke-rocky倉庫中提供的包，如果其他倉庫提供的包可能存在不兼容的問題；
下載安裝mairadb-server
[root@node02 ~]# yum install mariadb-server -yLoaded plugins: fastestmirrorLoading mirror speeds from cached hostfile * base: mirrors.aliyun.com * centos-qemu-ev: mirrors.aliyun.com * extras: mirrors.aliyun.com * updates: mirrors.aliyun.comResolving Dependencies--> Running transaction check---> Package mariadb-server.x86_64 3:10.1.20-2.el7 will be installed--> Processing Dependency: mariadb-common(x86-64) = 3:10.1.20-2.el7 for package: 3:mariadb-server-10.1.20-2.el7.x86_64--> Processing Dependency: mariadb-errmsg(x86-64) = 3:10.1.20-2.el7 for package: 3:mariadb-server-10.1.20-2.el7.x86_64--> Processing Dependency: mysql(x86-64) for package: 3:mariadb-server-10.1.20-2.el7.x86_64--> Processing Dependency: mysql-compat-client(x86-64) for package: 3:mariadb-server-10.1.20-2.el7.x86_64--> Processing Dependency: perl(DBD::mysql) for package: 3:mariadb-server-10.1.20-2.el7.x86_64--> Processing Dependency: perl(DBI) for package: 3:mariadb-server-10.1.20-2.el7.x86_64--> Processing Dependency: perl(Data::Dumper) for package: 3:mariadb-server-10.1.20-2.el7.x86_64--> Processing Dependency: rsync for package: 3:mariadb-server-10.1.20-2.el7.x86_64--> Processing Dependency: socat for package: 3:mariadb-server-10.1.20-2.el7.x86_64--> Running transaction check---> Package mariadb.x86_64 3:10.1.20-2.el7 will be installed--> Processing Dependency: mariadb-libs(x86-64) = 3:10.1.20-2.el7 for package: 3:mariadb-10.1.20-2.el7.x86_64……省略部分內(nèi)容……Installed: mariadb-server.x86_64 3:10.1.20-2.el7 Dependency Installed: mariadb.x86_64 3:10.1.20-2.el7 mariadb-common.x86_64 3:10.1.20-2.el7 mariadb-config.x86_64 3:10.1.20-2.el7 mariadb-errmsg.x86_64 3:10.1.20-2.el7 perl-Compress-Raw-Bzip2.x86_64 0:2.061-3.el7 perl-Compress-Raw-Zlib.x86_64 1:2.061-4.el7 perl-DBD-MySQL.x86_64 0:4.023-6.el7 perl-DBI.x86_64 0:1.627-4.el7 perl-Data-Dumper.x86_64 0:2.145-3.el7 perl-IO-Compress.noarch 0:2.061-2.el7 perl-Net-Daemon.noarch 0:0.48-5.el7 perl-PlRPC.noarch 0:0.2020-14.el7 rsync.x86_64 0:3.1.2-10.el7 socat.x86_64 0:1.7.3.2-2.el7 Dependency Updated: mariadb-libs.x86_64 3:10.1.20-2.el7 Complete![root@node02 ~]#
配置數(shù)據(jù)庫
[root@node02 ~]# cat /etc/my.cnf.d/openstack.cnf [mysqld]bind-address = 0.0.0.0default-storage-engine = innodbinnodb_file_per_table = onmax_connections = 4096collation-server = utf8_general_cicharacter-set-server = utf8[root@node02 ~]#
設(shè)置mariadb-server開機啟動，并啟動mairadb-server
[root@node02 ~]# systemctl enable mariadb.service Created symlink from /etc/systemd/system/multi-user.target.wants/mariadb.service to /usr/lib/systemd/system/mariadb.service.[root@node02 ~]# systemctl start mariadb.service [root@node02 ~]# ss -tnlState Recv-Q Send-Q Local Address:Port Peer Address:Port LISTEN 0 128 *:22 *:* LISTEN 0 100 127.0.0.1:25 *:* LISTEN 0 128 *:3306 *:* LISTEN 0 128 :::22 :::* LISTEN 0 100 ::1:25 :::* [root@node02 ~]#
5、在node01上安裝python2-PyMySQL包，用于控制節(jié)點連接數(shù)據(jù)庫驅(qū)動
[root@node01 ~]# yum install -y python2-PyMySQLLoaded plugins: fastestmirrorLoading mirror speeds from cached hostfile * base: mirrors.aliyun.com * centos-qemu-ev: mirrors.aliyun.com * extras: mirrors.aliyun.com * updates: mirrors.aliyun.comResolving Dependencies--> Running transaction check---> Package python2-PyMySQL.noarch 0:0.9.3-1.el7 will be installed--> Finished Dependency ResolutionDependencies Resolved============================================================================================================================== Package Arch Version Repository Size==============================================================================================================================Installing: python2-PyMySQL noarch 0.9.3-1.el7 epel 91 kTransaction Summary==============================================================================================================================Install 1 PackageTotal download size: 91 kInstalled size: 372 kDownloading packages:python2-PyMySQL-0.9.3-1.el7.noarch.rpm | 91 kB 00:00:00 Running transaction checkRunning transaction testTransaction test succeededRunning transaction Installing : python2-PyMySQL-0.9.3-1.el7.noarch 1/1 Verifying : python2-PyMySQL-0.9.3-1.el7.noarch 1/1 Installed: python2-PyMySQL.noarch 0:0.9.3-1.el7 Complete![root@node01 ~]#
6、在node02上部署memcached
[root@node02 ~]# yum install memcached -yLoaded plugins: fastestmirrorLoading mirror speeds from cached hostfile * base: mirrors.aliyun.com * centos-qemu-ev: mirrors.aliyun.com * extras: mirrors.aliyun.com * updates: mirrors.aliyun.comResolving Dependencies--> Running transaction check---> Package memcached.x86_64 0:1.5.6-1.el7 will be installed--> Finished Dependency ResolutionDependencies Resolved============================================================================================================================== Package Arch Version Repository Size==============================================================================================================================Installing: memcached x86_64 1.5.6-1.el7 centos-openstack-rocky 124 kTransaction Summary==============================================================================================================================Install 1 PackageTotal download size: 124 kInstalled size: 268 kDownloading packages:memcached-1.5.6-1.el7.x86_64.rpm | 124 kB 00:00:00 Running transaction checkRunning transaction testTransaction test succeededRunning transaction Installing : memcached-1.5.6-1.el7.x86_64 1/1 Verifying : memcached-1.5.6-1.el7.x86_64 1/1 Installed: memcached.x86_64 0:1.5.6-1.el7 Complete![root@node02 ~]#
配置memcached
[root@node02 ~]# cat /etc/sysconfig/memcachedPORT="11211"USER="memcached"MAXCONN="4096"CACHESIZE="1024"OPTIONS="-l 0.0.0.0,::1"[root@node02 ~]#
設(shè)置memcached開機啟動，并啟動memcached服務
[root@node02 ~]# systemctl enable memcached.serviceCreated symlink from /etc/systemd/system/multi-user.target.wants/memcached.service to /usr/lib/systemd/system/memcached.service.[root@node02 ~]# systemctl start memcached.service [root@node02 ~]# ss -tnlState Recv-Q Send-Q Local Address:Port Peer Address:Port LISTEN 0 128 *:11211 *:* LISTEN 0 128 *:22 *:* LISTEN 0 100 127.0.0.1:25 *:* LISTEN 0 128 *:3306 *:* LISTEN 0 128 ::1:11211 :::* LISTEN 0 128 :::22 :::* LISTEN 0 100 ::1:25 :::* [root@node02 ~]#
7、在node01上安裝連接memcached驅(qū)動，python-memcached
[root@node01 ~]# yum install -y python-memcachedLoaded plugins: fastestmirrorLoading mirror speeds from cached hostfile * base: mirrors.aliyun.com * centos-qemu-ev: mirrors.aliyun.com * extras: mirrors.aliyun.com * updates: mirrors.aliyun.comResolving Dependencies--> Running transaction check---> Package python-memcached.noarch 0:1.58-1.el7 will be installed--> Finished Dependency ResolutionDependencies Resolved============================================================================================================================== Package Arch Version Repository Size==============================================================================================================================Installing: python-memcached noarch 1.58-1.el7 centos-openstack-rocky 38 kTransaction Summary==============================================================================================================================Install 1 PackageTotal download size: 38 kInstalled size: 123 kDownloading packages:python-memcached-1.58-1.el7.noarch.rpm | 38 kB 00:00:00 Running transaction checkRunning transaction testTransaction test succeededRunning transaction Installing : python-memcached-1.58-1.el7.noarch 1/1 Verifying : python-memcached-1.58-1.el7.noarch 1/1 Installed: python-memcached.noarch 0:1.58-1.el7 Complete![root@node01 ~]#
8、在node02上部署rabbitmq-server
[root@node02 ~]# yum install rabbitmq-server -yLoaded plugins: fastestmirrorLoading mirror speeds from cached hostfile * base: mirrors.aliyun.com * centos-qemu-ev: mirrors.aliyun.com * extras: mirrors.aliyun.com * updates: mirrors.aliyun.comResolving Dependencies--> Running transaction check---> Package rabbitmq-server.noarch 0:3.6.16-1.el7 will be installed--> Processing Dependency: erlang-eldap >= 18 for package: rabbitmq-server-3.6.16-1.el7.noarch--> Processing Dependency: erlang-erts >= 18 for package: rabbitmq-server-3.6.16-1.el7.noarch--> Processing Dependency: erlang-kernel >= 18 for package: rabbitmq-server-3.6.16-1.el7.noarch--> Processing Dependency: erlang-mnesia >= 18 for package: rabbitmq-server-3.6.16-1.el7.noarch--> Processing Dependency: erlang-os_mon >= 18 for package: rabbitmq-server-3.6.16-1.el7.noarch--> Processing Dependency: erlang-public_key >= 18 for package: rabbitmq-server-3.6.16-1.el7.noarch……省略部分內(nèi)容……Installed: rabbitmq-server.noarch 0:3.6.16-1.el7 Dependency Installed: erlang-asn1.x86_64 0:19.3.6.4-1.el7 erlang-compiler.x86_64 0:19.3.6.4-1.el7 erlang-crypto.x86_64 0:19.3.6.4-1.el7 erlang-eldap.x86_64 0:19.3.6.4-1.el7 erlang-erts.x86_64 0:19.3.6.4-1.el7 erlang-hipe.x86_64 0:19.3.6.4-1.el7 erlang-inets.x86_64 0:19.3.6.4-1.el7 erlang-kernel.x86_64 0:19.3.6.4-1.el7 erlang-mnesia.x86_64 0:19.3.6.4-1.el7 erlang-os_mon.x86_64 0:19.3.6.4-1.el7 erlang-otp_mibs.x86_64 0:19.3.6.4-1.el7 erlang-public_key.x86_64 0:19.3.6.4-1.el7 erlang-runtime_tools.x86_64 0:19.3.6.4-1.el7 erlang-sasl.x86_64 0:19.3.6.4-1.el7 erlang-sd_notify.x86_64 0:1.0-2.el7 erlang-snmp.x86_64 0:19.3.6.4-1.el7 erlang-ssl.x86_64 0:19.3.6.4-1.el7 erlang-stdlib.x86_64 0:19.3.6.4-1.el7 erlang-syntax_tools.x86_64 0:19.3.6.4-1.el7 erlang-tools.x86_64 0:19.3.6.4-1.el7 erlang-xmerl.x86_64 0:19.3.6.4-1.el7 lksctp-tools.x86_64 0:1.0.17-2.el7 Complete![root@node02 ~]#
設(shè)置rabbitmq-server開機啟動，并啟動mabbitmq-server服務
[root@node02 ~]# systemctl enable rabbitmq-server.serviceCreated symlink from /etc/systemd/system/multi-user.target.wants/rabbitmq-server.service to /usr/lib/systemd/system/rabbitmq-server.service.[root@node02 ~]# systemctl start rabbitmq-server.service [root@node02 ~]# ss -tnlState Recv-Q Send-Q Local Address:Port Peer Address:Port LISTEN 0 128 *:11211 *:* LISTEN 0 128 *:4369 *:* LISTEN 0 128 *:22 *:* LISTEN 0 100 127.0.0.1:25 *:* LISTEN 0 128 *:25672 *:* LISTEN 0 128 *:3306 *:* LISTEN 0 128 ::1:11211 :::* LISTEN 0 128 :::22 :::* LISTEN 0 100 ::1:25 :::* LISTEN 0 128 :::5672 :::* [root@node02 ~]#
創(chuàng)建openstack用戶并設(shè)置密碼為openstack123
[root@node02 ~]# rabbitmqctl add_user openstack openstack123Creating user "openstack"[root@node02 ~]# rabbitmqctl list_usersListing usersopenstack []guest [administrator][root@node02 ~]#
授權(quán)openstack用戶對/下的所有文件有讀寫
[root@node02 ~]# rabbitmqctl set_permissions openstack ".*" ".*" ".*"Setting permissions for user "openstack" in vhost "/"[root@node02 ~]# rabbitmqctl list_permissionsListing permissions in vhost "/"guest .* .* .*openstack .* .* .*[root@node02 ~]#
到此，openstack的基礎(chǔ)環(huán)境和數(shù)據(jù)庫節(jié)點就準備ok了，后續(xù)我們就可以在逐一安裝各個控制節(jié)點上的服務和計算節(jié)點上的服務；
