免费视频淫片aa毛片_日韩高清在线亚洲专区vr_日韩大片免费观看视频播放_亚洲欧美国产精品完整版

打開(kāi)APP
userphoto
未登錄

開(kāi)通VIP，暢享免費(fèi)電子書(shū)等14項(xiàng)超值服

開(kāi)通VIP

首頁(yè)

好書(shū)

留言交流

下載APP

聯(lián)系客服
HBase學(xué)習(xí)之路 （二）HBase集群安裝

目錄

 

正文

前提

1、HBase 依賴于 HDFS 做底層的數(shù)據(jù)存儲(chǔ)

2、HBase 依賴于 MapReduce 做數(shù)據(jù)計(jì)算

3、HBase 依賴于 ZooKeeper 做服務(wù)協(xié)調(diào)

4、HBase源碼是java編寫(xiě)的，安裝需要依賴JDK

版本選擇

打開(kāi)官方的版本說(shuō)明http://hbase.apache.org/1.2/book.html

JDK的選擇

Hadoop的選擇

 

此處我們的hadoop版本用的的是2.7.5，HBase選擇的版本是1.2.6

安裝

1、zookeeper的安裝

參考http://www.cnblogs.com/qingyunzong/p/8619184.html

2、Hadoopd的安裝

參考http://www.cnblogs.com/qingyunzong/p/8634335.html

3、下載安裝包

找到官網(wǎng)下載 hbase 安裝包 hbase-1.2.6-bin.tar.gz，這里給大家提供一個(gè)下載地址： http://mirrors.hust.edu.cn/apache/hbase/

4、上傳服務(wù)器并解壓縮到指定目錄

[hadoop@hadoop1 ~]$ lsapps  data  hbase-1.2.6-bin.tar.gz  hello.txt  log  zookeeper.out[hadoop@hadoop1 ~]$ tar -zxvf hbase-1.2.6-bin.tar.gz -C apps/

5、修改配置文件

配置文件目錄在安裝包的conf文件夾中

（1）修改hbase-env.sh 

[hadoop@hadoop1 conf]$ vi hbase-env.sh
export JAVA_HOME=/usr/local/jdk1.8.0_73
export HBASE_MANAGES_ZK=false

（2）修改hbase-site.xml

[hadoop@hadoop1 conf]$ vi hbase-site.xml
<configuration>        <property>                <!-- 指定 hbase 在 HDFS 上存儲(chǔ)的路徑 -->                <name>hbase.rootdir</name>                <value>hdfs://myha01/hbase126</value>        </property>        <property>                <!-- 指定 hbase 是分布式的 -->                <name>hbase.cluster.distributed</name>                <value>true</value>        </property>        <property>                <!-- 指定 zk 的地址，多個(gè)用“,”分割 -->                <name>hbase.zookeeper.quorum</name>                <value>hadoop1:2181,hadoop2:2181,hadoop3:2181,hadoop4:2181</value>        </property></configuration>

（3）修改regionservers 

[hadoop@hadoop1 conf]$ vi regionservers 
hadoop1hadoop2hadoop3hadoop4

（4）修改backup-masters

該文件是不存在的，先自行創(chuàng)建

[hadoop@hadoop1 conf]$ vi backup-masters
hadoop4

（5）修改hdfs-site.xml 和 core-site.xml 

最重要一步，要把 hadoop 的 hdfs-site.xml 和 core-site.xml 放到 hbase-1.2.6/conf 下

[hadoop@hadoop1 conf]$ cd ~/apps/hadoop-2.7.5/etc/hadoop/[hadoop@hadoop1 hadoop]$ cp core-site.xml hdfs-site.xml ~/apps/hbase-1.2.6/conf/

6、將HBase安裝包分發(fā)到其他節(jié)點(diǎn)

分發(fā)之前先刪除HBase目錄下的docs文件夾，

[hadoop@hadoop1 hbase-1.2.6]$ rm -rf docs/

在進(jìn)行分發(fā)

[hadoop@hadoop1 apps]$ scp -r hbase-1.2.6/ hadoop2:$PWD[hadoop@hadoop1 apps]$ scp -r hbase-1.2.6/ hadoop3:$PWD[hadoop@hadoop1 apps]$ scp -r hbase-1.2.6/ hadoop4:$PWD

7、 同步時(shí)間

HBase 集群對(duì)于時(shí)間的同步要求的比 HDFS 嚴(yán)格，所以，集群?jiǎn)?dòng)之前千萬(wàn)記住要進(jìn)行 時(shí)間同步，要求相差不要超過(guò) 30s

8、配置環(huán)境變量

所有服務(wù)器都有進(jìn)行配置

[hadoop@hadoop1 apps]$ vi ~/.bashrc 
#HBaseexport HBASE_HOME=/home/hadoop/apps/hbase-1.2.6export PATH=$PATH:$HBASE_HOME/bin

使環(huán)境變量立即生效

[hadoop@hadoop1 apps]$ source ~/.bashrc

啟動(dòng)HBase集群

嚴(yán)格按照啟動(dòng)順序進(jìn)行

1、啟動(dòng)zookeeper集群

每個(gè)zookeeper節(jié)點(diǎn)都要執(zhí)行以下命令

[hadoop@hadoop1 apps]$ zkServer.sh startZooKeeper JMX enabled by defaultUsing config: /home/hadoop/apps/zookeeper-3.4.10/bin/../conf/zoo.cfgStarting zookeeper ... STARTED[hadoop@hadoop1 apps]$

2、啟動(dòng)HDFS集群及YARN集群

如果需要運(yùn)行MapReduce程序則啟動(dòng)yarn集群，否則不需要啟動(dòng)

[hadoop@hadoop1 apps]$ start-dfs.shStarting namenodes on [hadoop1 hadoop2]hadoop2: starting namenode, logging to /home/hadoop/apps/hadoop-2.7.5/logs/hadoop-hadoop-namenode-hadoop2.outhadoop1: starting namenode, logging to /home/hadoop/apps/hadoop-2.7.5/logs/hadoop-hadoop-namenode-hadoop1.outhadoop3: starting datanode, logging to /home/hadoop/apps/hadoop-2.7.5/logs/hadoop-hadoop-datanode-hadoop3.outhadoop4: starting datanode, logging to /home/hadoop/apps/hadoop-2.7.5/logs/hadoop-hadoop-datanode-hadoop4.outhadoop2: starting datanode, logging to /home/hadoop/apps/hadoop-2.7.5/logs/hadoop-hadoop-datanode-hadoop2.outhadoop1: starting datanode, logging to /home/hadoop/apps/hadoop-2.7.5/logs/hadoop-hadoop-datanode-hadoop1.outStarting journal nodes [hadoop1 hadoop2 hadoop3]hadoop3: starting journalnode, logging to /home/hadoop/apps/hadoop-2.7.5/logs/hadoop-hadoop-journalnode-hadoop3.outhadoop2: starting journalnode, logging to /home/hadoop/apps/hadoop-2.7.5/logs/hadoop-hadoop-journalnode-hadoop2.outhadoop1: starting journalnode, logging to /home/hadoop/apps/hadoop-2.7.5/logs/hadoop-hadoop-journalnode-hadoop1.outStarting ZK Failover Controllers on NN hosts [hadoop1 hadoop2]hadoop2: starting zkfc, logging to /home/hadoop/apps/hadoop-2.7.5/logs/hadoop-hadoop-zkfc-hadoop2.outhadoop1: starting zkfc, logging to /home/hadoop/apps/hadoop-2.7.5/logs/hadoop-hadoop-zkfc-hadoop1.out[hadoop@hadoop1 apps]$

啟動(dòng)完成之后檢查以下namenode的狀態(tài)

[hadoop@hadoop1 apps]$ hdfs haadmin -getServiceState nn1standby[hadoop@hadoop1 apps]$ hdfs haadmin -getServiceState nn2active[hadoop@hadoop1 apps]$

3、啟動(dòng)HBase

保證 ZooKeeper 集群和 HDFS 集群?jiǎn)?dòng)正常的情況下啟動(dòng) HBase 集群 啟動(dòng)命令：start-hbase.sh，在哪臺(tái)節(jié)點(diǎn)上執(zhí)行此命令，哪個(gè)節(jié)點(diǎn)就是主節(jié)點(diǎn)

[hadoop@hadoop1 conf]$ start-hbase.shstarting master, logging to /home/hadoop/apps/hbase-1.2.6/logs/hbase-hadoop-master-hadoop1.outJava HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0hadoop3: starting regionserver, logging to /home/hadoop/apps/hbase-1.2.6/logs/hbase-hadoop-regionserver-hadoop3.outhadoop4: starting regionserver, logging to /home/hadoop/apps/hbase-1.2.6/logs/hbase-hadoop-regionserver-hadoop4.outhadoop2: starting regionserver, logging to /home/hadoop/apps/hbase-1.2.6/logs/hbase-hadoop-regionserver-hadoop2.outhadoop3: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0hadoop3: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0hadoop4: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0hadoop4: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0hadoop2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0hadoop2: Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0hadoop1: starting regionserver, logging to /home/hadoop/apps/hbase-1.2.6/logs/hbase-hadoop-regionserver-hadoop1.outhadoop4: starting master, logging to /home/hadoop/apps/hbase-1.2.6/logs/hbase-hadoop-master-hadoop4.out[hadoop@hadoop1 conf]$

觀看啟動(dòng)日志可以看到：

（1）首先在命令執(zhí)行節(jié)點(diǎn)啟動(dòng) master

（2）然后分別在 hadoop02,hadoop03,hadoop04,hadoop05 啟動(dòng) regionserver

（3）然后在 backup-masters 文件中配置的備節(jié)點(diǎn)上再啟動(dòng)一個(gè) master 主進(jìn)程

驗(yàn)證啟動(dòng)是否正常

1、檢查各進(jìn)程是否啟動(dòng)正常

 主節(jié)點(diǎn)和備用節(jié)點(diǎn)都啟動(dòng) hmaster 進(jìn)程

 各從節(jié)點(diǎn)都啟動(dòng) hregionserver 進(jìn)程

按照對(duì)應(yīng)的配置信息各個(gè)節(jié)點(diǎn)應(yīng)該要啟動(dòng)的進(jìn)程如上圖所示

2、通過(guò)訪問(wèn)瀏覽器頁(yè)面

hadoop1

hadop4

從圖中可以看出hadoop4是備用節(jié)點(diǎn)

3、驗(yàn)證高可用

干掉hadoop1上的hbase進(jìn)程，觀察備用節(jié)點(diǎn)是否啟用

[hadoop@hadoop1 conf]$ jps4960 HMaster2960 QuorumPeerMain3169 NameNode3699 DFSZKFailoverController3285 DataNode5098 HRegionServer5471 Jps3487 JournalNode[hadoop@hadoop1 conf]$ kill -9 4960

 hadoop1界面訪問(wèn)不了

hadoop4變成主節(jié)點(diǎn)

4、如果有節(jié)點(diǎn)相應(yīng)的進(jìn)程沒(méi)有啟動(dòng)，那么可以手動(dòng)啟動(dòng)

啟動(dòng)HMaster進(jìn)程

[hadoop@hadoop3 conf]$ jps3360 Jps2833 JournalNode2633 QuorumPeerMain3179 HRegionServer2732 DataNode[hadoop@hadoop3 conf]$ hbase-daemon.sh start masterstarting master, logging to /home/hadoop/apps/hbase-1.2.6/logs/hbase-hadoop-master-hadoop3.outJava HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was removed in 8.0[hadoop@hadoop3 conf]$ jps2833 JournalNode3510 Jps3432 HMaster2633 QuorumPeerMain3179 HRegionServer2732 DataNode[hadoop@hadoop3 conf]$

 

啟動(dòng)HRegionServer進(jìn)程

[hadoop@hadoop3 conf]$ hbase-daemon.sh start regionserver

 

本站僅提供存儲(chǔ)服務(wù)，所有內(nèi)容均由用戶發(fā)布，如發(fā)現(xiàn)有害或侵權(quán)內(nèi)容，請(qǐng)點(diǎn)擊舉報(bào)。
打開(kāi)APP，閱讀全文并永久保存 查看更多類似文章
猜你喜歡
類似文章
HBase集群搭建
Hbase分布式集群安裝
HBase簡(jiǎn)介
Hbase HA 分布式搭建
Apache Hbase 全攻略
數(shù)據(jù)倉(cāng)庫(kù)組件：HBase集群環(huán)境搭建和應(yīng)用案例
更多類似文章 >>
生活服務(wù)
分享 收藏 導(dǎo)長(zhǎng)圖 關(guān)注 下載文章
綁定賬號(hào)成功
后續(xù)可登錄賬號(hào)暢享VIP特權(quán)！
如果VIP功能使用有故障，
可點(diǎn)擊這里聯(lián)系客服！

聯(lián)系客服