单机模式安装、启动 HBase
安装 HBase Master
安装HBase Master
|
1 |
yum install hbase-master |
启动HBase Master服务
|
1 2 3 |
[root@hadoop01 ~]# service hbase-master start starting master, logging to /var/log/hbase/hbase-hbase-master-hadoop01.out Started HBase master daemon (hbase-master):[ OK ] |
安装及启动HBase Thrift Server
安装HBase Thrift Server
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 |
[root@hadoop01 ~]# yum install hbase-thrift Loaded plugins: fastestmirror, refresh-packagekit, security Setting up Install Process Loading mirror speeds from cached hostfile c6-http | 2.9 kB 00:00 cdh5.3.1 | 2.9 kB 00:00 cm5.3.1 | 2.9 kB 00:00 Resolving Dependencies --> Running transaction check ---> Package hbase-thrift.x86_64 0:0.98.6+cdh5.3.1+74-1.cdh5.3.1.p0.17.el6 will be installed --> Finished Dependency Resolution Dependencies Resolved ================================================================================================== Package Arch Version Repository Size ================================================================================================== Installing: hbase-thrift x86_64 0.98.6+cdh5.3.1+74-1.cdh5.3.1.p0.17.el6 cdh5.3.1 5.2 k Transaction Summary ================================================================================================== Install 1 Package(s) Total download size: 5.2 k Installed size: 4.5 k Is this ok [y/N]: y Downloading Packages: hbase-thrift-0.98.6+cdh5.3.1+74-1.cdh5.3.1.p0.17.el6.x86_64.rpm | 5.2 kB 00:00 Running rpm_check_debug Running Transaction Test Transaction Test Succeeded Running Transaction Installing : hbase-thrift-0.98.6+cdh5.3.1+74-1.cdh5.3.1.p0.17.el6.x86_64 1/1 Verifying : hbase-thrift-0.98.6+cdh5.3.1+74-1.cdh5.3.1.p0.17.el6.x86_64 1/1 Installed: hbase-thrift.x86_64 0:0.98.6+cdh5.3.1+74-1.cdh5.3.1.p0.17.el6 Complete! |
启动HBase Thrift Server
|
1 2 3 |
[root@hadoop01 ~]# service hbase-thrift start starting thrift, logging to /var/log/hbase/hbase-hbase-thrift-hadoop01.out Started HBase thrift daemon (hbase-thrift):[ OK ] |
安装配置HBase REST
安装HBase REST
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 |
[root@hadoop01 ~]# yum install hbase-rest Loaded plugins: fastestmirror, refresh-packagekit, security Setting up Install Process Loading mirror speeds from cached hostfile Resolving Dependencies --> Running transaction check ---> Package hbase-rest.x86_64 0:0.98.6+cdh5.3.1+74-1.cdh5.3.1.p0.17.el6 will be installed --> Finished Dependency Resolution Dependencies Resolved ================================================================================================== Package Arch Version Repository Size ================================================================================================== Installing: hbase-rest x86_64 0.98.6+cdh5.3.1+74-1.cdh5.3.1.p0.17.el6 cdh5.3.1 4.7 k Transaction Summary ================================================================================================== Install 1 Package(s) Total download size: 4.7 k Installed size: 4.5 k Is this ok [y/N]: y Downloading Packages: hbase-rest-0.98.6+cdh5.3.1+74-1.cdh5.3.1.p0.17.el6.x86_64.rpm | 4.7 kB 00:00 Running rpm_check_debug Running Transaction Test Transaction Test Succeeded Running Transaction Installing : hbase-rest-0.98.6+cdh5.3.1+74-1.cdh5.3.1.p0.17.el6.x86_64 1/1 Verifying : hbase-rest-0.98.6+cdh5.3.1+74-1.cdh5.3.1.p0.17.el6.x86_64 1/1 Installed: hbase-rest.x86_64 0:0.98.6+cdh5.3.1+74-1.cdh5.3.1.p0.17.el6 Complete! |
配置REST端口（如果采用默认的60050则不需配置）
修改hbase-site.xml
|
1 2 3 4 |
<property> <name>hbase.rest.port</name> <value>60050</value> </property> |
启动HBase REST
|
1 2 3 |
[root@hadoop01 ~]# service hbase-rest start starting rest, logging to /var/log/hbase/hbase-hbase-rest-hadoop01.out Started HBase rest daemon (hbase-rest):[ OK ] |
安装至此，即可单机享用HBase。
HBase分布式安装配置
集群机器规划
按照以下规划安装对应的软件包
| Node Name | Master | ZooKeeper | RegionServer |
|---|---|---|---|
|
hadoop01 |
yes |
yes |
no |
|
hadoop02 |
backup |
yes |
yes |
|
hadoop03 |
no |
yes |
yes |
安装软件包命令
master
|
1 |
yum install hbase-master |
region server
|
1 |
yum install hbase-regionserver |
准备hadoop01
配置region server
编辑/etc/hbase/conf/regionservers，添加hadoop02、03.
|
1 2 3 4 |
[root@hadoop01 conf]# vim regionservers hadoop02 hadoop03 |
配置hadoop02为backup master
新增文件/etc/hbase/conf/backup-masters，添加一行hadoop02
|
1 2 3 |
[root@hadoop01 conf]# vim backup-masters hadoop02 |
配置HBase为分布式模式
编辑/etc/hbase/conf/hbase-site.xml
|
1 2 3 4 5 6 7 8 |
<property> <name>hbase.cluster.distributed</name> <value>true</value> </property> <property> <name>hbase.rootdir</name> <value>hdfs://hadoop01:8020/hbase</value> </property> |
配置zookeeper
在/etc/hbase/conf/hbase-site.xml添加参数
|
1 2 3 4 5 6 7 8 |
<property> <name>hbase.zookeeper.quorum</name> <value>hadoop01,hadoop02,hadoop03</value> </property> <property> <name>hbase.zookeeper.property.dataDir</name> <value>/var/lib/zookeeper</value> </property> |
其中dataDir参数参考本机的/etc/zookeeper/conf/zoo.cfg。
在HDFS上创建/hbase目录
|
1 2 |
hdfs dfs -mkdir /hbase hdfs dfs -chown hbase /hbase |
配置hadoop02、03
拷贝hadoop01配置文件到02、03
|
1 2 3 4 5 6 7 8 |
[root@hadoop01 conf]# scp backup-masters hbase-site.xml regionservers hadoop02:/etc/hbase/conf backup-masters 100% 9 0.0KB/s 00:00 hbase-site.xml 100% 3291 3.2KB/s 00:00 regionservers 100% 52 0.1KB/s 00:00 [root@hadoop01 conf]# scp backup-masters hbase-site.xml regionservers hadoop03:/etc/hbase/conf backup-masters 100% 9 0.0KB/s 00:00 hbase-site.xml 100% 3291 3.2KB/s 00:00 regionservers 100% 52 0.1KB/s 00:00 |
分别启动服务
在hadoop01、02启动hbase-master
|
1 |
service hbase-master start |
在hadoop02、03启动hbase-regionserver
|
1 |
service hbase-regionserver start |
检查服务状态
在各服务器执行：jps
hadoop01：
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
[root@hadoop01 ~]# jps 2917 ResourceManager 9145 NameNode 2773 NodeManager 2349 32369 Jps <strong>32138 HMaster</strong> 2139 JournalNode 3333 RunJar 4114 Worker 3867 Master 3511 RunJar 2667 JobHistoryServer 2604 Bootstrap <strong>1992 QuorumPeerMain</strong> 8950 DataNode |
hadoop02：
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
[root@hadoop02 ~]# jps 7365 -- process information unavailable 4764 Jps 3387 Worker 16481 -- process information unavailable 2537 NodeManager <strong>4450 HMaster</strong> 3140 Master <strong>1799 QuorumPeerMain</strong> 7511 DataNode 2171 2379 Bootstrap 1960 JournalNode <strong>4618 HRegionServer</strong> |
hadoop03：
|
1 2 3 4 5 6 7 8 9 10 11 12 |
[root@hadoop03 ~]# jps 3316 Worker 5521 DataNode 2749 RunJar 2477 NodeManager 18027 Jps <strong>17887 HRegionServer</strong> 2199 1979 JournalNode <strong>1837 QuorumPeerMain</strong> 2417 Bootstrap 3070 Master |
参考
单机模式安装、启动 HBase：http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cdh_ig_hbase_standalone_start.html
HBase分布式安装配置：http://hbase.apache.org/book.html#_introduction
HBase分布式安装配置（伪分布式）:
http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cdh_ig_hbase_pseudo_configure.html
HBase分布式安装配置（伪分布式->集群）：
http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cdh_ig_hbase_cluster_deploy.html