update hbase

This commit is contained in:
2019-04-24 22:51:34 +08:00
parent eca0927867
commit 987ee9a693
5 changed files with 58 additions and 214 deletions

View File

@@ -1,82 +1,61 @@
Run Aapache HBase with Docker
# Run distributed Aapache HBase with Docker
## Create a hadoop cluster with HBase installed in swarm mode
## Setup the zookeeper cluster
`--hostname` needs 1.13 or higher
see [zookeeper](https://github.com/newnius/scripts/tree/master/zookeeper)
Assume the nodes are `zookeeper-node1`, `zookeeper-node2`, `zookeeper-node3`
## Setup HDFS cluster
See [hadoop](https://github.com/newnius/scripts/tree/master/hadoop)
Assume the nodes are `hadoop-master`, `hadoop-slave1`, `hadoop-slave2`, `hadoop-slave3`
## Setup HBase cluster
```bash
docker service create \
--name hbase-master \
--network swarm-net \
--hostname hbase-master \
--replicas 1 \
--detach=true \
--mount type=bind,source=/etc/localtime,target=/etc/localtime \
--endpoint-mode vip \
newnius/hbase:1.2.6
--name hbase-master \
--hostname hbase-master \
--network swarm-net \
--endpoint-mode dnsrr \
newnius/hbase:1.2.6
```
```bash
docker service create \
--name hbase-slave1 \
--network swarm-net \
--hostname hbase-slave1 \
--replicas 1 \
--detach=true \
--mount type=bind,source=/etc/localtime,target=/etc/localtime \
--endpoint-mode vip \
newnius/hbase:1.2.6
--name hbase-slave1 \
--hostname hbase-slave1 \
--network swarm-net \
--endpoint-mode dnsrr \
newnius/hbase:1.2.6
```
```bash
docker service create \
--name hbase-slave2 \
--network swarm-net \
--hostname hbase-slave2 \
--replicas 1 \
--detach=true \
--mount type=bind,source=/etc/localtime,target=/etc/localtime \
--endpoint-mode vip \
newnius/hbase:1.2.6
--name hbase-slave2 \
--hostname hbase-slave2 \
--network swarm-net \
--endpoint-mode dnsrr \
newnius/hbase:1.2.6
```
```bash
docker service create \
--name hbase-slave3 \
--network swarm-net \
--hostname hbase-slave3 \
--replicas 1 \
--detach=true \
--mount type=bind,source=/etc/localtime,target=/etc/localtime \
--endpoint-mode vip \
newnius/hbase:1.2.6
--name hbase-slave3 \
--hostname hbase-slave3 \
--network swarm-net \
--endpoint-mode dnsrr \
newnius/hbase:1.2.6
```
## Init && Test
#### Start Hadoop
Read [newnius/hadoop](https://hub.docker.com/r/newnius/hadoop/) to learn how to run & init hadoop
#### Start Zookeeper cluster
```bash
ZOOKEEPER_NUM=3
for i in $( seq 1 $ZOOKEEPER_NUM )
do
docker service create \
-e MYID=${i} \
-e SERVERS=${zookeeper_str} \
--replicas 1 \
--network swarm-net \
--endpoint-mode dnsrr \
--name=zookeeper_node${i} \
mesoscloud/zookeeper:3.4.8-ubuntu-14.04
done
bin/start-hbase.sh
```
#### Start HBase
```bash
bash bin/start-hbase.sh
```
### Browse
#### Browse
Now you can see HBase cluster in `http://hadoop-master:16010` in browser. ([newnius/docker-proxy](https://hub.docker.com/r/newnius/docker-proxy/) needed.)
Now you can see HBase cluster in `http://hbase-master:16010` in browser. ([newnius/docker-proxy](https://hub.docker.com/r/newnius/docker-proxy/) needed.)