在centos 7 上安装zookeeper集群
测试机上需要安装java软件
$ rpm -qa|grep java
$ sudo yum install -y java-1.8.0-openjdk.x86_64
$ java -version
openjdk version "1.8.0_65"
openjdk runtime environment (build 1.8.0_65-b17)
openjdk 64-bit server vm (build 25.65-b01, mixed mode)
1、创建用户:bjrenrui0001~0003
sudo groupadd zookeeper
sudo useradd -g zookeeper zookeeper
echo "zookeeper@1234"|sudo passwd zookeeper —stdin
2、创建工作目录
bjrenrui0001:
sudo mkdir /yanfa/mq
sudo ln -s /yanfa/mq /mq
sudo chown -r dreamjobs.dreamjobs /mq
bjrenrui0002~0003:
sudo mkdir mq
sudo chown dreamjobs.dreamjobs mq
sudo ln -s /home/backupfile/mq /mq
sudo chown dreamjobs.dreamjobs mq
1. 单机模式(standalone mode)
下载,解压
cd /mq
wget http://mirror.bit.edu.cn/apache/zookeeper/zookeeper-3.4.7/zookeeper-3.4.7.tar.gz
tar zxvf zookeeper-3.4.7.tar.gz -c /mq
ln -s /mq/zookeeper-3.4.7 zookeeper
启动
默认就是单机模式
cd /mq/zookeeper/
cp ./conf/zoo_sample.cfg ./conf/zoo.cfg
sh ./bin/zkserver.sh start
防火墙开启2181端口
检查服务状态:
[dreamjobs@bjrenrui0001 bin]$ sh zkserver.sh status
zookeeper jmx enabled by default
using config: /mq/zookeeper/bin/../conf/zoo.cfg
mode: standalone
使用java 客户端连接zookeeper
./bin/zkcli.sh -server 127.0.0.1:2181
然后就可以使用各种命令了,跟文件操作命令很类似,输入help可以看到所有命令。
关闭
sh bin/zkserver.sh stop
2 分布式模式(replicated mode)
在生产环境中,要配置成分布式模式,才能发挥威力。
zookeeper集群一般被称为zookeeper ensemble(集成),或者 quorum(法定人数).
准备3台机器
假设有三台机器,hostname和ip对应关系是:
192.168.100.200 bjrenrui0001
192.168.100.201 bjrenrui0002
192.168.100.202 bjrenrui0003
zookeeper不存在明显的master/slave关系,各个节点都是服务器,leader挂了,会立马从follower中选举一个出来作为leader.
由于没有主从关系,也不用配置ssh无密码登录了,各个zk服务器是自己启动的,互相之间通过tcp端口来交换数据。
创建日志和数据目录:
bjrenrui0001~0003
cd /mq/zookeeper
mkdir -p zookeeperdatadir/{logs,data}
修改bjrenrui0001的配置文件conf/zoo.cfg:
[dreamjobs@bjrenrui0001 conf]$ grep -ve '^($|#)' zoo.cfg
ticktime=2000
initlimit=10
synclimit=5
datadir=/mq/zookeeper/zookeeperdatadir/data
datalogdir=/mq/zookeeper/zookeeperdatadir/logs
clientport=2181
server.1=bjrenrui0001:2888:3888
server.2=bjrenrui0002:2888:3888
server.3=bjrenrui0003:2888:3888
修改完后拷贝到 bjrenrui0002,以及 bjrenrui0003上
myid文件:
要在每台机器的datadir下,新建一个myid文件,里面存放一个数字,用来标识当前主机
bjrenrui0001: echo "1" >> /mq/zookeeper/zookeeperdatadir/data/myid
bjrenrui0002: echo "2" >> /mq/zookeeper/zookeeperdatadir/data/myid
bjrenrui0003: echo "3" >> /mq/zookeeper/zookeeperdatadir/data/myid
每台机器上启动zookeeper服务:
bjrenrui0001: sh /mq/zookeeper/bin/zkserver.sh start
bjrenrui0002: sh /mq/zookeeper/bin/zkserver.sh start
bjrenrui0003: sh /mq/zookeeper/bin/zkserver.sh start
每台机器上停止zookeeper服务:
bjrenrui0001: sh /mq/zookeeper/bin/zkserver.sh stop
bjrenrui0002: sh /mq/zookeeper/bin/zkserver.sh stop
bjrenrui0003: sh /mq/zookeeper/bin/zkserver.sh stop
因为3个节点的启动是有顺序的,所以在陆续启动三个节点的时候,前面先启动的节点连接未启动的节点的时候会报出一些错误,可以忽略。
防火墙开启2181端口:
sudo vi /etc/sysconfig/iptables
-a input -p tcp -s 192.168.100.0/24 -j accept
sudo systemctl restart iptables.service
查看状态
[dreamjobs@bjrenrui0001 conf]$ gmbjyf.sh bjyfnbserver "cat /mq/zookeeper/zookeeperdatadir/data/myid"
bjrenrui0001
1
bjrenrui0002
2
bjrenrui0003
3
$ gmbjyf.sh bjyfnbserver "sh /mq/zookeeper/bin/zkserver.sh restart"
bjrenrui0001
zookeeper jmx enabled by default
using config: /mq/zookeeper/bin/../conf/zoo.cfg
zookeeper jmx enabled by default
using config: /mq/zookeeper/bin/../conf/zoo.cfg
stopping zookeeper ... stopped
zookeeper jmx enabled by default
using config: /mq/zookeeper/bin/../conf/zoo.cfg
starting zookeeper ... started
bjrenrui0002
zookeeper jmx enabled by default
using config: /mq/zookeeper/bin/../conf/zoo.cfg
zookeeper jmx enabled by default
using config: /mq/zookeeper/bin/../conf/zoo.cfg
stopping zookeeper ... stopped
zookeeper jmx enabled by default
using config: /mq/zookeeper/bin/../conf/zoo.cfg
starting zookeeper ... started
bjrenrui0003
zookeeper jmx enabled by default
using config: /mq/zookeeper/bin/../conf/zoo.cfg
zookeeper jmx enabled by default
using config: /mq/zookeeper/bin/../conf/zoo.cfg
stopping zookeeper ... stopped
zookeeper jmx enabled by default
using config: /mq/zookeeper/bin/../conf/zoo.cfg
starting zookeeper … started
$ gmbjyf.sh bjyfnbserver "sh /mq/zookeeper/bin/zkserver.sh status"
bjrenrui0001
zookeeper jmx enabled by default
using config: /mq/zookeeper/bin/../conf/zoo.cfg
mode: follower
bjrenrui0002
zookeeper jmx enabled by default
using config: /mq/zookeeper/bin/../conf/zoo.cfg
mode: leader
bjrenrui0003
zookeeper jmx enabled by default
using config: /mq/zookeeper/bin/../conf/zoo.cfg
mode: follower
使用java客户端连接zookeeper集群
找一台机器,解压zookeeper压缩包,不用配置,就可以使用java客户端连接zookeeper集群中的任意一台服务器了。
$ sh /mq/zookeeper/bin/zkcli.sh -server bjrenrui0001:2181
$ sh /mq/zookeeper/bin/zkcli.sh -server bjrenrui0002:2181
$ sh /mq/zookeeper/bin/zkcli.sh -server bjrenrui0003:2181