分布式存儲算法
- 哈希取余算法分區(qū)(hash取模)
- 一致性哈希算法分區(qū)(hash閉環(huán))
- 哈希槽算法分區(qū)(hash中間代理)Redis集群使用
Redis集群搭建(3主3從案例)
- 啟動6個容器
// 節(jié)點(diǎn)1-6 端口6381-6386
docker run -d --name redis-node-1 --net host --privileged=true -v /data/redis/share/redis-node-1:/data redis:6.0.8 --cluster-enabled yes --appendonly yes --port 6381
docker run -d --name redis-node-2 --net host --privileged=true -v /data/redis/share/redis-node-2:/data redis:6.0.8 --cluster-enabled yes --appendonly yes --port 6382
docker run -d --name redis-node-3 --net host --privileged=true -v /data/redis/share/redis-node-3:/data redis:6.0.8 --cluster-enabled yes --appendonly yes --port 6383
docker run -d --name redis-node-4 --net host --privileged=true -v /data/redis/share/redis-node-4:/data redis:6.0.8 --cluster-enabled yes --appendonly yes --port 6384
docker run -d --name redis-node-5 --net host --privileged=true -v /data/redis/share/redis-node-5:/data redis:6.0.8 --cluster-enabled yes --appendonly yes --port 6385
docker run -d --name redis-node-6 --net host --privileged=true -v /data/redis/share/redis-node-6:/data redis:6.0.8 --cluster-enabled yes --appendonly yes --port 6386
// 查看運(yùn)行的容器
docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
75802596bb67 redis:6.0.8 "docker-entrypoint.s…" About a minute ago Up About a minute redis-node-6
c41b787f923c redis:6.0.8 "docker-entrypoint.s…" About a minute ago Up About a minute redis-node-5
6b67d6956c48 redis:6.0.8 "docker-entrypoint.s…" About a minute ago Up About a minute redis-node-4
8f4d3d46f060 redis:6.0.8 "docker-entrypoint.s…" About a minute ago Up About a minute redis-node-3
ec77cdc1af2a redis:6.0.8 "docker-entrypoint.s…" About a minute ago Up About a minute redis-node-2
9b3f843d9982 redis:6.0.8 "docker-entrypoint.s…" About a minute ago Up About a minute redis-node-1
- 進(jìn)入容器redis-node-1
docker exec -it redis-node-1 bash
- 為6臺機(jī)器構(gòu)建集群關(guān)系,構(gòu)建主從關(guān)系,ip為機(jī)器的地址 --cluster-replicas 1 表示為每個master創(chuàng)建一個slave節(jié)點(diǎn)
redis-cli --cluster create 192.168.223.135:6381 192.168.223.135:6382 192.168.223.135:6383 192.168.223.135:6384 192.168.223.135:6385 192.168.223.135:6386 --cluster-replicas 1
root@test:/data# redis-cli --cluster create 192.168.223.135:6381 192.168.223.135:6382 192.168.223.135:6383 192.168.223.135:6384 192.168.223.135:6385 192.168.223.135:6386 --cluster-replicas 1
>>> Performing hash slots allocation on 6 nodes...
Master[0] -> Slots 0 - 5460
Master[1] -> Slots 5461 - 10922
Master[2] -> Slots 10923 - 16383
Adding replica 192.168.223.135:6385 to 192.168.223.135:6381
Adding replica 192.168.223.135:6386 to 192.168.223.135:6382
Adding replica 192.168.223.135:6384 to 192.168.223.135:6383
>>> Trying to optimize slaves allocation for anti-affinity
[WARNING] Some slaves are in the same host as their master
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[0-5460] (5461 slots) master
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[5461-10922] (5462 slots) master
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[10923-16383] (5461 slots) master
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
replicates ed4bea7210969391e54fe5334c685b76263c4e85
S: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
replicates 7130be699c2d6970c4824efa69047adc85375d65
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
Can I set the above configuration? (type 'yes' to accept): yes
>>> Nodes configuration updated
>>> Assign a different config epoch to each node
>>> Sending CLUSTER MEET messages to join the cluster
Waiting for the cluster to join
.
>>> Performing Cluster Check (using node 192.168.223.135:6381)
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[0-5460] (5461 slots) master
1 additional replica(s)
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[5461-10922] (5462 slots) master
1 additional replica(s)
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[10923-16383] (5461 slots) master
1 additional replica(s)
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
S: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots: (0 slots) slave
replicates 7130be699c2d6970c4824efa69047adc85375d65
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
對應(yīng)關(guān)系:
1-5 2-6 3-4
- 查看集群狀態(tài)cluster info,以6381作為切入點(diǎn),任意都可以
redis-cli -p 6381
127.0.0.1:6381> cluster info
cluster_state:ok
cluster_slots_assigned:16384
cluster_slots_ok:16384
cluster_slots_pfail:0
cluster_slots_fail:0
cluster_known_nodes:6 6個節(jié)點(diǎn)
cluster_size:3
cluster_current_epoch:6
cluster_my_epoch:1
cluster_stats_messages_ping_sent:592
cluster_stats_messages_pong_sent:582
cluster_stats_messages_sent:1174
cluster_stats_messages_ping_received:577
cluster_stats_messages_pong_received:592
cluster_stats_messages_meet_received:5
cluster_stats_messages_received:1174
- 查看集群節(jié)點(diǎn)信息
cluster nodes
127.0.0.1:6381> cluster nodes
7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382@16382 master - 0 1700745136235 2 connected 5461-10922
7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381@16381 myself,master - 0 1700745135000 1 connected 0-5460
ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383@16383 master - 0 1700745137242 3 connected 10923-16383
9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384@16384 slave ed4bea7210969391e54fe5334c685b76263c4e85 0 1700745135000 3 connected
510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386@16386 slave 7874b26214a08a6816cd2aaada241d84d3d12880 0 1700745134220 2 connected
2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385@16385 slave 7130be699c2d6970c4824efa69047adc85375d65 0 1700745135228 1 connected
主從容錯切換遷移案例
- 數(shù)據(jù)讀寫存儲宝冕,由于是集群環(huán)境行疏,因此需要加-c參數(shù)智末,用于自動路由到對應(yīng)節(jié)點(diǎn)
redis-cli -c -p 6381
root@test:/data# redis-cli -c -p 6381
127.0.0.1:6381> set k1 v1
-> Redirected to slot [12706] located at 192.168.223.135:6383
OK
192.168.223.135:6383> set k2 v2
-> Redirected to slot [449] located at 192.168.223.135:6381
OK
192.168.223.135:6381> get k1
-> Redirected to slot [12706] located at 192.168.223.135:6383
"v1"
192.168.223.135:6383> get k2
-> Redirected to slot [449] located at 192.168.223.135:6381
"v2"
192.168.223.135:6381> get k1
-> Redirected to slot [12706] located at 192.168.223.135:6383
"v1"
192.168.223.135:6383> get k1
"v1"
- 集群檢查
redis-cli --cluster check 192.168.223.135:6381
root@test:/data# redis-cli --cluster check 192.168.223.135:6381
192.168.223.135:6381 (7130be69...) -> 2 keys | 5461 slots | 1 slaves.
192.168.223.135:6382 (7874b262...) -> 1 keys | 5462 slots | 1 slaves.
192.168.223.135:6383 (ed4bea72...) -> 1 keys | 5461 slots | 1 slaves.
[OK] 4 keys in 3 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 192.168.223.135:6381)
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[0-5460] (5461 slots) master
1 additional replica(s)
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[5461-10922] (5462 slots) master
1 additional replica(s)
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[10923-16383] (5461 slots) master
1 additional replica(s)
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
S: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots: (0 slots) slave
replicates 7130be699c2d6970c4824efa69047adc85375d65
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
- 主從切換(主從容錯遷移)哨鸭,將6381停止有咨,檢測6381的slave6385是否變成master
[root@test ~]# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
75802596bb67 redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-6
c41b787f923c redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-5
6b67d6956c48 redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-4
8f4d3d46f060 redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-3
ec77cdc1af2a redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-2
9b3f843d9982 redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-1
停止6381
[root@test ~]# docker stop redis-node-1
redis-node-1
[root@test ~]# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
75802596bb67 redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-6
c41b787f923c redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-5
6b67d6956c48 redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-4
8f4d3d46f060 redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-3
ec77cdc1af2a redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-2
查看集群狀態(tài)
root@test:/data# redis-cli --cluster check 192.168.223.135:6383
Could not connect to Redis at 192.168.223.135:6381: Connection refused
192.168.223.135:6383 (ed4bea72...) -> 1 keys | 5461 slots | 1 slaves.
192.168.223.135:6385 (2c2fdb0a...) -> 2 keys | 5461 slots | 0 slaves.
192.168.223.135:6382 (7874b262...) -> 1 keys | 5462 slots | 1 slaves.
[OK] 4 keys in 3 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 192.168.223.135:6383)
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[10923-16383] (5461 slots) master
1 additional replica(s)
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
M: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots:[0-5460] (5461 slots) master
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[5461-10922] (5462 slots) master
1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
發(fā)現(xiàn)6385由slave變?yōu)閙aster了
再次啟動6381
[root@test ~]# docker start redis-node-1
redis-node-1
查看集群狀態(tài)
root@test:/data# redis-cli --cluster check 192.168.223.135:6383
192.168.223.135:6383 (ed4bea72...) -> 1 keys | 5461 slots | 1 slaves.
192.168.223.135:6385 (2c2fdb0a...) -> 2 keys | 5461 slots | 1 slaves.
192.168.223.135:6382 (7874b262...) -> 1 keys | 5462 slots | 1 slaves.
[OK] 4 keys in 3 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 192.168.223.135:6383)
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[10923-16383] (5461 slots) master
1 additional replica(s)
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
S: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots: (0 slots) slave
replicates 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9
M: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots:[0-5460] (5461 slots) master
1 additional replica(s)
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[5461-10922] (5462 slots) master
1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
發(fā)現(xiàn)6381變?yōu)?385的slave了酱固,如果想讓6381變?yōu)閙aster 可以將6385停止后重新啟動
擴(kuò)容節(jié)點(diǎn)
- 新建6387械念、6388節(jié)點(diǎn)
docker run -d --name redis-node-7 --net host --privileged=true -v /data/redis/share/redis-node-7:/data redis:6.0.8 --cluster-enabled yes --appendonly yes --port 6387
docker run -d --name redis-node-8 --net host --privileged=true -v /data/redis/share/redis-node-8:/data redis:6.0.8 --cluster-enabled yes --appendonly yes --port 6388
[root@test ~]# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
696436d25a81 redis:6.0.8 "docker-entrypoint.s…" 3 seconds ago Up 2 seconds redis-node-8
8ba5919bb9ba redis:6.0.8 "docker-entrypoint.s…" 4 seconds ago Up 4 seconds redis-node-7
75802596bb67 redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-6
6b67d6956c48 redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-4
8f4d3d46f060 redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-3
ec77cdc1af2a redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up About an hour redis-node-2
9b3f843d9982 redis:6.0.8 "docker-entrypoint.s…" About an hour ago Up 8 minutes redis-node-1
- 進(jìn)入節(jié)點(diǎn)7容器 將6387節(jié)點(diǎn)加入集群
docker exec -it redis-node-7 bash
將新增的6387作為master節(jié)點(diǎn)加入集群
redis-cli --cluster add-node 自己實(shí)際IP地址:6387 自己實(shí)際IP地址:6381
6387 就是將要作為master新增節(jié)點(diǎn)
6381 就是原來集群節(jié)點(diǎn)里面的領(lǐng)路人,相當(dāng)于6387拜拜6381的碼頭從而找到組織加入集群
root@test:/data# redis-cli --cluster add-node 192.168.223.135:6387 192.168.223.135:6381
>>> Adding node 192.168.223.135:6387 to cluster 192.168.223.135:6381
Could not connect to Redis at 192.168.223.135:6385: Connection refused
>>> Performing Cluster Check (using node 192.168.223.135:6381)
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[0-5460] (5461 slots) master
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[5461-10922] (5462 slots) master
1 additional replica(s)
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[10923-16383] (5461 slots) master
1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
>>> Send CLUSTER MEET to node 192.168.223.135:6387 to make it join the cluster.
[OK] New node added correctly.
查看集群狀態(tài)运悲,加入成功龄减,但是槽位為0
root@test:/data# redis-cli --cluster check 192.168.223.135:6383
192.168.223.135:6383 (ed4bea72...) -> 1 keys | 5461 slots | 1 slaves.
192.168.223.135:6381 (7130be69...) -> 2 keys | 5461 slots | 1 slaves.
192.168.223.135:6387 (ec07e09e...) -> 0 keys | 0 slots | 0 slaves.
192.168.223.135:6382 (7874b262...) -> 1 keys | 5462 slots | 1 slaves.
[OK] 4 keys in 4 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 192.168.223.135:6383)
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[10923-16383] (5461 slots) master
1 additional replica(s)
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[0-5460] (5461 slots) master
1 additional replica(s)
M: ec07e09e0c98c7fac6db05728f4a8236dfc25b65 192.168.223.135:6387
slots: (0 slots) master
S: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots: (0 slots) slave
replicates 7130be699c2d6970c4824efa69047adc85375d65
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[5461-10922] (5462 slots) master
1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
- 重新分派槽號:命令:redis-cli --cluster reshard ip地址:端口號
root@test:/data# redis-cli --cluster reshard 192.168.223.135:6381
>>> Performing Cluster Check (using node 192.168.223.135:6381)
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[0-5460] (5461 slots) master
1 additional replica(s)
S: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots: (0 slots) slave
replicates 7130be699c2d6970c4824efa69047adc85375d65
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
M: ec07e09e0c98c7fac6db05728f4a8236dfc25b65 192.168.223.135:6387
slots: (0 slots) master 該節(jié)點(diǎn)沒有槽號,需要分配
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[5461-10922] (5462 slots) master
1 additional replica(s)
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[10923-16383] (5461 slots) master
1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
How many slots do you want to move (from 1 to 16384)? 4096 AA分=16384/4(節(jié)點(diǎn)數(shù))
What is the receiving node ID? ec07e09e0c98c7fac6db05728f4a8236dfc25b65 這里填需要分配的節(jié)點(diǎn)id號
Please enter all the source node IDs.
Type 'all' to use all the nodes as source nodes for the hash slots.
Type 'done' once you entered all the source nodes IDs.
Source node #1: all
......
Do you want to proceed with the proposed reshard plan (yes/no)? yes
執(zhí)行完畢后班眯,檢測集群狀態(tài)
root@test:/data# redis-cli --cluster check 192.168.223.135:6383
192.168.223.135:6383 (ed4bea72...) -> 1 keys | 4096 slots | 1 slaves.
192.168.223.135:6381 (7130be69...) -> 1 keys | 4096 slots | 1 slaves.
192.168.223.135:6387 (ec07e09e...) -> 1 keys | 4096 slots | 0 slaves.
192.168.223.135:6382 (7874b262...) -> 1 keys | 4096 slots | 1 slaves.
[OK] 4 keys in 4 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 192.168.223.135:6383)
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[12288-16383] (4096 slots) master
1 additional replica(s)
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[1365-5460] (4096 slots) master
1 additional replica(s)
M: ec07e09e0c98c7fac6db05728f4a8236dfc25b65 192.168.223.135:6387
slots:[0-1364],[5461-6826],[10923-12287] (4096 slots) master 該節(jié)點(diǎn)已經(jīng)成功分配槽位
為什么6387是3個新的區(qū)間希停,重新分配成本太高,所以前3家各自勻出來一部分署隘,從6381/6382/6383三個舊節(jié)點(diǎn)分別勻出1364個坑位給新節(jié)點(diǎn)6387
S: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots: (0 slots) slave
replicates 7130be699c2d6970c4824efa69047adc85375d65
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[6827-10922] (4096 slots) master
1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
- 為主節(jié)點(diǎn)6387分配從節(jié)點(diǎn)6388
命令: redis-cli --cluster add-node ip:新slave端口 ip:新master端口 --cluster-slave --cluster-master-id 新主機(jī)節(jié)點(diǎn)ID
root@test:/data# redis-cli --cluster add-node 192.168.223.135:6388 192.168.223.135:6387 --cluster-slave --cluster-master-id ec07e09e0c98c7fac6db05728f4a8236dfc25b65
>>> Adding node 192.168.223.135:6388 to cluster 192.168.223.135:6387
>>> Performing Cluster Check (using node 192.168.223.135:6387)
M: ec07e09e0c98c7fac6db05728f4a8236dfc25b65 192.168.223.135:6387
slots:[0-1364],[5461-6826],[10923-12287] (4096 slots) master
S: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots: (0 slots) slave
replicates 7130be699c2d6970c4824efa69047adc85375d65
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[6827-10922] (4096 slots) master
1 additional replica(s)
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[12288-16383] (4096 slots) master
1 additional replica(s)
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[1365-5460] (4096 slots) master
1 additional replica(s)
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
>>> Send CLUSTER MEET to node 192.168.223.135:6388 to make it join the cluster.
Waiting for the cluster to join
>>> Configure node as replica of 192.168.223.135:6387.
[OK] New node added correctly.
檢查集群狀態(tài)
root@test:/data# redis-cli --cluster check 192.168.223.135:6383
192.168.223.135:6383 (ed4bea72...) -> 1 keys | 4096 slots | 1 slaves.
192.168.223.135:6381 (7130be69...) -> 1 keys | 4096 slots | 1 slaves.
192.168.223.135:6387 (ec07e09e...) -> 1 keys | 4096 slots | 1 slaves.
192.168.223.135:6382 (7874b262...) -> 1 keys | 4096 slots | 1 slaves.
[OK] 4 keys in 4 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 192.168.223.135:6383)
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[12288-16383] (4096 slots) master
1 additional replica(s)
S: 06392a32a424b1823e818fcc4c25985ae2e9e51b 192.168.223.135:6388
slots: (0 slots) slave slave已經(jīng)成功加入6387
replicates ec07e09e0c98c7fac6db05728f4a8236dfc25b65
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[1365-5460] (4096 slots) master
1 additional replica(s)
M: ec07e09e0c98c7fac6db05728f4a8236dfc25b65 192.168.223.135:6387
slots:[0-1364],[5461-6826],[10923-12287] (4096 slots) master
1 additional replica(s)
S: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots: (0 slots) slave
replicates 7130be699c2d6970c4824efa69047adc85375d65
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[6827-10922] (4096 slots) master
1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
縮容節(jié)點(diǎn)
- 目的:6387和6388下線
- 邏輯:檢查集群狀態(tài)宠能,先刪除縮容節(jié)點(diǎn)對應(yīng)的slave節(jié)點(diǎn)6388,再將縮容節(jié)點(diǎn)6387槽號清空磁餐,重新分配违崇,本例子將清出來的槽號都給6381,再次檢查集群诊霹,刪除6387羞延,檢差集群
root@test:/data# redis-cli --cluster check 192.168.223.135:6388
192.168.223.135:6387 (ec07e09e...) -> 1 keys | 4096 slots | 1 slaves.
192.168.223.135:6381 (7130be69...) -> 1 keys | 4096 slots | 1 slaves.
192.168.223.135:6383 (ed4bea72...) -> 1 keys | 4096 slots | 1 slaves.
192.168.223.135:6382 (7874b262...) -> 1 keys | 4096 slots | 1 slaves.
[OK] 4 keys in 4 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 192.168.223.135:6388)
S: 06392a32a424b1823e818fcc4c25985ae2e9e51b 192.168.223.135:6388
slots: (0 slots) slave
replicates ec07e09e0c98c7fac6db05728f4a8236dfc25b65
M: ec07e09e0c98c7fac6db05728f4a8236dfc25b65 192.168.223.135:6387
slots:[0-1364],[5461-6826],[10923-12287] (4096 slots) master
1 additional replica(s)
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[1365-5460] (4096 slots) master
1 additional replica(s)
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[12288-16383] (4096 slots) master
1 additional replica(s)
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[6827-10922] (4096 slots) master
1 additional replica(s)
S: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots: (0 slots) slave
replicates 7130be699c2d6970c4824efa69047adc85375d65
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
可以發(fā)現(xiàn)6388的id為06392a32a424b1823e818fcc4c25985ae2e9e51b
- 刪除6388節(jié)點(diǎn)
命令: redis-cli --cluster del-node ip:從機(jī)端口 從機(jī)6388節(jié)點(diǎn)ID
root@test:/data# redis-cli --cluster del-node 192.168.223.135:6388 06392a32a424b1823e818fcc4c25985ae2e9e51b
>>> Removing node 06392a32a424b1823e818fcc4c25985ae2e9e51b from cluster 192.168.223.135:6388
>>> Sending CLUSTER FORGET messages to the cluster...
>>> Sending CLUSTER RESET SOFT to the deleted node.
檢查集群
root@test:/data# redis-cli --cluster check 192.168.223.135:6383
192.168.223.135:6383 (ed4bea72...) -> 1 keys | 4096 slots | 1 slaves.
192.168.223.135:6381 (7130be69...) -> 1 keys | 4096 slots | 1 slaves.
192.168.223.135:6387 (ec07e09e...) -> 1 keys | 4096 slots | 0 slaves.
192.168.223.135:6382 (7874b262...) -> 1 keys | 4096 slots | 1 slaves.
[OK] 4 keys in 4 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 192.168.223.135:6383)
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[12288-16383] (4096 slots) master
1 additional replica(s)
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[1365-5460] (4096 slots) master
1 additional replica(s)
M: ec07e09e0c98c7fac6db05728f4a8236dfc25b65 192.168.223.135:6387
slots:[0-1364],[5461-6826],[10923-12287] (4096 slots) master
S: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots: (0 slots) slave
replicates 7130be699c2d6970c4824efa69047adc85375d65
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[6827-10922] (4096 slots) master
1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
發(fā)現(xiàn)已經(jīng)沒有6388節(jié)點(diǎn)了 刪除成功
- 再將縮容節(jié)點(diǎn)6387槽號清空,重新分配脾还,本例子將清出來的槽號都給6381
root@test:/data# redis-cli --cluster reshard 192.168.223.135:6381
>>> Performing Cluster Check (using node 192.168.223.135:6381)
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[1365-5460] (4096 slots) master
1 additional replica(s)
S: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots: (0 slots) slave
replicates 7130be699c2d6970c4824efa69047adc85375d65
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
M: ec07e09e0c98c7fac6db05728f4a8236dfc25b65 192.168.223.135:6387
slots:[0-1364],[5461-6826],[10923-12287] (4096 slots) master
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[6827-10922] (4096 slots) master
1 additional replica(s)
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[12288-16383] (4096 slots) master
1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
How many slots do you want to move (from 1 to 16384)? 4096 將要移動的槽位 6387的槽位為4096,
What is the receiving node ID? 7130be699c2d6970c4824efa69047adc85375d65 將槽位移動給誰伴箩,我們移動到6381中,指定6381的id
Please enter all the source node IDs.
Type 'all' to use all the nodes as source nodes for the hash slots.
Type 'done' once you entered all the source nodes IDs.
Source node #1: ec07e09e0c98c7fac6db05728f4a8236dfc25b65 槽位來源鄙漏,6387的id
Source node #2: done
......
Do you want to proceed with the proposed reshard plan (yes/no)? yes
- 檢查集群
root@test:/data# redis-cli --cluster check 192.168.223.135:6383
192.168.223.135:6383 (ed4bea72...) -> 1 keys | 4096 slots | 1 slaves.
192.168.223.135:6381 (7130be69...) -> 2 keys | 8192 slots | 1 slaves.
192.168.223.135:6387 (ec07e09e...) -> 0 keys | 0 slots | 0 slaves. 空槽位
192.168.223.135:6382 (7874b262...) -> 1 keys | 4096 slots | 1 slaves.
[OK] 4 keys in 4 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 192.168.223.135:6383)
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[12288-16383] (4096 slots) master
1 additional replica(s)
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[0-6826],[10923-12287] (8192 slots) master 槽位增加了
1 additional replica(s)
M: ec07e09e0c98c7fac6db05728f4a8236dfc25b65 192.168.223.135:6387
slots: (0 slots) master 空槽位
S: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots: (0 slots) slave
replicates 7130be699c2d6970c4824efa69047adc85375d65
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[6827-10922] (4096 slots) master
1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
- 移除6387節(jié)點(diǎn)
命令: redis-cli --cluster del-node ip:端口 節(jié)點(diǎn)ID
root@test:/data# redis-cli --cluster del-node 192.168.223.135:6387 ec07e09e0c98c7fac6db05728f4a8236dfc25b65
>>> Removing node ec07e09e0c98c7fac6db05728f4a8236dfc25b65 from cluster 192.168.223.135:6387
>>> Sending CLUSTER FORGET messages to the cluster...
>>> Sending CLUSTER RESET SOFT to the deleted node.
- 檢查集群
root@test:/data# redis-cli --cluster check 192.168.223.135:6383
192.168.223.135:6383 (ed4bea72...) -> 1 keys | 4096 slots | 1 slaves.
192.168.223.135:6381 (7130be69...) -> 2 keys | 8192 slots | 1 slaves.
192.168.223.135:6382 (7874b262...) -> 1 keys | 4096 slots | 1 slaves.
[OK] 4 keys in 3 masters.
0.00 keys per slot on average.
>>> Performing Cluster Check (using node 192.168.223.135:6383)
M: ed4bea7210969391e54fe5334c685b76263c4e85 192.168.223.135:6383
slots:[12288-16383] (4096 slots) master
1 additional replica(s)
S: 510af78ad32df6fa5cfd51dff27d3bef53bda01b 192.168.223.135:6386
slots: (0 slots) slave
replicates 7874b26214a08a6816cd2aaada241d84d3d12880
S: 9712b4047d92f217131b5ff8d3e42448be817bcb 192.168.223.135:6384
slots: (0 slots) slave
replicates ed4bea7210969391e54fe5334c685b76263c4e85
M: 7130be699c2d6970c4824efa69047adc85375d65 192.168.223.135:6381
slots:[0-6826],[10923-12287] (8192 slots) master
1 additional replica(s)
S: 2c2fdb0a6a24a7972e5e66ee5eeabefbc139f5b9 192.168.223.135:6385
slots: (0 slots) slave
replicates 7130be699c2d6970c4824efa69047adc85375d65
M: 7874b26214a08a6816cd2aaada241d84d3d12880 192.168.223.135:6382
slots:[6827-10922] (4096 slots) master
1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.