1、MYSQL 主從復(fù)制(單活)
2、雙主(單活)倍啥,failover比單主簡(jiǎn)單
3耸三、雙主配san存儲(chǔ)(單活)
4、DRBD雙主配DRBD(單活)
5捣炬、NDB CLUSTER
6熊昌、第三方的Tungsten
7、網(wǎng)易的INNOSQL
實(shí)驗(yàn)mysql 主從復(fù)制
1湿酸、從服務(wù)器發(fā)起對(duì)主服務(wù)器連接同步請(qǐng)求婿屹,主服務(wù)器驗(yàn)證連接。
2推溃、主服務(wù)器為從服務(wù)器單獨(dú)開(kāi)啟一個(gè)線程昂利。
3、從服務(wù)器將自身(Read_Master_Log_Pos)記錄位置點(diǎn)告訴主服務(wù)器铁坎,(show slave status;查看)
4蜂奸、主服務(wù)器將從服務(wù)器傳遞過(guò)來(lái)的位置記錄點(diǎn)與自身二進(jìn)制日志記錄位置進(jìn)行比較,是否少于
5厢呵、如果小于窝撵,則通知從服務(wù)器來(lái)拉取數(shù)據(jù)。
6襟铭、從服務(wù)器持續(xù)到主服務(wù)器讀取數(shù)據(jù)碌奉,直至取完,從服務(wù)線程與主服務(wù)器同步的線程進(jìn)入睡眠寒砖。
7赐劣、當(dāng)主服務(wù)器有更新時(shí),主服務(wù)器線程被激活哩都,并將二進(jìn)制日志推送給從服務(wù)器魁兼,并通知從服務(wù)器線程開(kāi)始工作
8、從服務(wù)器的sql線程執(zhí)行中繼日志漠嵌。
實(shí)驗(yàn)環(huán)境:
centos 6 + mariadb 10
master: hostname node1 ip 192.168.1.154
slave1: hostname node2 ip 192.168.3.6
slave2: hostname node3 ip 192.168.10.27
同步過(guò)程:
master(二進(jìn)制日志) <--- slave1(二進(jìn)制日志+中繼日志) <--- slave2(中繼日志)
系統(tǒng)準(zhǔn)備:
~]# ntpdate pool.ntp.org
~]# getenforce
Disabled
~]# iptables -F
準(zhǔn)備ssh互信(三臺(tái)主機(jī)一樣)
~]# ssh-keygen -t rsa
~]# ssh-copy-id -i .ssh/id_rsa.pub root@192.168.1.154
~]# ssh-copy-id -i .ssh/id_rsa.pub root@192.168.3.6
~]# ssh-copy-id -i .ssh/id_rsa.pub root@192.168.10.27
準(zhǔn)備hosts文件
~]# cat /etc/hosts
192.168.1.154 node1
192.168.3.6 node2
192.168.10.27 node3
復(fù)制到其他節(jié)點(diǎn)
scp /etc/hosts root@node2:/etc/hosts
scp /etc/hosts root@node3:/etc/hosts
安裝Mariadb(二進(jìn)制安裝包方式)
data]# pwd
/data
data]# scp mariadb-10.0.10-linux-x86_64.tar.gz root@node2:/data/
data]# tar xf mariadb-10.0.10-linux-x86_64.tar.gz -C /usr/local/
data]# useradd mysql -s /sbin/nologin -M
data]# mkdir -p /data/mysql/{data,binlogs}
data]# chown -R mysql.mysql /data/mysql/*
local]# ln -sv mariadb-10.0.10-linux-x86_64 /usr/local/mysql
local]# chown -R root.mysql mysql/*
mysql]# cp support-files/mysql.server /etc/rc.d/init.d/mysqld
mysql]# mv /etc/my.cnf{,.bk}
mysql]# cp support-files/my-large.cnf /etc/my.cnf
mysql]# ./scripts/mysql_install_db --user=mysql --datadir=/data /mysql/data --basedir=/usr/local/mysql //初始化數(shù)據(jù)庫(kù)
mysql]# chkconfig --add mysqld
mysql]# chkconfig mysqld on
master編輯配置文件:
vim /etc/my.cnf
[mysqld]
...
server-id = 1
log-bin=/data/mysql/binlogs/mysql-bin
thread_concurrency = 2
datadir=/data/mysql/data
basedir=/usr/local/mysql
innodb-file-per-table=on
skip-name-resolve=on
replicate_wild_ignore_table=test1.%
...
創(chuàng)建兩個(gè)數(shù)據(jù)庫(kù)testdb,testdb1 模擬目前是采用一臺(tái)mysql運(yùn)行咐汞。
MariaDB [(none)]> create database testdb;
MariaDB [(none)]> create database testdb1;
MariaDB [(none)]> create table testdb.info(id int primary key ,name varchar(20),age int );
MariaDB [testdb]> insert into info values(1,"neo",27);
MariaDB [testdb]> insert into info values(2,"andy",30);
MariaDB [testdb]> insert into info values(3,"super",100);
以上可以模擬正常生成環(huán)境的單臺(tái)數(shù)據(jù)庫(kù),此時(shí)業(yè)務(wù)數(shù)據(jù)比較重要儒鹿,考慮添加從數(shù)據(jù)庫(kù)化撕,以保護(hù)數(shù)據(jù)。
準(zhǔn)備從數(shù)據(jù)庫(kù)slave1(node2)约炎,
同樣的進(jìn)行數(shù)據(jù)庫(kù)安裝植阴,準(zhǔn)備配置文件蟹瘾,數(shù)據(jù)存儲(chǔ)目錄,日志文件存儲(chǔ)目錄掠手,以及初始化憾朴,開(kāi)啟二進(jìn)制日志和中繼日志
server-id = 2
thread_concurrency = 2
datadir=/data/mysql/data
basedir=/usr/local/mysql
innodb-file-per-table=on
skip-name-resolve=on
replicate_wild_ignore_table=testdb1.% //跨數(shù)據(jù)庫(kù)更新操作也能同步
log-bin=/data/mysql/binlogs/mysql-bin
log-bin-index=/data/mysql/binlogs/mysql-bin.index
relay_log_purge=0
relay_log=/data/mysql/binlogs/mysql-relay-log
relay_log_index=/data/mysql/binlogs/mysql-relay-log.index
log_slave_updates=on //開(kāi)啟從服務(wù)器更新數(shù)據(jù)時(shí)寫入自己的二進(jìn)制日志文件
啟動(dòng)mysql服務(wù)
service mysqld start
回到master主數(shù)據(jù)庫(kù),創(chuàng)建復(fù)制數(shù)據(jù)的mysql賬戶
MariaDB [(none)]> grant replication slave on *.* to 'test'@'%' identified by '123456';
MariaDB [(none)]> flush privileges;
想象一下生成環(huán)境喷鸽,數(shù)據(jù)庫(kù)運(yùn)行N年众雷,數(shù)據(jù)量很多,此時(shí)來(lái)做mysql主從魁衙,我們肯定不能從最開(kāi)始位置進(jìn)行復(fù)制报腔,很早之前二進(jìn)制日志可能不存在,我們需要先進(jìn)行數(shù)據(jù)庫(kù)備份剖淀,然后將備份在從數(shù)據(jù)庫(kù)恢復(fù)纯蛾,接著從數(shù)據(jù)庫(kù)在從備份記錄點(diǎn)開(kāi)始復(fù)制。
那么問(wèn)題又來(lái)了纵隔,數(shù)據(jù)庫(kù)目前在線上生產(chǎn)翻诉,如何備份同時(shí)記錄二進(jìn)制日志的記錄位置?
1捌刮、可以停下業(yè)務(wù)碰煌,先備份,記錄位置绅作。時(shí)間長(zhǎng)芦圾。
2、采用Xtrabackup備份工具俄认,比較靠譜个少。
數(shù)據(jù)庫(kù)備份:
mysqldump --database testdb > testdb.sql
記錄二進(jìn)制日志記錄點(diǎn)
MariaDB [(none)]> show master status;
mysql-bin.000003 1438
在從庫(kù)slave1進(jìn)行恢復(fù)
data]# scp testdb.sql root@node2:/data/
slave1進(jìn)行恢復(fù)
data]# mysql < testdb.sql
slave1 配置進(jìn)行數(shù)據(jù)庫(kù)同步
MariaDB [(none)]> change master to master_host='192.168.1.154',master_user='test',master_password='123456',master_log_file="mysql-bin.000003",master_log_pos=1438;
MariaDB [(none)]> show slave status\G
*************************** 1. row ***************************
Slave_IO_State:
Master_Host: 192.168.1.154
Master_User: test
Master_Port: 3306
Connect_Retry: 60
Master_Log_File: mysql-bin.000003
Read_Master_Log_Pos: 1438
Relay_Log_File: mysql-relay-log.000001
Relay_Log_Pos: 4
Relay_Master_Log_File: mysql-bin.000003
Slave_IO_Running: No
Slave_SQL_Running: No
MariaDB [(none)]> start slave;
Slave_IO_Running: Yes
Slave_SQL_Running: Yes
Replicate_Wild_Ignore_Table: testdb1.%
此時(shí)在master上在進(jìn)行插入數(shù)據(jù)
MariaDB [testdb]> insert into info values(4,"piter",22);
slava1上確認(rèn)數(shù)據(jù)同步
MariaDB [testdb]> select * from info;
+----+-------+------+
| id | name | age |
+----+-------+------+
| 1 | neo | 27 |
| 2 | andy | 30 |
| 3 | super | 100 |
| 4 | piter | 22 |
+----+-------+------+
可以看到slave1已經(jīng)正常同步master 數(shù)據(jù)庫(kù)了,關(guān)閉slave1的mysql服務(wù)眯杏,在master上新增數(shù)據(jù)夜焦,啟動(dòng)slave1之后,數(shù)據(jù)自動(dòng)同步過(guò)去岂贩。
注意:此時(shí)為了避免認(rèn)為誤操作將在從數(shù)據(jù)庫(kù)進(jìn)行寫操作茫经,需要將從數(shù)據(jù)庫(kù)設(shè)置為只讀,在my.cnf添加如下配置:
read_only=on
=====slave2(node3)從slave1從庫(kù)進(jìn)行同步=====
同樣的進(jìn)行數(shù)據(jù)庫(kù)安裝萎津,準(zhǔn)備配置文件卸伞,數(shù)據(jù)存儲(chǔ)目錄,日志文件存儲(chǔ)目錄锉屈,以及初始化荤傲,開(kāi)啟中繼日志(無(wú)需開(kāi)啟二進(jìn)制日志)
vi /etc/my.cnf
datadir=/data/mysql/data
basedir=/usr/local/mysql
innodb-file-per-table=on
skip-name-resolve=on
# replicate_wild_ignore_table=testdb1.%
# log-bin=mysql-bin
server-id = 3
relay_log_purge=0
relay_log=/data/mysql/binlogs/mysql-relay-log
relay_log_index=/data/mysql/binlogs/mysql-relay-log.index
啟動(dòng)mysql數(shù)據(jù)庫(kù)
service mysqld start
slave1創(chuàng)建復(fù)制同步的帳號(hào)信息
MariaDB [(none)]> grant replication slave on *.* to 'test'@'%' identified by '123456';
slave1進(jìn)行數(shù)據(jù)庫(kù)備份并切記錄二進(jìn)制日志記錄點(diǎn)
data]# mysqldump --database testdb > testdb_slave2.sql
data]# scp testdb_slave2.sql root@node3:/data
MariaDB [(none)]> show master status;
mysql-bin.000002 732
slave2進(jìn)行數(shù)據(jù)庫(kù)恢復(fù)
data]# mysql < testdb_slave2.sql
slave2設(shè)置復(fù)制信息
MariaDB [(none)]> change master to master_host='192.168.3.6',master_user='test',master_password='123456',master_log_file='mysql-bin.000002',master_log_pos=732;
MariaDB [(none)]> start slave;
MariaDB [(none)]> show slave status\G
Slave_IO_Running: Yes
Slave_SQL_Running: Yes
同步復(fù)制正常工作。
slave2 也應(yīng)該開(kāi)啟read_only=on
在master上寫入數(shù)據(jù)測(cè)試部念,會(huì)同時(shí)同步到slave1,slave2上弃酌。
假如master 掛了呢?假如說(shuō)master--slave數(shù)據(jù)完全同步
1儡炼、手動(dòng)配置妓湘,取消read_only,
2、前段將數(shù)據(jù)庫(kù)IP切換到從服務(wù)器IP乌询,