一兜喻、背景描述
項(xiàng)目發(fā)展到一定的階段伏尼,數(shù)據(jù)庫可能成為訪問性能的一個(gè)瓶頸咆蒿,并且我們發(fā)現(xiàn)數(shù)據(jù)庫的讀寫基本上符合2-8定律,因此有必要對(duì)數(shù)據(jù)庫進(jìn)行主從備份和讀寫分離秩冈,通過擴(kuò)展讀數(shù)據(jù)庫的數(shù)目來橫線的分散讀數(shù)取數(shù)據(jù)的訪問壓力本缠。
在之前的文章中有介紹過Mysql層面的主從復(fù)制的原理以及環(huán)境的搭建,這里不再贅述入问,直接介紹如何對(duì)一個(gè)原來只有一個(gè)讀寫庫的項(xiàng)目進(jìn)行改造搓茬,使其讀寫分離犹赖。
為了最小化項(xiàng)目的改造成本队他,我們自然希望對(duì)于原有的項(xiàng)目的代碼改造量最小卷仑,因此我們考慮通過在dao層對(duì)Mybatis的Executor執(zhí)行語句進(jìn)行攔截:如果是事務(wù)性的操作或者INSERT、UPDATE麸折、DELETE等操作锡凝,則使用主庫(寫庫);如果是SELECT查詢語句垢啼,則使用從庫(讀庫)窜锯。
代碼實(shí)現(xiàn)
在dao package下新增一個(gè)split的子package,在該package下依次編寫如下的三個(gè)類:
2.1 代碼編寫
2.1.1 編寫DynamicDatasource
該類繼承自AbstractRoutingDataSource
芭析,通過復(fù)寫determineCurrentLookupKey()
方法決定使用主庫還是從庫锚扎。
import org.springframework.jdbc.datasource.lookup.AbstractRoutingDataSource;
public class DynamicDataSource extends AbstractRoutingDataSource {
@Override
protected Object determineCurrentLookupKey() {
return DynamicDataSourceHolder.getDbType();
}
}
2.1.2 編寫DynamicDataSourceHolder
該類使用一個(gè)ThreadLocal
的變量用于保存實(shí)現(xiàn)線程安全的主從庫信息的存取。
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
public class DynamicDataSourceHolder {
private static Logger logger = LoggerFactory.getLogger(DynamicDataSourceHolder.class);
public static final String DB_MASTER = "master";
public static final String DB_SLAVE = "slave";
private static ThreadLocal<String> contextHolder = new ThreadLocal<>();
/**
* 獲取線程的dbType
*
* @return
*/
public static String getDbType() {
String db = contextHolder.get();
if (db == null) {
db = DB_MASTER;
}
return db;
}
/**
* 設(shè)置線程的dbType
*
* @param str
*/
public static void setDbType(String str) {
logger.debug("所使用的數(shù)據(jù)源為:" + str);
contextHolder.set(str);
}
/**
* 清理連接類型
*/
public static void clearDbType() {
contextHolder.remove();
}
}
2.1.3 編寫DynamicDatasourceInterceptor
自定義的數(shù)據(jù)源攔截器DynamicDatasourceInterceptor 馁启,繼承自Mybatis的Interceptor攔截器驾孔,用于在Exectutor執(zhí)行時(shí)對(duì)實(shí)際執(zhí)行語句進(jìn)行攔截,確定使用主庫還是從庫惯疙,并且將信息保存到線程安全的DynamicDataSourceHolder
中翠勉,后面在具體確定使用哪個(gè)數(shù)據(jù)源時(shí),會(huì)到DynamicDataSourceHolder
中進(jìn)行查詢霉颠。
import org.apache.ibatis.executor.Executor;
import org.apache.ibatis.executor.keygen.SelectKeyGenerator;
import org.apache.ibatis.mapping.BoundSql;
import org.apache.ibatis.mapping.MappedStatement;
import org.apache.ibatis.mapping.SqlCommandType;
import org.apache.ibatis.plugin.*;
import org.apache.ibatis.session.ResultHandler;
import org.apache.ibatis.session.RowBounds;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
import org.springframework.transaction.support.TransactionSynchronizationManager;
import javax.swing.tree.RowMapper;
import java.util.Locale;
import java.util.Properties;
/**
* Mybatis級(jí)別的攔截器
* <p>
* 該攔截器會(huì)去攔截傳遞進(jìn)來的SQL信息:
* - 如果是INSERT对碌、UPDATE則采用寫數(shù)據(jù)源(Master)
* - 如果是SELECT則采用讀數(shù)據(jù)源(Slave)
*/
@Intercepts({@Signature(type = Executor.class, method = "update", args = {MappedStatement.class, Object.class}),
@Signature(type = Executor.class, method = "query", args = {MappedStatement.class, Object.class, RowBounds.class, ResultHandler.class})})
public class DynamicDatasourceInterceptor implements Interceptor {
private static Logger logger = LoggerFactory.getLogger(DynamicDatasourceInterceptor.class);
private static final String REGEX = ".*insert\\u0020.*|.*delete\\u0020.*|.*update\\u0020.*";
/**
* SQL語句攔截
*
* @param invocation
* @return
* @throws Throwable
*/
@Override
public Object intercept(Invocation invocation) throws Throwable {
String lookupKey = DynamicDataSourceHolder.DB_MASTER;
Object[] objects = invocation.getArgs();
MappedStatement ms = (MappedStatement) objects[0];
// 是否啟用事務(wù)支持,檢測(cè)@Transactional注解是否啟用蒿偎,啟用這里就為true,否則為false
boolean synchronizationActive = TransactionSynchronizationManager.isActualTransactionActive();
if (synchronizationActive != true) {
//讀方法
if (ms.getSqlCommandType().equals(SqlCommandType.SELECT)) {
// selectKey為自增id查詢主鍵(SELECT_LAST_INSERT_ID())方法則使用主庫
if (ms.getId().contains(SelectKeyGenerator.SELECT_KEY_SUFFIX)) {
lookupKey = DynamicDataSourceHolder.DB_MASTER;
} else {
BoundSql boundSql = ms.getSqlSource().getBoundSql(objects[1]);
String sql = boundSql.getSql().toLowerCase(Locale.CHINA).replaceAll("[\\t\\n\\r]", " ");
if (sql.matches(REGEX)) {
lookupKey = DynamicDataSourceHolder.DB_MASTER;
} else {
lookupKey = DynamicDataSourceHolder.DB_SLAVE;
}
}
}
} else {
lookupKey = DynamicDataSourceHolder.DB_MASTER;
}
logger.debug("設(shè)置方法[{}] use [{}] Strategy, SqlCommandType [{}]..", ms.getId(), lookupKey, ms.getSqlCommandType().name());
DynamicDataSourceHolder.setDbType(lookupKey);
return invocation.proceed();
}
/**
* 決定返回本體還是編織好的代理類,
* 代理類會(huì)去調(diào)用intercept方法決定是使用主庫還是從庫
*
* @param target
* @return
*/
@Override
public Object plugin(Object target) {
if (target instanceof Executor) {//Executor是用來支持一系列增刪改查操作的朽们,因此需要對(duì)該對(duì)象進(jìn)行攔截,其他的放過
return Plugin.wrap(target, this);
} else {//返回本體诉位,不做攔截
return target;
}
}
/**
* 做一些相關(guān)的參數(shù)設(shè)置骑脱,不是關(guān)鍵
*
* @param properties
*/
@Override
public void setProperties(Properties properties) {
}
}
2.2 配置變更
原來只有一個(gè)數(shù)據(jù)庫部署在192.168.91.134這臺(tái)機(jī)器上,后面為它在192.168.91.137上配置了一個(gè)從庫不从,訪問的端口惜姐、賬號(hào)、密碼都一樣椿息。
2.2.1 修改數(shù)據(jù)庫配置參數(shù)
原始的jdbc.properties
jdbc.driver=com.mysql.jdbc.Driver
jdbc.url=jdbc:mysql://192.168.91.134:3306/o2o?useUnicode=true&characterEncoding=utf8
jdbc.username=root
jdbc.password=123
修改后的jdbc.properties
jdbc.driver=com.mysql.jdbc.Driver
jdbc.master.url=jdbc:mysql://192.168.91.134:3306/o2o?useUnicode=true&characterEncoding=utf8
jdbc.master.username=root
jdbc.master.password=123
jdbc.slave.url=jdbc:mysql://192.168.91.137:3306/o2o?useUnicode=true&characterEncoding=utf8
jdbc.slave.username=root
jdbc.slave.password=123
2.2.3 修改數(shù)據(jù)源配置
原始的Spring-dao.xml中關(guān)于dataSource的配置:
<!--數(shù)據(jù)庫連接池-->
<bean id="dataSource" class="com.mchange.v2.c3p0.ComboPooledDataSource">
<!--配置連接池屬性-->
<property name="driverClass" value="${jdbc.driver}"/>
<property name="jdbcUrl" value="${jdbc.url}"/>
<property name="user" value="${jdbc.username}"/>
<property name="password" value="${jdbc.password}"/>
<!--c3p0連接池私有屬性-->
<property name="maxPoolSize" value="30"/>
<property name="minPoolSize" value="10"/>
<!--關(guān)閉連接后不自動(dòng)commit-->
<property name="autoCommitOnClose" value="false"/>
<!--獲取連接超時(shí)時(shí)間設(shè)置-->
<property name="checkoutTimeout" value="10000"/>
<!--當(dāng)獲取連接失敗時(shí)重試的次數(shù)-->
<property name="acquireRetryAttempts" value="2"/>
</bean>
修改后的Spring-dao.xml中關(guān)于dataSource的配置:
<!--數(shù)據(jù)庫連接池-->
<bean id="abstractDatasource" abstract="true" class="com.mchange.v2.c3p0.ComboPooledDataSource"
destroy-method="close">
<!--c3p0連接池私有屬性-->
<property name="maxPoolSize" value="30"/>
<property name="minPoolSize" value="10"/>
<!--關(guān)閉連接后不自動(dòng)commit-->
<property name="autoCommitOnClose" value="false"/>
<!--獲取連接超時(shí)時(shí)間設(shè)置-->
<property name="checkoutTimeout" value="10000"/>
<!--當(dāng)獲取連接失敗時(shí)重試的次數(shù)-->
<property name="acquireRetryAttempts" value="2"/>
</bean>
<!--配置主庫連接池屬性-->
<bean id="master" parent="abstractDatasource">
<property name="driverClass" value="${jdbc.driver}"/>
<property name="jdbcUrl" value="${jdbc.master.url}"/>
<property name="user" value="${jdbc.master.username}"/>
<property name="password" value="${jdbc.master.password}"/>
</bean>
<!--配置從庫連接池屬性-->
<bean id="slave" parent="abstractDatasource">
<property name="driverClass" value="${jdbc.driver}"/>
<property name="jdbcUrl" value="${jdbc.slave.url}"/>
<property name="user" value="${jdbc.slave.username}"/>
<property name="password" value="${jdbc.slave.password}"/>
</bean>
<!--
配置動(dòng)態(tài)數(shù)據(jù)源:
這兒的targetDatasources就是路由數(shù)據(jù)源所對(duì)應(yīng)的名稱歹袁。
-->
<bean id="dynamicDatasource" class="com.netease.o2o.dao.split.DynamicDataSource">
<property name="targetDataSources">
<map>
<entry value-ref="master" key="master"></entry>
<entry value-ref="slave" key="slave"></entry>
</map>
</property>
</bean>
<!--延遲懶加載機(jī)制:是在mybatis生成sql語句時(shí)才去執(zhí)行-->
<bean id="dataSource" class="org.springframework.jdbc.datasource.LazyConnectionDataSourceProxy">
<property name="targetDataSource">
<ref bean="dynamicDatasource"/>
</property>
</bean>
三、測(cè)試
3.1 測(cè)試查詢
2018-12-17 16:14:04.859 [main] DEBUG c.n.o2o.dao.split.DynamicDatasourceInterceptor - 設(shè)置方法[com.netease.o2o.dao.AreaDao.findAll] use [master] Strategy, SqlCommandType [SELECT]..
2018-12-17 16:14:04.863 [main] DEBUG com.netease.o2o.dao.split.DynamicDataSourceHolder - 所使用的數(shù)據(jù)源為:slave
2018-12-17 16:14:04.871 [main] DEBUG com.netease.o2o.dao.AreaDao.findAll - ==> Preparing: SELECT area_id,area_name,priority,create_time,last_edit_time FROM tb_area ORDER BY priority DESC
2018-12-17 16:14:04.894 [main] DEBUG com.netease.o2o.dao.AreaDao.findAll - ==> Parameters:
2018-12-17 16:14:04.909 [main] DEBUG com.netease.o2o.dao.AreaDao.findAll - <== Total: 2
3.2 測(cè)試插入
2018-12-17 16:13:09.348 [main] DEBUG c.n.o2o.dao.split.DynamicDatasourceInterceptor - 設(shè)置方法[com.netease.o2o.dao.ShopDao.insertShop] use [master] Strategy, SqlCommandType [INSERT]..
2018-12-17 16:13:09.351 [main] DEBUG com.netease.o2o.dao.split.DynamicDataSourceHolder - 所使用的數(shù)據(jù)源為:master
2018-12-17 16:13:09.357 [main] DEBUG com.netease.o2o.dao.ShopDao.insertShop - ==> Preparing: INSERT INTO tb_shop (owner_id,area_id,shop_category_id,shop_name,shop_description,shop_address,phone,shop_image, priority,create_time,last_edit_time,enable_status,advice) VALUES (?,?,?,?,? ,?,?,?,?,?,?,?,?)
2018-12-17 16:13:09.387 [main] DEBUG com.netease.o2o.dao.ShopDao.insertShop - ==> Parameters: 1(Long), 1(Integer), 1(Long), test(String), test(String), test(String), test(String), (String), 1(Integer), 2018-12-17 16:13:09.336(Timestamp), 2018-12-17 16:13:09.336(Timestamp), 1(Integer), 審核中(String)
2018-12-17 16:13:09.388 [main] DEBUG com.netease.o2o.dao.ShopDao.insertShop - <== Updates: 1