?HBase2.0 啥時(shí)候發(fā)布抡草?好奇寶寶也是期待了很久,曾幾何時(shí)都把stack問“煩”了宝惰,就在2018年4月30日中午足丢,
期待已久的HBase 2.0發(fā)布啦粱腻!
?你是不是也很迫不及待想了解它?這次斩跌,作為一枚HBase搬運(yùn)工绍些,已經(jīng)為你準(zhǔn)備好了一大波 HBase 2.0.0導(dǎo)讀材料,拿走不謝~
?北京時(shí)間2018年4月30日(星期一) 中午12:24耀鸦,HBase的“掌門人”Michael Stack 在Announce Mail List中宣布了HBase 2.0.0 版本正式Release柬批,大家可以開始下載使用了。
拜讀stack大神announce email原文袖订,激動(dòng)人心的時(shí)刻:
The HBase team is happy to announce the immediate availability of Apache
HBase 2.0.0.Apache HBase? is the Hadoop database, a distributed, scalable, big data
store.
To learn more about HBase, see https://hbase.apache.org/.HBase 2.0.0 is our second major release, the first release off the HBase
2.0 line.Please review 'Upgrading from 1.x to 2.x' in the bundled HBase 2.0.0
Reference
Guide before installing or upgrading for a list of notable
incompatibilities, major
changes, and features including a new Region assignment manager ("AMv2"),
a means for configuring the read and/or write path to run off-heap, and an
optional In-Memory Compaction ("IMC", A.K.A "Accordion") facility.According to our adopted Semantic Versioning guidelines[2], we allowed
ourselves make breaking changes in this major version release. For
example, Coprocessors will need to be recast to fit more constrained APIs
and
rolling upgrade of an hbase-1.x install to hbase-2.x without downtime is
(currently)
not possible. That said, a bunch of effort has been expended mitigating the
differences; a hbase-1.x client can perform DML against an hbase-2 cluster.
A
bundled compatibility report showing difference from 1.2.6 may be of help
[3].For the complete list of fixes and improvements, see the included
CHANGES.md
(or online at [1]) andRELEASENOTES.md
.
......
郵件簡(jiǎn)述了HBase 2.0.0 有新版Assignment Manager V2,offhead read/write, in-memory compaction等氮帐。你是不是也很好奇,HBase 2.0 到底還有有哪些features洛姑?https://s.apache.org/hbase-2.0.0-JIRA-changes 上顯示了HBase2.0.0相關(guān)的issue多達(dá)4551個(gè)issue, 這么多改動(dòng)上沐,還有哪些features值得關(guān)注一下呢?
了解
下面整理了一些HBase2.0.0 主要的feature介紹楞艾,更多特性参咙,可以參考上述鏈接:
1.A new Region assignment manager ("AMv2") ,HBASE-14350 , HBASE-14614
AssignmentManager V2基于Procedure V2實(shí)現(xiàn)硫眯,能夠更快速的分配Region蕴侧,維護(hù)的region狀態(tài)機(jī)存儲(chǔ)不再依賴于ZooKeeper。親可以搭建一個(gè)hbase2.0 集群两入,查看ZK節(jié)點(diǎn)列表净宵,已經(jīng)找不到類似region-in-transistion節(jié)點(diǎn)了。
2.Offheaping of Read/Write Path HBASE-11425裹纳,HBASE-15179
讀寫路徑中择葡,使用Offheap區(qū)的內(nèi)存,大大減少GC壓力痊夭,提高穩(wěn)定性刁岸、降低99延時(shí)脏里。細(xì)節(jié)見下面offheap擴(kuò)展閱讀材料她我。
3.In-Memory Compaction HBASE-17343
重新設(shè)計(jì)了CompactingMemStore 替代 DefaultMemStore,數(shù)據(jù)會(huì)在內(nèi)存中事先進(jìn)行合并compact,有效提高后續(xù)常規(guī)compaction的效率番舆。
4.NettyRpcServer HBASE-17263 其實(shí)并不新鮮酝碳,早在1.x 淘寶就有使用,現(xiàn)在2.0 開始默認(rèn)使用NettyRpcServer
使用Netty替代HBase原生的RPC server恨狈,大大提升了HBaseRPC的吞吐能力疏哗,降低了延遲
5.Async Client HBASE-16833 HBASE-15921
Client不在是原來同步等待,而是利用異步RPC機(jī)制禾怠,大大提高Client端請(qǐng)求并發(fā)度返奉,有效提高資源利用率,擴(kuò)大吞吐吗氏。
- Support for MOB (Medium-Sized Objects) HBASE-11339
MOB特性使得HBase支持存儲(chǔ)小于10MB 的中等媒體對(duì)象數(shù)據(jù)芽偏,相比原來直接存儲(chǔ)大對(duì)象插入hbase,其讀寫效率更高弦讽;Mob數(shù)據(jù)存儲(chǔ)還是以hfile格式存儲(chǔ)污尉,兼容HBase現(xiàn)有特性,如snapshot往产、bulkload被碗、replication等。MOB數(shù)據(jù)文件有獨(dú)立的compaction和expire clean機(jī)制仿村,穩(wěn)定性更可控锐朴。
研究
還不過癮?下面還真為熱愛專研的磚友們網(wǎng)羅了一些hbase2.0特性詳細(xì)的擴(kuò)展閱讀蔼囊!都是大神執(zhí)筆的干貨:
1. hbase2.0 in-memory compaction
2. hbase2.0 read replicas 功能介紹
5. hbase2.0 offheap read
? https://issues.apache.org/jira/browse/HBASE-11425
? https://blogs.apache.org/hbase/search?q=offheap
12. HBase 2.0 AMv2
? https://docs.google.com/document/d/1jkIblLGxO4qgjo5lQOhAAypgDfxA_BEfxiPmcgDK0Do/edit
? https://docs.google.com/document/d/1DS44uwadHCbEK5rbx5itcjan-KsBlfQCQYYXB0A_gAM/edit?usp=sharing
官方下載&指南
HBase 2.0.0 安裝包下載地址:
http://www.apache.org/dyn/closer.lua/hbase/2.0.0/
官方閱讀:
- https://s.apache.org/hbase-2.0.0-JIRA-changes 所有hbase2.0相關(guān)的jira包颁,subtask
- http://hbase.apache.org/2.0/book.html#hbase.versioning.post10 最新的HBase 2.0.0官方指南
- http://apache.mirrors.tds.net/hbase/2.0.0/compatibiliity_report_1.2.6vs2.0.0.html 整理了v1.2.6和v2.0.0版本之間的兼容性報(bào)告
其他更多優(yōu)化特性,不一一列舉压真,后續(xù)可能會(huì)由HBase技術(shù)社區(qū)為你帶來更多HBase 2.0細(xì)節(jié)上的特性優(yōu)化文章分享娩嚼。
1. HBase社區(qū)微信群
2. 微信公眾號(hào):
長(zhǎng)按下面的二維碼邀請(qǐng)加入HBase社區(qū)微信群
3. HBase社區(qū)釘釘群: