flink
文檔
https://flink.apache.org/
下載flink包
https://dlcdn.apache.org/flink/flink-1.14.4/flink-1.14.4-bin-scala_2.12.tgz
下載驅(qū)動(dòng)
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/table/jdbc/
連接器包：
https://repo.maven.apache.org/maven2/org/apache/flink/flink-connector-jdbc_2.12/1.14.4/flink-connector-jdbc_2.12-1.14.4.jar
驅(qū)動(dòng)包：
https://repo.maven.apache.org/maven2/mysql/mysql-connector-java/8.0.28/mysql-connector-java-8.0.28.jar
doris
文檔
https://doris.apache.org/zh-CN/downloads/downloads.html
下載
https://www.apache.org/dyn/closer.cgi/incubator/doris/1.0/1.0.0-incubating/apache-doris-1.0.0-incubating-bin.tar.gz
部署
https://doris.apache.org/zh-CN/installing/install-deploy.html#%E9%9B%86%E7%BE%A4%E9%83%A8%E7%BD%B2
編譯安裝connector包
下載flink-connector源碼
https://doris.apache.org/zh-CN/extending-doris/flink-doris-connector.html#%E7%89%88%E6%9C%AC%E5%85%BC%E5%AE%B9
切換tag：1.14.3-2.12-1.0.2
修改一下代碼
29:<version>1.14.4-2.12-1.0.2</version>
43:<tag>1.14.4-2.12-1.0.2</tag>
65:<flink.version>1.14.4</flink.version>
72:<thrift.binary>/usr/local/bin/thrift</thrift.binary>
替換 ${scala.version} -> 2.12
替換 ${flink.version} -> 1.14.4
添加
302: <scalaVersion>2.12</scalaVersion> <!-- Scala version is detected from dependency to scala-library -->
安裝
brew install thrift@0.13.0
Thrift version 0.13.0
添加：custom_env.sh
export THRIFT_BIN=/usr/local/bin/thrift
export MVN_BIN=/Users/zeal/soft/apache-maven-3.6.3/bin/mvn
export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8.0_201.jdk/Contents/Home
打包：sh build.sh --flink 1.14.4 --scala 2.12
復(fù)制到flink lib目錄
metabase
文檔
https://www.metabase.com/docs/latest/operations-guide/installing-metabase.html
wget https://downloads.metabase.com/v0.42.4/metabase.jar
java -jar metabase.jar
處理數(shù)據(jù)
https://mp.weixin.qq.com/s/ssXocqCyoSVuRFBi2hzCKQ
創(chuàng)建docker鏡像
docker commit -a "chenmingang" -m "bi" 0f618597cc58 bi:2.0
docker network create --driver bridge --subnet=172.17.0.0/16 --gateway=172.17.1.1 mynet
docker run -it -p 9030:9030 -p 8081:8081 -p 8030:8030 -p 3000:3000 --network=mynet --ip 172.17.0.3 bi:2.0
