ETL是什么
數(shù)據(jù)抽取拍嵌、轉(zhuǎn)換和加載(Extraction-Transformation-Loading)
1.數(shù)據(jù)抽取
ODI是指Oracle Data Integrator ,oracle提供的ETL工具骡送,可以實(shí)現(xiàn)跨數(shù)據(jù)庫(kù)抽取數(shù)據(jù)盟步。
對(duì)于非數(shù)據(jù)庫(kù)數(shù)據(jù)蓖康,可以使用程序進(jìn)行推送庶骄,通過(guò)定時(shí)任務(wù)陕悬,使用程序讀取數(shù)據(jù)碴犬,插入到數(shù)據(jù)倉(cāng)庫(kù)對(duì)應(yīng)表中
2.轉(zhuǎn)換
說(shuō)到轉(zhuǎn)換絮宁,就要說(shuō)明一下數(shù)據(jù)倉(cāng)庫(kù)分層
ODS層: 存儲(chǔ)明細(xì)數(shù)據(jù)
DW層 :存儲(chǔ)輕度匯總的數(shù)據(jù)
DM成:存儲(chǔ)高度匯總的數(shù)據(jù)
DIM層:存儲(chǔ)參數(shù)表所有的版本數(shù)據(jù),具有參數(shù)版本的有效日期范圍
數(shù)據(jù)轉(zhuǎn)換服协,是指將業(yè)務(wù)數(shù)據(jù)進(jìn)行加工绍昂,比如日期格式,指標(biāo)等,轉(zhuǎn)換成數(shù)據(jù)庫(kù)需要的形式窘游,然后加載到數(shù)據(jù)倉(cāng)庫(kù)的ODS層表
創(chuàng)建DBLINK
-- Create database link
create database link sourcepdb
connect to source-dw identified by 123
using '(DESCRIPTION = (ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = IP)(PORT = 1521)))
(CONNECT_DATA = (SERVICE_NAME = sourcepdb)))';
持續(xù)更新中...