Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
D
DataX
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
risk-feature
DataX
Commits
c6c09310
Commit
c6c09310
authored
Feb 02, 2018
by
mingya.wmy
Committed by
shf
Feb 04, 2018
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Update README.md
parent
7a7967ca
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
43 additions
and
41 deletions
+43
-41
README.md
README.md
+22
-21
introduction.md
introduction.md
+21
-20
No files found.
README.md
View file @
c6c09310
...
...
@@ -16,7 +16,7 @@ DataX本身作为数据同步框架,将不同数据源的同步抽象为从源
# DataX详细介绍
##### 请参考:[DataX-Introduction](https://github.com/alibaba/DataX/
wiki/DataX-Introduction
)
##### 请参考:[DataX-Introduction](https://github.com/alibaba/DataX/
blob/master/introduction.md
)
...
...
@@ -28,31 +28,32 @@ DataX本身作为数据同步框架,将不同数据源的同步抽象为从源
# Support Data Channels
# Support Data Channels
DataX目前已经有了比较全面的插件体系,主流的RDBMS数据库、NOSQL、大数据计算系统都已经接入,目前支持数据如下图,详情请点击:
[
DataX数据源参考指南
](
https://github.com/alibaba/DataX/wiki/DataX-all-data-channels
)
| 类型 | 数据源 | Reader(读) | Writer(写) |文档|
| ------------ | ---------- | :-------: | :-------: |:-------: |
| RDBMS 关系型数据库 | MySQL | √ | √ |!
[
读
](
https://github.com/alibaba/DataX/blob/master/mysqlreader/doc/mysqlreader.md
)
、!
[
写
](
https://github.com/alibaba/DataX/blob/master/mysqlwriter/doc/mysqlwriter.md
)
|
| | Oracle | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | SQLServer | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | PostgreSQL | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | DRDS | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | 达梦 | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | 通用RDBMS(支持所有关系型数据库) | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| 阿里云数仓数据存储 | ODPS | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | ADS | | √ |!
[
读
](
)
、!
[
写
](
)|
| | OSS | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | OCS | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| NoSQL数据存储 | OTS | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | Hbase0.94 | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | Hbase1.1 | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | MongoDB | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| 无结构化数据存储 | TxtFile | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | FTP | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | HDFS | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | Elasticsearch | | √ |!
[
读
](
)
、!
[
写
](
)|
| RDBMS 关系型数据库 | MySQL | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/mysqlreader/doc/mysqlreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/mysqlwriter/doc/mysqlwriter.md
)
|
| | Oracle | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/oraclereader/doc/oraclereader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/oraclewriter/doc/oraclewriter.md
)
|
| | SQLServer | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/sqlserverreader/doc/sqlserverreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/sqlserverwriter/doc/sqlserverwriter.md
)
|
| | PostgreSQL | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/postgresqlreader/doc/postgresqlreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/postgresqlwriter/doc/postgresqlwriter.md
)
|
| | DRDS | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/drdsreader/doc/drdsreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/drdswriter/doc/drdswriter.md
)
|
| | 达梦 | √ | √ |
[
读
](
)
、
[
写
](
)|
| | 通用RDBMS(支持所有关系型数据库) | √ | √ |
[
读
](
)
、
[
写
](
)|
| 阿里云数仓数据存储 | ODPS | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/odpsreader/doc/odpsreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/odpswriter/doc/odpswriter.md
)
|
| | ADS | | √ |
[
写
](
https://github.com/alibaba/DataX/blob/master/adswriter/doc/adswriter.md
)
|
| | OSS | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/ossreader/doc/ossreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/osswriter/doc/osswriter.md
)
|
| | OCS | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/ocsreader/doc/ocsreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/ocswriter/doc/ocswriter.md
)
|
| NoSQL数据存储 | OTS | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/otsreader/doc/otsreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/otswriter/doc/otswriter.md
)
|
| | Hbase0.94 | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/hbase094xreader/doc/hbase094xreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/hbase094xwriter/doc/hbase094xwriter.md
)
|
| | Hbase1.1 | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/hbase11xreader/doc/hbase11xreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/hbase11xwriter/doc/hbase11xwriter.md
)
|
| | MongoDB | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/mongoreader/doc/mongoreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/mongowriter/doc/mongowriter.md
)
|
| | Hive | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/hdfsreader/doc/hdfsreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/hdfswriter/doc/hdfswriter.md
)
|
| 无结构化数据存储 | TxtFile | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/txtfilereader/doc/txtfilereader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/txtfilewriter/doc/txtfilewriter.md
)
|
| | FTP | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/ftpreader/doc/ftpreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/ftpwriter/doc/ftpwriter.md
)
|
| | HDFS | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/hdfsreader/doc/hdfsreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/hdfswriter/doc/hdfswriter.md
)
|
| | Elasticsearch | | √ |
[
写
](
https://github.com/alibaba/DataX/blob/master/elasticsearchwriter/doc/elasticsearchwriter.md
)
|
# 我要开发新的插件
请点击:
[
DataX插件开发宝典
](
xxx
)
...
...
introduction.md
View file @
c6c09310
...
...
@@ -34,25 +34,26 @@ DataX本身作为离线数据同步框架,采用Framework + plugin架构构建
| 类型 | 数据源 | Reader(读) | Writer(写) |文档|
| ------------ | ---------- | :-------: | :-------: |:-------: |
| RDBMS 关系型数据库 | MySQL | √ | √ |!
[
读
](
https://github.com/alibaba/DataX/blob/master/mysqlreader/doc/mysqlreader.md
)
、!
[
写
](
https://github.com/alibaba/DataX/blob/master/mysqlwriter/doc/mysqlwriter.md
)
|
| | Oracle | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | SQLServer | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | PostgreSQL | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | DRDS | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | 达梦 | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | 通用RDBMS(支持所有关系型数据库) | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| 阿里云数仓数据存储 | ODPS | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | ADS | | √ |!
[
读
](
)
、!
[
写
](
)|
| | OSS | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | OCS | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| NoSQL数据存储 | OTS | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | Hbase0.94 | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | Hbase1.1 | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | MongoDB | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| 无结构化数据存储 | TxtFile | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | FTP | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | HDFS | √ | √ |!
[
读
](
)
、!
[
写
](
)|
| | Elasticsearch | | √ |!
[
读
](
)
、!
[
写
](
)|
| RDBMS 关系型数据库 | MySQL | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/mysqlreader/doc/mysqlreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/mysqlwriter/doc/mysqlwriter.md
)
|
| | Oracle | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/oraclereader/doc/oraclereader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/oraclewriter/doc/oraclewriter.md
)
|
| | SQLServer | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/sqlserverreader/doc/sqlserverreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/sqlserverwriter/doc/sqlserverwriter.md
)
|
| | PostgreSQL | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/postgresqlreader/doc/postgresqlreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/postgresqlwriter/doc/postgresqlwriter.md
)
|
| | DRDS | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/drdsreader/doc/drdsreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/drdswriter/doc/drdswriter.md
)
|
| | 达梦 | √ | √ |
[
读
](
)
、
[
写
](
)|
| | 通用RDBMS(支持所有关系型数据库) | √ | √ |
[
读
](
)
、
[
写
](
)|
| 阿里云数仓数据存储 | ODPS | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/odpsreader/doc/odpsreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/odpsswriter/doc/odpswriter.md
)
|
| | ADS | | √ |
[
写
](
https://github.com/alibaba/DataX/blob/master/adswriter/doc/adswriter.md
)
|
| | OSS | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/ossreader/doc/ossreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/osswriter/doc/osswriter.md
)
|
| | OCS | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/ocsreader/doc/ocsreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/ocswriter/doc/ocswriter.md
)
|
| NoSQL数据存储 | OTS | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/otsreader/doc/otsreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/otswriter/doc/otswriter.md
)
|
| | Hbase0.94 | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/hbase094xreader/doc/hbase094xreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/hbase094xwriter/doc/hbase094xwriter.md
)
|
| | Hbase1.1 | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/hbase11xreader/doc/hbase11xreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/hbase11xwriter/doc/hbase11xwriter.md
)
|
| | MongoDB | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/mongoreader/doc/mongoreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/mongowriter/doc/mongowriter.md
)
|
| | Hive | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/hdfsreader/doc/hdfsreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/hdfswriter/doc/hdfswriter.md
)
|
| 无结构化数据存储 | TxtFile | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/txtfilereader/doc/txtfilereader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/txtfilewriter/doc/txtfilewriter.md
)
|
| | FTP | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/ftpreader/doc/ftpreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/ftpwriter/doc/ftpwriter.md
)
|
| | HDFS | √ | √ |
[
读
](
https://github.com/alibaba/DataX/blob/master/hdfsreader/doc/hdfsreader.md
)
、
[
写
](
https://github.com/alibaba/DataX/blob/master/hdfswriter/doc/hdfswriter.md
)
|
| | Elasticsearch | | √ |
[
写
](
https://github.com/alibaba/DataX/blob/master/elasticsearchwriter/doc/elasticsearchwriter.md
)
|
DataX Framework提供了简单的接口与插件交互,提供简单的插件接入机制,只需要任意加上一种插件,就能无缝对接其他数据源。详情请看:
[
DataX数据源指南
](
https://github.com/alibaba/DataX/wiki/DataX-all-data-channels
)
...
...
@@ -147,4 +148,4 @@ DataX 3.0 开源版本支持单机多线程模式完成同步作业运行,本
- 在任务结束之后,打印总体运行情况
!
[
datax_end_info
](
https://cloud.githubusercontent.com/assets/1067175/17850930/0484d3ac-6892-11e6-9c1d-b102ad210a32.png
)
\ No newline at end of file

Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment