Tablestore
Tablestore 源连接器
描述
从阿里云 Tablestore 读取数据,支持全量和 CDC。
关键特性
选项
| 参数名 | 类型 | 必须 | 默认值 | 描述 |
|---|---|---|---|---|
| end_point | string | 是 | - | Tablestore 的端点 |
| instance_name | string | 是 | - | Tablestore 的实例名称 |
| access_key_id | string | 是 | - | Tablestore 的访问 ID |
| access_key_secret | string | 是 | - | Tablestore 的访问密钥 |
| table | string | 是 | - | Tablestore 的表名 |
| primary_keys | array | 是 | - | 表的主键,只需添加一个唯一的主键 |
| schema | config | 是 | - | 数据的结构 |
end_point [string]
Tablestore 的端点。
instance_name [string]
Tablestore 的实例名称。
access_key_id [string]
Tablestore 的访问 ID。
access_key_secret [string]
Tablestore 的访问密钥。
table [string]
Tablestore 的表名。
primary_keys [array]
表的主键,只需添加一个唯一的主键。
schema [Config]
数据的结构。
示例
env {
parallelism = 1
job.mode = "STREAMING"
}
source {
# 这是一个示例源插件 **仅用于测试和演示源插件功能**
Tablestore {
end_point = "https://****.cn-zhangjiakou.tablestore.aliyuncs.com"
instance_name = "****"
access_key_id="***************2Ag5"
access_key_secret="***********2Dok"
table="test"
primary_keys=["id"]
schema={
fields {
id = string
name = string
}
}
}
}
sink {
MongoDB{
uri = "mongodb://localhost:27017"
database = "test"
collection = "test"
primary-key = ["id"]
schema = {
fields {
id = string
name = string
}
}
}
}
变更日志
Change Log
| Change | Commit | Version |
|---|---|---|
| [Improve] table_store options (#9515) | https://github.com/apache/seatunnel/commit/145b68793f | 2.3.12 |
| [Feature][Checkpoint] Add check script for source/sink state class serialVersionUID missing (#9118) | https://github.com/apache/seatunnel/commit/4f5adeb1c7 | 2.3.11 |
| [Improve] restruct connector common options (#8634) | https://github.com/apache/seatunnel/commit/f3499a6eeb | 2.3.10 |
| [Feature][Restapi] Allow metrics information to be associated to logical plan nodes (#7786) | https://github.com/apache/seatunnel/commit/6b7c53d03c | 2.3.9 |
| [Feature][Connector-V2][Tablestore] Support Source connector for Tablestore #7448 (#7467) | https://github.com/apache/seatunnel/commit/a7ca51b585 | 2.3.8 |
| [Improve][Common] Introduce new error define rule (#5793) | https://github.com/apache/seatunnel/commit/9d1b2582b2 | 2.3.4 |
[Improve] Remove use SeaTunnelSink::getConsumedType method and mark it as deprecated (#5755) | https://github.com/apache/seatunnel/commit/8de7408100 | 2.3.4 |
| Support config column/primaryKey/constraintKey in schema (#5564) | https://github.com/apache/seatunnel/commit/eac76b4e50 | 2.3.4 |
| [Improve][Connector-V2] Remove scheduler in Tablestore sink (#5272) | https://github.com/apache/seatunnel/commit/8d6b07e466 | 2.3.3 |
| Merge branch 'dev' into merge/cdc | https://github.com/apache/seatunnel/commit/4324ee1912 | 2.3.1 |
| [Improve][Project] Code format with spotless plugin. | https://github.com/apache/seatunnel/commit/423b583038 | 2.3.1 |
| [improve][api] Refactoring schema parse (#4157) | https://github.com/apache/seatunnel/commit/b2f573a13e | 2.3.1 |
| [Improve][build] Give the maven module a human readable name (#4114) | https://github.com/apache/seatunnel/commit/d7cd601051 | 2.3.1 |
| [Improve][Project] Code format with spotless plugin. (#4101) | https://github.com/apache/seatunnel/commit/a2ab166561 | 2.3.1 |
| [Hotfix][OptionRule] Fix option rule about all connectors (#3592) | https://github.com/apache/seatunnel/commit/226dc6a119 | 2.3.0 |
| [Improve][Connector-V2][TableStore] Unified excetion for TableStore sink connector (#3527) | https://github.com/apache/seatunnel/commit/7b264d7004 | 2.3.0 |
| [Feature][connector-v2] add tablestore source and sink (#3309) | https://github.com/apache/seatunnel/commit/ebebf0b633 | 2.3.0 |