You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@inlong.apache.org by "yunqingmoswu (via GitHub)" <gi...@apache.org> on 2023/03/10 04:33:03 UTC
[GitHub] [inlong] yunqingmoswu opened a new issue, #7557: [Bug][Sort] Fix class incompatible error between elasticsearch6 with elasticsearch7
yunqingmoswu opened a new issue, #7557:
URL: https://github.com/apache/inlong/issues/7557
### What happened
it encounters a class incompatible error when dirty data archiving is enabled.

### What you expected to happen
it's exactly right when dirty data archiving is enabled.
### How to reproduce
It can reproduce by the follow code:
```
CREATE TABLE `table_input`(
PRIMARY KEY (`a`) NOT ENFORCED,
`database_wedata_di` STRING METADATA FROM 'meta.database_name' VIRTUAL,
`table_wedata_di` STRING METADATA FROM 'meta.table_name' VIRTUAL,
`type_wedata_di` STRING METADATA FROM 'meta.op_type' VIRTUAL,
`ts_wedata_di` TIMESTAMP_LTZ(3) METADATA FROM 'meta.op_ts' VIRTUAL,
`processing_time_wedata_di` AS PROCTIME(),
`a` INT,
`b` STRING,
`c` STRING,
`PROCESS_TIME` AS PROCTIME())
WITH (
'debezium.snapshot.locking.mode' = 'none',
'scan.startup.mode' = 'initial',
'debezium.binary.handling.mode' = 'base64',
'inlong.metric.labels' = 'groupId=1&streamId=1&nodeId=1',
'connector' = 'mysql-cdc-inlong',
'hostname' = 'localhost',
'database-name' = 'test_db',
'port' = '3306',
'scan.incremental.snapshot.enabled' = 'true',
'server-time-zone' = 'Asia/Shanghai',
'username' = 'root',
'password' = 'password',
'table-name' = 'test_db.mysql_dirtydata_source'
);
CREATE TABLE `table_output`(
`a` INT,
`b` STRING,
`c` STRING)
WITH (
'dirty.side-output.field-delimiter' = ',',
'dirty.side-output.s3.region' = 'ap-beijing',
'dirty.side-output.log-tag' = 'DirtyData',
'dirty.side-output.log.enable' = 'true',
'dirty.ignore' = 'true',
'dirty.side-output.s3.secret-key-id' = 'secretkeyid',
'dirty.side-output.s3.endpoint' = 's3.endpoint',
'dirty.side-output.s3.access-key-id' = 'secretaccesskeyid',
'dirty.side-output.format' = 'csv',
'dirty.identifier' = 'DirtyData',
'failure-handler' = 'ignore',
'dirty.side-output.enable' = 'true',
'dirty.side-output.line-delimiter' = '\n',
'dirty.side-output.s3.bucket' = 's3bucket',
'dirty.side-output.labels' = '[SYSTEM_TIME=${SYSTEM_TIME}][index_es]',
'dirty.side-output.connector' = 's3',
'dirty.side-output.s3.key' = 'index_es',
'inlong.metric.labels' = 'groupId=1&streamId=1&nodeId=2',
'connector' = 'elasticsearch-7-inlong',
'hosts' = 'http://localhost:9200',
'index' = 'index_es',
'password' = 'password',
'username' = 'elastic'
);
INSERT INTO `table_output`
SELECT
`a` AS `a`,
`b` AS `b`,
`c` AS `c`
FROM `table_input` ;
```
### Environment
_No response_
### InLong version
master
### InLong Component
InLong Sort
### Are you willing to submit PR?
- [X] Yes, I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] dockerzhang closed issue #7557: [Bug][Sort] Fix class incompatible error between elasticsearch6 with elasticsearch7
Posted by "dockerzhang (via GitHub)" <gi...@apache.org>.
dockerzhang closed issue #7557: [Bug][Sort] Fix class incompatible error between elasticsearch6 with elasticsearch7
URL: https://github.com/apache/inlong/issues/7557
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org