You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@inlong.apache.org by "yunqingmoswu (via GitHub)" <gi...@apache.org> on 2023/03/10 04:33:03 UTC

[GitHub] [inlong] yunqingmoswu opened a new issue, #7557: [Bug][Sort] Fix class incompatible error between elasticsearch6 with elasticsearch7

yunqingmoswu opened a new issue, #7557:
URL: https://github.com/apache/inlong/issues/7557

   ### What happened
   
   it encounters a class incompatible error when dirty data archiving is enabled.
   ![image](https://user-images.githubusercontent.com/44659300/224223219-25e72c7c-3e6c-4b1e-8257-12751bfdca55.png)
   
   
   ### What you expected to happen
   
   it's exactly right when dirty data archiving is enabled.
   
   ### How to reproduce
   
   It can reproduce by the follow code:
   ```
   CREATE TABLE `table_input`(
       PRIMARY KEY (`a`) NOT ENFORCED,
       `database_wedata_di` STRING METADATA FROM 'meta.database_name' VIRTUAL,
       `table_wedata_di` STRING METADATA FROM 'meta.table_name' VIRTUAL,
       `type_wedata_di` STRING METADATA FROM 'meta.op_type' VIRTUAL,
       `ts_wedata_di` TIMESTAMP_LTZ(3) METADATA FROM 'meta.op_ts' VIRTUAL,
       `processing_time_wedata_di` AS PROCTIME(),
       `a` INT,
       `b` STRING,
       `c` STRING,
       `PROCESS_TIME` AS PROCTIME())
       WITH (
       'debezium.snapshot.locking.mode' = 'none',
       'scan.startup.mode' = 'initial',
       'debezium.binary.handling.mode' = 'base64',
       'inlong.metric.labels' = 'groupId=1&streamId=1&nodeId=1',
       'connector' = 'mysql-cdc-inlong',
       'hostname' = 'localhost',
       'database-name' = 'test_db',
       'port' = '3306',
       'scan.incremental.snapshot.enabled' = 'true',
       'server-time-zone' = 'Asia/Shanghai',
       'username' = 'root',
       'password' = 'password',
       'table-name' = 'test_db.mysql_dirtydata_source'
   );
   CREATE TABLE `table_output`(
       `a` INT,
       `b` STRING,
       `c` STRING)
       WITH (
       'dirty.side-output.field-delimiter' = ',',
       'dirty.side-output.s3.region' = 'ap-beijing',
       'dirty.side-output.log-tag' = 'DirtyData',
       'dirty.side-output.log.enable' = 'true',
       'dirty.ignore' = 'true',
       'dirty.side-output.s3.secret-key-id' = 'secretkeyid',
       'dirty.side-output.s3.endpoint' = 's3.endpoint',
       'dirty.side-output.s3.access-key-id' = 'secretaccesskeyid',
       'dirty.side-output.format' = 'csv',
       'dirty.identifier' = 'DirtyData',
       'failure-handler' = 'ignore',
       'dirty.side-output.enable' = 'true',
       'dirty.side-output.line-delimiter' = '\n',
       'dirty.side-output.s3.bucket' = 's3bucket',
       'dirty.side-output.labels' = '[SYSTEM_TIME=${SYSTEM_TIME}][index_es]',
       'dirty.side-output.connector' = 's3',
       'dirty.side-output.s3.key' = 'index_es',
       'inlong.metric.labels' = 'groupId=1&streamId=1&nodeId=2',
       'connector' = 'elasticsearch-7-inlong',
       'hosts' = 'http://localhost:9200',
       'index' = 'index_es',
       'password' = 'password',
       'username' = 'elastic'
   );
   INSERT INTO `table_output`
       SELECT 
       `a` AS `a`,
       `b` AS `b`,
       `c` AS `c`
       FROM `table_input` ;
   ```
   
   ### Environment
   
   _No response_
   
   ### InLong version
   
   master
   
   ### InLong Component
   
   InLong Sort
   
   ### Are you willing to submit PR?
   
   - [X] Yes, I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [inlong] dockerzhang closed issue #7557: [Bug][Sort] Fix class incompatible error between elasticsearch6 with elasticsearch7

Posted by "dockerzhang (via GitHub)" <gi...@apache.org>.
dockerzhang closed issue #7557: [Bug][Sort] Fix class incompatible error between elasticsearch6 with elasticsearch7
URL: https://github.com/apache/inlong/issues/7557


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org