You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@amoro.apache.org by "Jzjsnow (via GitHub)" <gi...@apache.org> on 2025/10/11 07:42:00 UTC
[I] [Bug]: AMS start error after executing upgrade.sql to update tables in database [amoro]
Jzjsnow opened a new issue, #3815:
URL: https://github.com/apache/amoro/issues/3815
### What happened?
After executing the latest `upgrade.sql` to update the tables in MySQL, starting AMS will fail. The detailed issue is as follows:
1. Syntax errors in `upgrade.sql`
2. Unknown column `bucket_id` in `field list`:
<img width="1706" height="1182" alt="Image" src="https://github.com/user-attachments/assets/a1c4b99c-eeac-43fb-be2b-b1c9ad3f7805" />
3. java.lang.IllegalStateException: Expected a string but was BEGIN_OBJECT
<img width="1704" height="714" alt="Image" src="https://github.com/user-attachments/assets/fd54e9b5-3a62-4162-98f6-b5a4cbac192e" />
### Affects Versions
master
### What table formats are you seeing the problem on?
_No response_
### What engines are you seeing the problem on?
AMS
### How to reproduce
Execute the latest upgrade.sql in mysql and start ams.
### Relevant log output
```shell
```
### Anything else
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's Code of Conduct
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: AMS start error after executing upgrade.sql to update tables in database [amoro]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #3815:
URL: https://github.com/apache/amoro/issues/3815#issuecomment-4416729316
This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: AMS start error after executing upgrade.sql to update tables in database [amoro]
Posted by "liaoyt (via GitHub)" <gi...@apache.org>.
liaoyt commented on issue #3815:
URL: https://github.com/apache/amoro/issues/3815#issuecomment-3455517193
UPDATE table_runtime
SET table_config = table_config::jsonb
- 'optimizingConfig'
- 'expiringDataConfig'
- 'tagConfiguration';
if use default setting, after executing this sql, server can start
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: AMS start error after executing upgrade.sql to update tables in database [amoro]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #3815:
URL: https://github.com/apache/amoro/issues/3815#issuecomment-4323385031
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: AMS start error after executing upgrade.sql to update tables in database [amoro]
Posted by "Jzjsnow (via GitHub)" <gi...@apache.org>.
Jzjsnow commented on issue #3815:
URL: https://github.com/apache/amoro/issues/3815#issuecomment-3393048109
Bug 1 and 2 can be resolved in #3816. But 3 appears to have inconsistent data results after the update:
The `table_config` column information in table `table_runtime` inserted from my old tableRuntime table is in JSON format:
> {
> "expireSnapshotEnabled": true,
> "snapshotTTLMinutes": 720,
> "snapshotMinCount": 1,
> "changeDataTTLMinutes": 10080,
> "cleanOrphanEnabled": false,
> "orphanExistingMinutes": 2880,
> "deleteDanglingDeleteFilesEnabled": true,
> "optimizingConfig": {
> "enabled": true,
> "targetQuota": 0.5,
> "optimizerGroup": "flinkgroup-new",
> "maxExecuteRetryCount": 5,
> "targetSize": 134217728,
> "maxTaskSize": 134217728,
> "maxFileCount": 10000,
> "openFileCost": 4194304,
> "fragmentRatio": 8,
> "minTargetSizeRatio": 0.75,
> "minorLeastFileCount": 12,
> "minorLeastInterval": 3600000,
> "majorDuplicateRatio": 0.1,
> "fullTriggerInterval": -1,
> "fullRewriteAllFiles": true,
> "filter": null,
> "baseHashBucket": 4,
> "baseRefreshInterval": -1,
> "hiveRefreshInterval": -1,
> "minPlanInterval": 60000
> },
> "expiringDataConfig": {
> "enabled": false,
> "expirationField": null,
> "expirationLevel": "PARTITION",
> "retentionTime": 0,
> "dateTimePattern": "yyyy-MM-dd",
> "numberDateFormat": "TIMESTAMP_MS",
> "baseOnRule": "LAST_COMMIT_TIME"
> },
> "tagConfiguration": {
> "autoCreateTag": false,
> "tagFormat": "'tag-'yyyyMMdd",
> "triggerPeriod": "DAILY",
> "triggerOffsetMinutes": 0,
> "maxDelayMinutes": 60,
> "tagMaxAgeMs": -1
> }
> }
While the ` table_config` column information inserted in the new run is in map format, e.g.:
> {
> "self-optimizing.group": "flinkgroup-new",
> "upsert-enabled": "false",
> "write-format": "parquet",
> "write.parquet.compression-codec": "snappy"
> }
It seems the old tableRuntime table information may require some adjustments before it can be inserted into the new table. @baiyangtx PTAL
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: AMS start error after executing upgrade.sql to update tables in database [amoro]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #3815: [Bug]: AMS start error after executing upgrade.sql to update tables in database
URL: https://github.com/apache/amoro/issues/3815
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org