You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@devlake.apache.org by GitBox <gi...@apache.org> on 2022/06/03 11:10:52 UTC
[GitHub] [incubator-devlake] marcemv90 opened a new issue, #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
marcemv90 opened a new issue, #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073
## Describe the bug
Running a Github pipeline to register a repository that contains emojis on some of its pull request comments (and probably in other fields) the pipeline fails with the following error:
```
Error 3988: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
```
## To Reproduce
Steps to reproduce the behavior:
1. Go to '**Pipelines > Create Pipeline Run**'
2. Click on '**Create Pipeline Run**'
3. Scroll down to until '**Github**' is shown in Data Providers list
4. **Toggle on** GitHub Data provider
5. Enter repository owner and name for a repository **that contains emojis** on some of its comments, titles, etc.
6. Click on '**Run Pipeline**'
7. Wait for the Pipeline to run, in our case it fails at 20%.
## Expected behavior
Github scan succeeds with no errors.
## Screenshots
## Additional context
Similar errors are shown in the lake container logs:
```shell
time="2022-06-03 10:51:01" level=error msg=" [task service] task failed%!(EXTRA *errors.SubTaskError=Error 3988: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter)"
time="2022-06-03 10:51:01" level=error msg=" [pipeline service] [pipeline #21] run tasks failed: %!w(*errors.errorString=&{Error 3988: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter})"
```
We think it might be related to the emojis as the log also contains those. Probably is related to the charset used in the Database or some of its tables or fields.
Please let us know if further information is required.
Many thanks!
Regards.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] marcemv90 commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
marcemv90 commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1171973539
Hi @warren830 👋 ,
I can't provide the repository where that bug was found as it is a private repository from my company. Emojis becoming the cause of the error was our first thought, but we are not sures about that. That was something that simply made sense for us, but we have no further mechanisms to dig deeper.
What is something that I do can provide are the tags of the docker images that we are using, maybe that's helpful for your for troubleshooting, or maybe it is something that is already fixed in a higher version or something similar.
- **Lake:** [mericodev/lake:20220523](https://hub.docker.com/layers/lake/mericodev/lake/20220523/images/sha256-b2210658d048388e1a0ea0ae55f865c8ad520b628e9a94a76d492045097524bc?context=explore)
- **ConfigUI**: We are using a Docker image built by us because there hasn't been a non-test release since #2238. But it is based on [mericodev/config-ui:20220523](https://hub.docker.com/layers/config-ui/mericodev/config-ui/20220523/images/sha256-7c8c87fa885a1ce9f4065e0cd2334e2be0866845dc0c7566af7c09224b97533f?context=explore).
- **Database**: We are running a MySQL in AWS RDS. Engine version 8.0.27
Hope it can shed some light to help identifying the root cause.
Please let me know if I provide something else that might be helpful as well, like enabling debug traces and upload the logs of a failed scan, or something like that.
Regards!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] warren830 commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
warren830 commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1171894080
@marcemv90 can you provide the repo you met the problem?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] github-actions[bot] commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1264775763
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] klesh commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
klesh commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1194859379
Hi, @marcemv90, what was the name of the failing subtask?
Can you isolate the specific "emoji" that causing the problem?
Thanks in advanced.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] warren830 commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
warren830 commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1171926276
> 😅
also tried this one
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] github-actions[bot] closed issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
URL: https://github.com/apache/incubator-devlake/issues/2073
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] warren830 commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
warren830 commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1173497003
>
Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] marcemv90 commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
marcemv90 commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1212854203
Hello @klesh , @Startrekzky , sorry for the delayed response, I've been trying to reproduce the error, but I've been completely unable. I will let you know if it arises again, so I can provide further details.
Sorry.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] marcemv90 commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
marcemv90 commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1194337103
Hi @warren830, the task is using the Github plugin, not sure if that the information that you need. Let me know if I can provide further details.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] Startrekzky commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
Startrekzky commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1208835454
Hey @marcemv90 , have you found out which specific emojis cause this problem?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] warren830 commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
warren830 commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1173405423
I think the problem might be caused by AWS RDS. What's the collation of your db?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] warren830 commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
warren830 commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1171892041
@marcemv90 This is wield, I tried many times, it works well.
<img width="418" alt="image" src="https://user-images.githubusercontent.com/39366025/176817911-ea61011d-4340-4f13-8d1c-1055a00c56fe.png">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] Startrekzky commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
Startrekzky commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1147609287
@klesh @warren830 Can you look at this bug?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] hezyin commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
hezyin commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1228008326
@marcemv90 Hi Marcelo, were you able to reproduce the issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] warren830 commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
warren830 commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1190969973
> Hello @warren830 , see following:
>
> ```sql
> use lake;
> SELECT @@character_set_database, @@collation_database;
> ```
>
> 
>
> Also our connection string is set to the following, in case it could be helpful:
>
> `mysql://user:pass@devlake.xxxxxxxxx.eu-west-1.rds.amazonaws.com:3306/lake?charset=utf8mb4&parseTime=True`
>
> Thanks for your time!
>
> Regards.
This is so strange, we are using the same character set and collation:
Can you check which task returned error?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] github-actions[bot] commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1257322316
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] warren830 commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
warren830 commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1171921553
😅
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] marcemv90 commented on issue #2073: Conversion from collation utf8mb4_0900_ai_ci into utf8_general_ci impossible for parameter
Posted by GitBox <gi...@apache.org>.
marcemv90 commented on issue #2073:
URL: https://github.com/apache/incubator-devlake/issues/2073#issuecomment-1173484574
Hello @warren830 , see following:
```mysql
use lake;
SELECT @@character_set_database, @@collation_database;
```
Also our connection string is set to the following, in case it could be helpful:
`mysql://user:pass@devlake.xxxxxxxxx.eu-west-1.rds.amazonaws.com:3306/lake?charset=utf8mb4&parseTime=True`
Thanks for your time!
Regards.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org