You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@superset.apache.org by GitBox <gi...@apache.org> on 2021/02/17 00:53:51 UTC

[GitHub] [superset] puranikamey opened a new issue #13162: [sqllab] While querying from sqllab editor to database table, characters written Japanese and Chinese are getting converted to '???'

puranikamey opened a new issue #13162:
URL: https://github.com/apache/superset/issues/13162


   A clear and concise description of what the bug is.
   While performing CURD operations using sqllab editor, Chinese and Japanese chars are getting converted to '???'.  For ex. While inserting value in to the table, insert query runs successfully but data inserted in the table getting converted to  '?????'. Also, if you refresh page, values in the sql editor (Chinese and Japanese chars) are getting converted to '???'. 
   
   ### Environment
   
   - superset version: 0.36.0
   - python version: 3.6.9
   - node.js version: 6.11.5 <7.0.0 || >= 8.9.0
   
   ### Expected results
   On Sqllab editor, Chinese and Japanese chars should not be getting converted to '???'.
   
   ### Actual results
   Should be able to perform CURD operations using Chinese and Japanese language. 
   
   #### Screenshots
   
   As you can see data inserted  in the table is ??????
   
   ![image](https://user-images.githubusercontent.com/23127814/108135531-4629b880-7086-11eb-8578-0108f0b3adaf.png)
   
   ![image](https://user-images.githubusercontent.com/23127814/108140398-ff40c080-708f-11eb-8d09-6597e2d7a69a.png)
   
   
   
   #### How to reproduce the bug
   
   1. Go to /superset/sqllab
   2. Select database(connection)
   3. Select schema(connection)
   4. Create new table. (Mysql: create table multilang (name varchar(80) null); Snowflake: create table multilang (name nvarchar);
   5. Run following query : insert into multilang values('こんにちは世界');
   6. Insert query will run successfully, however data inserted will be '??????'
   7. Refresh the page; insert into multilang values('こんにちは世界'); will get converted to insert into multilang values('???????');
   
   
   ### Checklist
   
   Make sure to follow these steps before submitting your issue - thank you!
   
   - [ ] I have checked the superset logs for python stacktraces and included it here as text if there are any.
   - [ ] I have reproduced the issue with at least the latest released version of superset.
   - [ ] I have checked the issue tracker for the same issue and I haven't found one similar.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org


[GitHub] [superset] puranikamey commented on issue #13162: [sqllab] While querying from sqllab editor to database table, characters written Japanese and Chinese are getting converted to '???'

Posted by GitBox <gi...@apache.org>.
puranikamey commented on issue #13162:
URL: https://github.com/apache/superset/issues/13162#issuecomment-780218582


   Just FYI: We are using charset=utf-8 in connection string. Also, We are able to perform all the above scenerios via connecting through snowflake UI etc, so this seems to be superset UI issue. 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org


[GitHub] [superset] stale[bot] commented on issue #13162: [sqllab] While querying from sqllab editor to database table, characters written Japanese and Chinese are getting converted to '???'

Posted by GitBox <gi...@apache.org>.
stale[bot] commented on issue #13162:
URL: https://github.com/apache/superset/issues/13162#issuecomment-868936108


   This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. For admin, please label this issue `.pinned` to prevent stale bot from closing the issue.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org


[GitHub] [superset] devarchi33 commented on issue #13162: [sqllab] While querying from sqllab editor to database table, characters written Japanese and Chinese are getting converted to '???'

Posted by GitBox <gi...@apache.org>.
devarchi33 commented on issue #13162:
URL: https://github.com/apache/superset/issues/13162#issuecomment-825375090


   We are also using charset=utf-8 at connection string, It works! 😁
   ![스크린샷 2021-04-23 오후 12 21 21](https://user-images.githubusercontent.com/7742818/115818069-8b73b900-a42e-11eb-9324-16dfa7cb3a29.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org


[GitHub] [superset] 7A6A78 commented on issue #13162: [sqllab] While querying from sqllab editor to database table, characters written Japanese and Chinese are getting converted to '???'

Posted by GitBox <gi...@apache.org>.
7A6A78 commented on issue #13162:
URL: https://github.com/apache/superset/issues/13162#issuecomment-892476561


   @puranikamey 
   I resolved this issue by creating database `superset` by myself, the most important thing is that the charset of the mysql database `superset` must be utf8:
   `CREATE DATABASE superset CHARACTER SET utf8 COLLATE utf8_general_ci;`
   
   After that, initialize the database:
   `superset db upgrade`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org