You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@superset.apache.org by GitBox <gi...@apache.org> on 2021/10/05 19:41:59 UTC
[GitHub] [superset] danunafig opened a new issue #16982: Does not work with clickhouse source. Cannot create a dataset
danunafig opened a new issue #16982:
URL: https://github.com/apache/superset/issues/16982
Updated as stated here https://superset.apache.org/docs/databases/clickhouse
#### How to reproduce the bug
1. Followed instructions.
2. Connected to database succesfully
3. Was able to connect and get dataset from other tools
4. Failed with adding dataset using superset
5. Tried to clickhouse-sqlalchemy and sqlalchemy-clickhouse didn't help
### Expected results
Working dataset
### Actual results
`2021-10-05 19:35:02,803:DEBUG:clickhouse_driver.connection:Connecting. Database: default. User: labuser5
2021-10-05 19:35:02,804:DEBUG:clickhouse_driver.connection:Connecting to 10.11.12.13:9000
2021-10-05 19:35:02,807:DEBUG:clickhouse_driver.connection:Connected to ClickHouse server version 18.16.1, revision: 54412
2021-10-05 19:35:02,808:DEBUG:clickhouse_driver.connection:Query: select version()
2021-10-05 19:35:02,809:DEBUG:clickhouse_driver.connection:Block "" send time: 0.000187
2021-10-05 19:35:02,812:DEBUG:clickhouse_driver.connection:Connecting. Database: default. User: labuser5
2021-10-05 19:35:02,812:DEBUG:clickhouse_driver.connection:Connecting to 10.11.12.13:9000
2021-10-05 19:35:02,814:DEBUG:clickhouse_driver.connection:Connected to ClickHouse server version 18.16.1, revision: 54412
2021-10-05 19:35:02,815:DEBUG:clickhouse_driver.connection:Query: DESCRIBE TABLE default.cell_towers
2021-10-05 19:35:02,815:DEBUG:clickhouse_driver.connection:Block "" send time: 0.000207
2021-10-05 19:35:02,818:ERROR:root:Invalid enum member name:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/flask_appbuilder/api/__init__.py", line 85, in wraps
return f(self, *args, **kwargs)
File "/app/superset/views/base_api.py", line 85, in wraps
raise ex
File "/app/superset/views/base_api.py", line 82, in wraps
duration, response = time_function(f, self, *args, **kwargs)
File "/app/superset/utils/core.py", line 1461, in time_function
response = func(*args, **kwargs)
File "/app/superset/utils/log.py", line 242, in wrapper
value = f(*args, **kwargs)
File "/app/superset/datasets/api.py", line 252, in post
new_model = CreateDatasetCommand(g.user, item).run()
File "/app/superset/datasets/commands/create.py", line 46, in run
self.validate()
File "/app/superset/datasets/commands/create.py", line 86, in validate
if database and not DatasetDAO.validate_table_exists(
File "/app/superset/datasets/dao.py", line 81, in validate_table_exists
database.get_table(table_name, schema=schema)
File "/app/superset/models/core.py", line 645, in get_table
return Table(
File "<string>", line 2, in new
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/util/deprecations.py", line 139, in warned
return fn(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/sql/schema.py", line 563, in new
metadata._remove_table(name, schema)
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/util/langhelpers.py", line 68, in exit
compat.raise_(
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/util/compat.py", line 182, in raise_
raise exception
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/sql/schema.py", line 558, in new
table._init(name, metadata, *args, **kw)
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/sql/schema.py", line 647, in _init
self._autoload(
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/sql/schema.py", line 670, in _autoload
autoload_with.run_callable(
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2212, in run_callable
return conn.run_callable(callable_, *args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1653, in run_callable
return callable_(self, *args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/clickhouse_sqlalchemy/drivers/base.py", line 825, in reflecttable
rv = super(ClickHouseDialect, self).reflecttable(
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 484, in reflecttable
return insp.reflecttable(
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/reflection.py", line 664, in reflecttable
for col_d in self.get_columns(
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/reflection.py", line 390, in get_columns
col_defs = self.dialect.get_columns(
File "<string>", line 2, in get_columns
File
"/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/reflection.py", line 52, in cache
ret = fn(self, con, *args, **kw)
File "/usr/local/lib/python3.8/site-packages/clickhouse_sqlalchemy/drivers/base.py", line 863, in get_columns
return [self._get_column_info(row.name, row.type) for row in rows]
File "/usr/local/lib/python3.8/site-packages/clickhouse_sqlalchemy/drivers/base.py", line 863, in <listcomp>
return [self._get_column_info(row.name, row.type) for row in rows]
File "/usr/local/lib/python3.8/site-packages/clickhouse_sqlalchemy/drivers/base.py", line 866, in _get_column_info
col_type = self._get_column_type(name, format_type)
File "/usr/local/lib/python3.8/site-packages/clickhouse_sqlalchemy/drivers/base.py", line 908, in _get_column_type
type_enum = enum.Enum('%s_enum' % name, options)
File "/usr/local/lib/python3.8/enum.py", line 341, in call
return cls._create_(
File "/usr/local/lib/python3.8/enum.py", line 465, in _create_
enum_class = metacls.__new__(metacls, class_name, bases, classdict)
File "/usr/local/lib/python3.8/enum.py", line 185, in new
raise ValueError('Invalid enum member name: {0}'.format(
ValueError: Invalid enum member name:
127.0.0.1 - - [05/Oct/2021:19:35:02 +0000] "POST /api/v1/dataset/ HTTP/1.1" 500 26 "http://127.0.0.1:53755/tablemodelview/list/?pageIndex=0&sortColumn=changed_on_delta_humanized&sortOrder=desc" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36"
127.0.0.1 - - [05/Oct/2021:19:35:02 +0000] "GET /static/assets/73f05b21ea1ababa1228.chunk.js HTTP/1.1" 200 1052 "http://127.0.0.1:53755/tablemodelview/list/?pageIndex=0&sortColumn=changed_on_delta_humanized&sortOrder=desc" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36"`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] afpd commented on issue #16982: Does not work with clickhouse source. Cannot create a dataset
Posted by GitBox <gi...@apache.org>.
afpd commented on issue #16982:
URL: https://github.com/apache/superset/issues/16982#issuecomment-937712808
triggered by
https://github.com/xzkostyan/clickhouse-sqlalchemy/issues/147
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] junlincc commented on issue #16982: Does not work with clickhouse source. Cannot create a dataset
Posted by GitBox <gi...@apache.org>.
junlincc commented on issue #16982:
URL: https://github.com/apache/superset/issues/16982#issuecomment-937097974
@dandanhub thanks for filing, can you provide the rest of the info required(video, screenshot, version, FF etc in the bug report template? thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] kpotehin commented on issue #16982: Does not work with clickhouse source. Cannot create a dataset
Posted by GitBox <gi...@apache.org>.
kpotehin commented on issue #16982:
URL: https://github.com/apache/superset/issues/16982#issuecomment-1012633617
I'm also getting this error but it caused by another problem: `TypeError: __init__() got multiple values for argument 'partition_by'`. Here's the issue: https://github.com/xzkostyan/clickhouse-sqlalchemy/issues/164
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] danunafig commented on issue #16982: Does not work with clickhouse source. Cannot create a dataset
Posted by GitBox <gi...@apache.org>.
danunafig commented on issue #16982:
URL: https://github.com/apache/superset/issues/16982#issuecomment-937359507
Same error
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] danunafig commented on issue #16982: Does not work with clickhouse source. Cannot create a dataset
Posted by GitBox <gi...@apache.org>.
danunafig commented on issue #16982:
URL: https://github.com/apache/superset/issues/16982#issuecomment-937359405
Here they are
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] alexey-milovidov commented on issue #16982: Does not work with clickhouse source. Cannot create a dataset
Posted by GitBox <gi...@apache.org>.
alexey-milovidov commented on issue #16982:
URL: https://github.com/apache/superset/issues/16982#issuecomment-938917344
> ClickHouse server version 18.16.1
This is three years old version that is not supported.
You should have recent version of ClickHouse.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] afpd commented on issue #16982: Does not work with clickhouse source. Cannot create a dataset
Posted by GitBox <gi...@apache.org>.
afpd commented on issue #16982:
URL: https://github.com/apache/superset/issues/16982#issuecomment-938981031
Issue persists with the 21.9.4.35 as well
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] afpd commented on issue #16982: Does not work with clickhouse source. Cannot create a dataset
Posted by GitBox <gi...@apache.org>.
afpd commented on issue #16982:
URL: https://github.com/apache/superset/issues/16982#issuecomment-937377081
I get the same error for helm deployed superset with the section
```
bootstrapScript: |
#!/bin/bash
rm -rf /var/lib/apt/lists/* && \
pip install \
clickhouse-sqlalchemy \
psycopg2==2.8.5 \
redis==3.2.1 && \
if [ ! -f ~/bootstrap ]; then echo "Running Superset with uid {{ .Values.runAsUser }}" > ~/bootstrap; fi
```
Logs say
```
Successfully installed backports.zoneinfo-0.2.1 clickhouse-driver-0.2.2 clickhouse-sqlalchemy-0.1.6 psycopg2-2.8.5 redis-3.2.1 tzlocal-3.0
```
And later when trying to add clickhouse db, the very same error appears
```
ERROR:root:Invalid enum member name: Traceback (most recent call last): File
```
and the rest is the same as in the original report.
clickhouse-server 18.16.1+ds-7.2+b1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] danunafig commented on issue #16982: Does not work with clickhouse source. Cannot create a dataset
Posted by GitBox <gi...@apache.org>.
danunafig commented on issue #16982:
URL: https://github.com/apache/superset/issues/16982#issuecomment-938981358
> > ClickHouse server version 18.16.1
>
> This is three years old version that is not supported. You should have recent version of Click House.
The version on ClickHouse is irrelative, but to confirm the case:
```
ClickHouse client version 21.9.4.35 (official build).
Connecting to localhost:9000 as user labuser5.
Connected to ClickHouse server version 21.9.4 revision 54449.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] danunafig commented on issue #16982: Does not work with clickhouse source. Cannot create a dataset
Posted by GitBox <gi...@apache.org>.
danunafig commented on issue #16982:
URL: https://github.com/apache/superset/issues/16982#issuecomment-937359405
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] afpd commented on issue #16982: Does not work with clickhouse source. Cannot create a dataset
Posted by GitBox <gi...@apache.org>.
afpd commented on issue #16982:
URL: https://github.com/apache/superset/issues/16982#issuecomment-937377081
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [superset] junlincc commented on issue #16982: Does not work with clickhouse source. Cannot create a dataset
Posted by GitBox <gi...@apache.org>.
junlincc commented on issue #16982:
URL: https://github.com/apache/superset/issues/16982#issuecomment-937097974
@dandanhub thanks for filing, can you provide the rest of the info required(video, screenshot, version, FF etc in the bug report template? thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org