You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@superset.apache.org by GitBox <gi...@apache.org> on 2020/06/18 08:09:34 UTC
[GitHub] [incubator-superset] reidlai opened a new issue #10096: CockroachDB Alchemy Migraitons failure
reidlai opened a new issue #10096:
URL: https://github.com/apache/incubator-superset/issues/10096
### Expected results
I am expecting superset can run all migrations successfully in create schema in brand new database with Cockroachdb Alchemy dialect and driver
After running "superset upgrade", "superset init", and "superset run", superset flask app is up and all database data should be populated into cockroachdb tables
### Actual results
Howevere, I got many errors related to the follow error during migration upgrade (superset upgrade):
(psycopg2.errors.InvalidForeignKey) missing "id" primary key column
If I switch back to use SQLLite Alchemy, it is working.
#### Screenshots
[error.txt](https://github.com/apache/incubator-superset/files/4797155/error.txt)
#### How to reproduce the bug
just put COCKROACHDB cluster url in SQLALCHEMY_DATABASE_URI and start the server
### Environment
(please complete the following information):
- superset version: clone from master branch, error occur when running superset version inside docker
- python version: 3.6.9
### Checklist
Make sure these boxes are checked before submitting your issue - thank you!
- [X] I have checked the superset logs for python stacktraces and included it here as text if there are any.
- [X] I have reproduced the issue with at least the latest released version of superset.
- [X] I have checked the issue tracker for the same issue and I haven't found one similar.
### Additional context
Add any other context about the problem here.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [incubator-superset] issue-label-bot[bot] commented on issue #10096: CockroachDB Alchemy Migraitons failure
Posted by GitBox <gi...@apache.org>.
issue-label-bot[bot] commented on issue #10096:
URL: https://github.com/apache/incubator-superset/issues/10096#issuecomment-645855668
Issue-Label Bot is automatically applying the label `#bug` to this issue, with a confidence of 0.83. Please mark this comment with :thumbsup: or :thumbsdown: to give our bot feedback!
Links: [app homepage](https://github.com/marketplace/issue-label-bot), [dashboard](https://mlbot.net/data/apache/incubator-superset) and [code](https://github.com/hamelsmu/MLapp) for this bot.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [incubator-superset] stale[bot] commented on issue #10096: CockroachDB Alchemy Migraitons failure
Posted by GitBox <gi...@apache.org>.
stale[bot] commented on issue #10096:
URL: https://github.com/apache/incubator-superset/issues/10096#issuecomment-683327744
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. For admin, please label this issue `.pinned` to prevent stale bot from closing the issue.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [incubator-superset] reidlai commented on issue #10096: CockroachDB Alchemy Migraitons failure
Posted by GitBox <gi...@apache.org>.
reidlai commented on issue #10096:
URL: https://github.com/apache/incubator-superset/issues/10096#issuecomment-645929547
@dpgaspar if talking about MySQL, can i use MySQL Client as wrapper to connect vitess as metadata database?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [incubator-superset] dpgaspar edited a comment on issue #10096: CockroachDB Alchemy Migraitons failure
Posted by GitBox <gi...@apache.org>.
dpgaspar edited a comment on issue #10096:
URL: https://github.com/apache/incubator-superset/issues/10096#issuecomment-645907351
Hi @reidlai,
Apache Superset only supports MySQL and PostgreSQL has it's metadata database. `SQLALCHEMY_DATABASE_URI` on config is for configuring the metadata connections string. Note that support for CockroachDB, Druid, ORACLE etc... are for analytics DB, and those are configured on superset -> Databases, you can configure has many connections has you like and for multiple db engines
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [incubator-superset] reidlai edited a comment on issue #10096: CockroachDB Alchemy Migraitons failure
Posted by GitBox <gi...@apache.org>.
reidlai edited a comment on issue #10096:
URL: https://github.com/apache/incubator-superset/issues/10096#issuecomment-651588408
@willbarrett Beacuse Postgresql and Mysql architecture lasts for many years and we are now migrating to NewSQL engine like CockroachDB, Yogabytes, Vitess, TiDB, etc which supports high scalability and availability features. Wish Superset can support those backend in your roadmap. If Superset targets as DV for BigData, i believe MySQL and Postgres is not enough for huge data set
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [incubator-superset] dpgaspar commented on issue #10096: CockroachDB Alchemy Migraitons failure
Posted by GitBox <gi...@apache.org>.
dpgaspar commented on issue #10096:
URL: https://github.com/apache/incubator-superset/issues/10096#issuecomment-645907351
Hi @reidlai,
Apache Superset only supports MySQL and PostgreSQL for has it's metadata database. `SQLALCHEMY_DATABASE_URI` on config is for configuring the metadata connections string. Note that support for CockroachDB, Druid, ORACLE etc... are for analytics DB, and those are configured on superset -> Databases, you can configure has many connections has you like and for multiple db engines
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [incubator-superset] stale[bot] closed issue #10096: CockroachDB Alchemy Migraitons failure
Posted by GitBox <gi...@apache.org>.
stale[bot] closed issue #10096:
URL: https://github.com/apache/incubator-superset/issues/10096
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [incubator-superset] reidlai commented on issue #10096: CockroachDB Alchemy Migraitons failure
Posted by GitBox <gi...@apache.org>.
reidlai commented on issue #10096:
URL: https://github.com/apache/incubator-superset/issues/10096#issuecomment-651588408
@willbarrett Beacuse Postgresql and Mysql architecture lasts for many years and we are now migrating to NewSQL engine like CockroachDB, Yogabytes, Vitess, TiDB, etc which supports high scalability and availability features. Wish Superset can support those backend in your roadmap
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [incubator-superset] willbarrett commented on issue #10096: CockroachDB Alchemy Migraitons failure
Posted by GitBox <gi...@apache.org>.
willbarrett commented on issue #10096:
URL: https://github.com/apache/incubator-superset/issues/10096#issuecomment-649078467
@reidlai we are not aware of anyone using Vitess as a metadata back-end for Superset. It may very well work, but it is not explicitly supported by the project. We are aware of organizations using MySQL clusters and Postgres clusters successfully. Typically the metadata database for Superset is not under heavy load, so horizontal/vertical scaling is usually not necessary. Do you expect your system to be under heavy load?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
[GitHub] [incubator-superset] dpgaspar edited a comment on issue #10096: CockroachDB Alchemy Migraitons failure
Posted by GitBox <gi...@apache.org>.
dpgaspar edited a comment on issue #10096:
URL: https://github.com/apache/incubator-superset/issues/10096#issuecomment-645907351
Hi @reidlai,
Apache Superset only supports MySQL and PostgreSQL has it's metadata database. `SQLALCHEMY_DATABASE_URI` on config is for the metadata connection string. Note that support for CockroachDB, Druid, ORACLE etc... are for analytics DB, and those are configured on superset -> Databases, you can configure has many connections has you like and for multiple db engines
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org