You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@superset.apache.org by "iercan (via GitHub)" <gi...@apache.org> on 2025/10/24 14:29:48 UTC
[I] shillelagh package is broken on version 6.0.0 [superset]
iercan opened a new issue, #35831:
URL: https://github.com/apache/superset/issues/35831
### Bug description
While testing 6.0.0rc2 and I've encountered below error. I think it is about
```2025-10-24 14:18:38,647:ERROR:superset.views.error_handling:No module named 'pip'
Traceback (most recent call last):
File "/app/superset/views/error_handling.py", line 101, in wraps
return f(self, *args, **kwargs)
File "/app/superset/views/base_api.py", line 487, in get_list_headless
duration, response = time_function(super().get_list_headless, **kwargs)
File "/app/superset/utils/core.py", line 1409, in time_function
response = func(*args, **kwargs)
File "/app/.venv/lib/python3.10/site-packages/flask_appbuilder/api/__init__.py", line 1641, in get_list_headless
response[API_RESULT_RES_KEY] = list_model_schema.dump(lst, many=True)
File "/app/.venv/lib/python3.10/site-packages/marshmallow/schema.py", line 621, in dump
result = self._serialize(processed_obj, many=many)
File "/app/.venv/lib/python3.10/site-packages/marshmallow/schema.py", line 586, in _serialize
return [self._serialize(d, many=False) for d in obj]
File "/app/.venv/lib/python3.10/site-packages/marshmallow/schema.py", line 586, in <listcomp>
return [self._serialize(d, many=False) for d in obj]
File "/app/.venv/lib/python3.10/site-packages/marshmallow/schema.py", line 589, in _serialize
value = field_obj.serialize(attr_name, obj, accessor=self.get_attribute)
File "/app/.venv/lib/python3.10/site-packages/marshmallow/fields.py", line 340, in serialize
value = self.get_value(obj, attr, accessor=accessor)
File "/app/.venv/lib/python3.10/site-packages/marshmallow/fields.py", line 270, in get_value
return accessor_func(obj, check_key, default)
File "/app/.venv/lib/python3.10/site-packages/marshmallow/schema.py", line 554, in get_attribute
return get_value(obj, attr, default)
File "/app/.venv/lib/python3.10/site-packages/marshmallow/utils.py", line 283, in get_value
return _get_value_for_key(obj, key, default)
File "/app/.venv/lib/python3.10/site-packages/marshmallow/utils.py", line 296, in _get_value_for_key
return getattr(obj, key, default)
File "/app/superset/models/core.py", line 235, in allows_cost_estimate
extra = self.get_extra() or {}
File "/app/superset/models/core.py", line 972, in get_extra
return self.db_engine_spec.get_extra_params(self, source)
File "/app/superset/models/core.py", line 944, in db_engine_spec
return self.get_db_engine_spec(url)
File "/app/superset/models/core.py", line 953, in get_db_engine_spec
driver = url.get_driver_name()
File "/app/.venv/lib/python3.10/site-packages/sqlalchemy/engine/url.py", line 625, in get_driver_name
return self.get_dialect().driver
File "/app/.venv/lib/python3.10/site-packages/sqlalchemy/engine/url.py", line 680, in get_dialect
entrypoint = self._get_entrypoint()
File "/app/.venv/lib/python3.10/site-packages/sqlalchemy/engine/url.py", line 662, in _get_entrypoint
cls = registry.load(name)
File "/app/.venv/lib/python3.10/site-packages/sqlalchemy/util/langhelpers.py", line 330, in load
return self.impls[name]()
File "/usr/local/lib/python3.10/importlib/metadata/__init__.py", line 171, in load
module = import_module(match.group('module'))
File "/usr/local/lib/python3.10/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 883, in exec_module
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "/app/.venv/lib/python3.10/site-packages/shillelagh/backends/apsw/dialects/gsheets.py", line 21, in <module>
from shillelagh.backends.apsw import db
File "/app/.venv/lib/python3.10/site-packages/shillelagh/backends/apsw/db.py", line 16, in <module>
from shillelagh import functions
File "/app/.venv/lib/python3.10/site-packages/shillelagh/functions.py", line 12, in <module>
import pip
ModuleNotFoundError: No module named 'pip'
```
I'm installing shillelagh with `uv pip install apache-superset[shillelagh]`. I think this error related with uv migration. Issue dissapeared after I installed pip myself. It should be added pyproject file for shillelagh.
### Screenshots/recordings
_No response_
### Superset version
master / latest-dev
### Python version
3.9
### Node version
16
### Browser
Chrome
### Additional context
_No response_
### Checklist
- [x] I have searched Superset docs and Slack and didn't find a solution to my problem.
- [x] I have searched the GitHub issue tracker and didn't find a similar bug report.
- [x] I have checked Superset's logs for errors and if I found a relevant Python stacktrace, I included it here as text in the "additional context" section.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [I] shillelagh package is broken on version 6.0.0 [superset]
Posted by "rusackas (via GitHub)" <gi...@apache.org>.
rusackas commented on issue #35831:
URL: https://github.com/apache/superset/issues/35831#issuecomment-3462699754
Actually, it looks like you just need to install `pip`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [I] shillelagh package is broken on version 6.0.0 [superset]
Posted by "betodealmeida (via GitHub)" <gi...@apache.org>.
betodealmeida commented on issue #35831:
URL: https://github.com/apache/superset/issues/35831#issuecomment-3463175075
This has been fixed actually, I just need to make a new release. Let me do it now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [I] shillelagh package is broken on version 6.0.0 [superset]
Posted by "iercan (via GitHub)" <gi...@apache.org>.
iercan closed issue #35831: shillelagh package is broken on version 6.0.0
URL: https://github.com/apache/superset/issues/35831
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [I] shillelagh package is broken on version 6.0.0 [superset]
Posted by "rusackas (via GitHub)" <gi...@apache.org>.
rusackas commented on issue #35831:
URL: https://github.com/apache/superset/issues/35831#issuecomment-3462697420
Paging Dr. @betodealmeida!
@iercan you can open this on the Shillelagh repo as well, if you want ¯\\\_(ツ)_/¯
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [I] shillelagh package is broken on version 6.0.0 [superset]
Posted by "betodealmeida (via GitHub)" <gi...@apache.org>.
betodealmeida commented on issue #35831:
URL: https://github.com/apache/superset/issues/35831#issuecomment-3463111058
Yeah, looks like we're missing a dep in shillelagh.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [I] shillelagh package is broken on version 6.0.0 [superset]
Posted by "dosubot[bot] (via GitHub)" <gi...@apache.org>.
dosubot[bot] commented on issue #35831:
URL: https://github.com/apache/superset/issues/35831#issuecomment-3443495703
<!-- Answer -->
This error happens because shillelagh tries to import pip at runtime, but pip is not guaranteed to be present in environments where Superset is installed using uv, especially with lean Docker images. Superset and shillelagh do not declare pip as a dependency, and there is no code in Superset that expects pip to be present for shillelagh to work. This is similar to other recent issues with missing Python modules in Superset's lean/uv-based setups, where users must manually install any runtime dependencies that are not included by default[^1][^2][^3].
A workaround is to manually install pip in your environment (for example, with uv pip install pip). Ideally, shillelagh should declare pip as a dependency if it requires it at runtime, but currently, this is not the case. This pattern is common with other optional dependencies in Superset as well.
[^1]: https://github.com/apache/superset/issues/31600
[^2]: https://github.com/apache/superset/issues/32217
[^3]: https://github.com/apache/superset/issues/34839
<!-- Dosu Comment Footer -->
*To reply, just mention [@dosu](https://go.dosu.dev/dosubot).*
---
<sup>How did I do? [Good](https://app.dosu.dev/response-feedback/3861cb97-2e29-4298-91a8-2e9d62c49f84?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/3861cb97-2e29-4298-91a8-2e9d62c49f84?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/3861cb97-2e29-4298-91a8-2e9d62c49f84?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/3861cb97-2e29-4298-91a8-2e9d62c49f84?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/3861cb97-2e29-4298-91a8-2e9d62c49f84?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/3861cb97-2e29-4298-91a8-2e9d62c49f84?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/3861cb97-2e29-4298-91a8-2e9d62c49f84?feedback_type=other)</sup> [](https://app.dosu.dev/a28d3c7e-a9d3-459e-9fb6-3a6f9ff4f357/ask?utm_source=githu
b) [](https://go.dosu.dev/discord-bot) [](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/apache/superset/issues/35831)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org
Re: [I] shillelagh package is broken on version 6.0.0 [superset]
Posted by "betodealmeida (via GitHub)" <gi...@apache.org>.
betodealmeida commented on issue #35831:
URL: https://github.com/apache/superset/issues/35831#issuecomment-3463201363
1.4.3 is out, should fix this: https://pypi.org/project/shillelagh/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@superset.apache.org
For additional commands, e-mail: notifications-help@superset.apache.org