You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sedona.apache.org by GitBox <gi...@apache.org> on 2021/06/08 13:33:05 UTC
[GitHub] [incubator-sedona] skorski opened a new pull request #530: removing logging configuration as it causes errors on databricks.
skorski opened a new pull request #530:
URL: https://github.com/apache/incubator-sedona/pull/530
## Is this PR related to a proposed Issue?
No
## What changes were proposed in this PR?
Importing this file causes logging issues within databricks.
Full error:
```
--- Logging error ---
Traceback (most recent call last):
File "/usr/lib/python3.7/logging/__init__.py", line 1025, in emit
msg = self.format(record)
File "/usr/lib/python3.7/logging/__init__.py", line 869, in format
return fmt.format(record)
File "/usr/lib/python3.7/logging/__init__.py", line 611, in format
s = self.formatMessage(record)
File "/usr/lib/python3.7/logging/__init__.py", line 580, in formatMessage
return self._style.format(record)
File "/usr/lib/python3.7/logging/__init__.py", line 422, in format
return self._fmt % record.__dict__
ValueError: unsupported format character '%' (0x25) at index 11
Call stack:
File "/local_disk0/tmp/1623158547967-0/PythonShell.py", line 30, in <module>
launch_process()
File "/local_disk0/tmp/1623158547967-0/PythonShellImpl.py", line 1907, in launch_process
shell.executor.run()
File "/local_disk0/tmp/1623158547967-0/PythonShellImpl.py", line 285, in run
self.shell.shell.run_cell(command_id, cmd, store_history=True)
File "/local_disk0/tmp/1623158547967-0/PythonShellImpl.py", line 1233, in run_cell
super(IPythonShell, self).run_cell(raw_cell, store_history, silent, shell_futures)
File "/databricks/python/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 2858, in run_cell
raw_cell, store_history, silent, shell_futures)
File "/databricks/python/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 2886, in _run_cell
return runner(coro)
File "/databricks/python/lib/python3.7/site-packages/IPython/core/async_helpers.py", line 68, in _pseudo_sync_runner
coro.send(None)
File "/databricks/python/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 3063, in run_cell_async
interactivity=interactivity, compiler=compiler, result=result)
File "/databricks/python/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 3254, in run_ast_nodes
if (await self.run_code(code, result, async_=asy)):
File "/databricks/python/lib/python3.7/site-packages/IPython/core/interactiveshell.py", line 3331, in run_code
exec(code_obj, self.user_global_ns, self.user_ns)
File "<command-3221151447083464>", line 3, in <module>
logging.warning("Test2")
Message: 'Test2'
Arguments: ()
```
## How was this patch tested?
I manually removed this line and the logging will work again. It is unclear why the library is doing this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-sedona] skorski commented on pull request #530: removing logging configuration as it causes errors on databricks.
Posted by GitBox <gi...@apache.org>.
skorski commented on pull request #530:
URL: https://github.com/apache/incubator-sedona/pull/530#issuecomment-858627902
@jiayuasu Should all of these tests pass? It seems odd that this change would cause some of the other failures.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-sedona] jiayuasu merged pull request #530: [SEDONA-50] Removing logging configuration as it causes errors on databricks.
Posted by GitBox <gi...@apache.org>.
jiayuasu merged pull request #530:
URL: https://github.com/apache/incubator-sedona/pull/530
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-sedona] jiayuasu commented on pull request #530: removing logging configuration as it causes errors on databricks.
Posted by GitBox <gi...@apache.org>.
jiayuasu commented on pull request #530:
URL: https://github.com/apache/incubator-sedona/pull/530#issuecomment-859164538
@yitao-li Hi Yitao, could you please check why the R build failed at Spark 3.1.1?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-sedona] jiayuasu commented on pull request #530: [SEDONA-50] Removing logging configuration as it causes errors on databricks.
Posted by GitBox <gi...@apache.org>.
jiayuasu commented on pull request #530:
URL: https://github.com/apache/incubator-sedona/pull/530#issuecomment-860137045
@skorski @yitao-li Not sure why R fails at Spark 3.1.1. But I think this PR itself has nothing to do with this issue. I will merge this PR first.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-sedona] yitao-li commented on pull request #530: removing logging configuration as it causes errors on databricks.
Posted by GitBox <gi...@apache.org>.
yitao-li commented on pull request #530:
URL: https://github.com/apache/incubator-sedona/pull/530#issuecomment-859504596
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-sedona] yitao-li edited a comment on pull request #530: removing logging configuration as it causes errors on databricks.
Posted by GitBox <gi...@apache.org>.
yitao-li edited a comment on pull request #530:
URL: https://github.com/apache/incubator-sedona/pull/530#issuecomment-859908827
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-sedona] jiayuasu edited a comment on pull request #530: [SEDONA-50] Removing logging configuration as it causes errors on databricks.
Posted by GitBox <gi...@apache.org>.
jiayuasu edited a comment on pull request #530:
URL: https://github.com/apache/incubator-sedona/pull/530#issuecomment-860137045
@skorski @yitao-li Not sure why R fails at Spark 3.1.1. But I think this PR itself has nothing to do with this issue. I will merge this PR first.
I also re-ran the CI several times. It always failed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-sedona] yitao-li commented on pull request #530: [SEDONA-50] Removing logging configuration as it causes errors on databricks.
Posted by GitBox <gi...@apache.org>.
yitao-li commented on pull request #530:
URL: https://github.com/apache/incubator-sedona/pull/530#issuecomment-860866137
@jiayuasu I figured out the errors with Spark 3.1.1 turned out to be a minor issue on `sparklyr` side. The fix has been merged to the main branch of `sparklyr` and all the R builds should be suceeding now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org