You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "safronau (via GitHub)" <gi...@apache.org> on 2023/05/24 16:47:15 UTC

[GitHub] [airflow] safronau opened a new issue, #31513: Scheduler endlessly prints "ValueError: source code string cannot contain null bytes"

safronau opened a new issue, #31513:
URL: https://github.com/apache/airflow/issues/31513

   ### Apache Airflow version
   
   2.6.1
   
   ### What happened
   
   Scheduler endlessly prints:
   
   ```
   app-airflow-scheduler-1  | Process ForkProcess-<XXX>:
   app-airflow-scheduler-1  | Traceback (most recent call last):
   app-airflow-scheduler-1  |   File "/usr/local/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap
   app-airflow-scheduler-1  |     self.run()
   app-airflow-scheduler-1  |   File "/usr/local/lib/python3.10/multiprocessing/process.py", line 108, in run
   app-airflow-scheduler-1  |     self._target(*self._args, **self._kwargs)
   app-airflow-scheduler-1  |   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/dag_processing/manager.py", line 259, in _run_processor_manager
   app-airflow-scheduler-1  |     processor_manager.start()
   app-airflow-scheduler-1  |   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/dag_processing/manager.py", line 493, in start
   app-airflow-scheduler-1  |     return self._run_parsing_loop()
   app-airflow-scheduler-1  |   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/dag_processing/manager.py", line 639, in _run_parsing_loop
   app-airflow-scheduler-1  |     self.start_new_processes()
   app-airflow-scheduler-1  |   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/dag_processing/manager.py", line 1092, in start_new_processes
   app-airflow-scheduler-1  |     processor.start()
   app-airflow-scheduler-1  |   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/dag_processing/processor.py", line 213, in start
   app-airflow-scheduler-1  |     self.import_modules(self.file_path)
   app-airflow-scheduler-1  |   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/dag_processing/processor.py", line 380, in import_modules
   app-airflow-scheduler-1  |     _import_modules(file_path)
   app-airflow-scheduler-1  |   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/dag_processing/processor.py", line 366, in _import_modules
   app-airflow-scheduler-1  |     for module in iter_airflow_imports(filepath):
   app-airflow-scheduler-1  |   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/file.py", line 389, in iter_airflow_imports
   app-airflow-scheduler-1  |     parsed = ast.parse(Path(file_path).read_bytes())
   app-airflow-scheduler-1  |   File "/usr/local/lib/python3.10/ast.py", line 50, in parse
   app-airflow-scheduler-1  |     return compile(source, filename, mode, flags,
   app-airflow-scheduler-1  | ValueError: source code string cannot contain null bytes
   
   ```
   
   It is deployed without zipped DAGS as descibed in #31039 
   But `AIRFLOW__SCHEDULER__PARSING_PRE_IMPORT_MODULES=False` fixes it too.
   But dags are exist.
   
   ### What you think should happen instead
   
   _No response_
   
   ### How to reproduce
   
   I can not provide minimal code to reproduce.
   
   ### Operating System
   
   linux/amd64
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Docker-Compose
   
   ### Deployment details
   
   source docker image: apache/airflow:2.6.1-python3.10
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] potiuk closed issue #31513: Scheduler endlessly prints "ValueError: source code string cannot contain null bytes"

Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #31513: Scheduler endlessly prints "ValueError: source code string cannot contain null bytes"
URL: https://github.com/apache/airflow/issues/31513


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] boring-cyborg[bot] commented on issue #31513: Scheduler endlessly prints "ValueError: source code string cannot contain null bytes"

Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #31513:
URL: https://github.com/apache/airflow/issues/31513#issuecomment-1561577330

   Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org