You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "okayhooni (via GitHub)" <gi...@apache.org> on 2023/02/27 15:06:34 UTC
[GitHub] [airflow] okayhooni opened a new pull request, #29786: Handling project location param on async BigQuery dts trigger
okayhooni opened a new pull request, #29786:
URL: https://github.com/apache/airflow/pull/29786
Currently, async version of BigQuery dts operator with trigger cannot be used in other regions except us (default) region.
when I used it on another region, trigger task raise error like below.
```
airflow.exceptions.AirflowException: Trigger failed with exception: 404 The requested transfer config (projects/****/locations/us/transferConfigs/*****) was not found.
```
I added config param in order to cover all the gcp locations.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on pull request #29786: Handling project location param on async BigQuery dts trigger
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on PR #29786:
URL: https://github.com/apache/airflow/pull/29786#issuecomment-1465270540
I rebased it. It was a strange error.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eladkal commented on pull request #29786: Handling project location param on async BigQuery dts trigger
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on PR #29786:
URL: https://github.com/apache/airflow/pull/29786#issuecomment-1461443462
static tests are failing :(
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on pull request #29786: Handling project location param on async BigQuery dts trigger
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on PR #29786:
URL: https://github.com/apache/airflow/pull/29786#issuecomment-1468966713
@MrGeorgeOwl - can you take a look please?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk merged pull request #29786: Handling project location param on async BigQuery dts trigger
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk merged PR #29786:
URL: https://github.com/apache/airflow/pull/29786
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] okayhooni commented on pull request #29786: Handling project location param on async BigQuery dts trigger
Posted by "okayhooni (via GitHub)" <gi...@apache.org>.
okayhooni commented on PR #29786:
URL: https://github.com/apache/airflow/pull/29786#issuecomment-1462244997
> static tests are failing :(
@eladkal
I guess this was a just random failure..
[error log]
```
An unexpected error has occurred: CalledProcessError: command: ('/opt/pipx/venvs/apache-airflow-breeze/bin/python', '-mnodeenv', '--prebuilt', '--clean-src', '/home/runner/.cache/pre-commit/repoui20kj4a/node_env-18.6.0', '-n', '18.6.0')
return code: 1
stdout: (none)
stderr:
* Install prebuilt node (18.6.0) .Incomplete read while readingfrom https://nodejs.org/download/release/v18.6.0/node-v18.6.0-linux-x64.tar.gz
.
Traceback (most recent call last):
File "/opt/hostedtoolcache/Python/3.7.15/x64/lib/python3.7/runpy.py", line 193, in _run_module_as_main
"__main__", mod_spec)
File "/opt/hostedtoolcache/Python/3.7.15/x64/lib/python3.7/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/opt/pipx/venvs/apache-airflow-breeze/lib/python3.7/site-packages/nodeenv.py", line 1519, in <module>
main()
File "/opt/pipx/venvs/apache-airflow-breeze/lib/python3.7/site-packages/nodeenv.py", line 1104, in main
create_environment(env_dir, args)
File "/opt/pipx/venvs/apache-airflow-breeze/lib/python3.7/site-packages/nodeenv.py", line 980, in create_environment
install_node(env_dir, src_dir, args)
File "/opt/pipx/venvs/apache-airflow-breeze/lib/python3.7/site-packages/nodeenv.py", line 739, in install_node
install_node_wrapped(env_dir, src_dir, args)
File "/opt/pipx/venvs/apache-airflow-breeze/lib/python3.7/site-packages/nodeenv.py", line [76](https://github.com/apache/airflow/actions/runs/4283958493/jobs/7460518056#step:6:77)2, in install_node_wrapped
download_node_src(node_url, src_dir, args)
File "/opt/pipx/venvs/apache-airflow-breeze/lib/python3.7/site-packages/nodeenv.py", line 602, in download_node_src
with ctx as archive:
File "/opt/hostedtoolcache/Python/3.7.15/x64/lib/python3.7/contextlib.py", line 112, in __enter__
return next(self.gen)
File "/opt/pipx/venvs/apache-airflow-breeze/lib/python3.7/site-packages/nodeenv.py", line 573, in tarfile_open
tf = tarfile.open(*args, **kwargs)
File "/opt/hostedtoolcache/Python/3.7.15/x64/lib/python3.7/tarfile.py", line 1573, in open
saved_pos = fileobj.tell()
AttributeError: 'bytes' object has no attribute 'tell'
Check the log at /home/runner/.cache/pre-commit/pre-commit.log
There were errors during pre-commit check. They should be fixed
Error: Process completed with exit code 3.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org