You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "AchimGaedkeLynker (via GitHub)" <gi...@apache.org> on 2026/07/13 10:17:34 UTC
[I] SSHRemoteJobOperator: inconsistent "remote_base_dir" validation [airflow]
AchimGaedkeLynker opened a new issue, #69813:
URL: https://github.com/apache/airflow/issues/69813
### Under which category would you file this issue?
Providers
### Apache Airflow version
3.3
### What happened and how to reproduce it?
(On a system I can't report from) I use `SSHRemoteJobOperator` with `remote_base_dir="/tmp-data/airflow-ssh-jobs"`.
The operator starts and tracks the remote job till the end - as it has before.
But instead of finishing cleanly (as the remote command did after an hour...), it fails while cleaning up the job.
It raises a `Value Error` with the description:
```text
Invalid job directory: '/tmp-data/airflow-ssh-jobs/af_ ....'. Expected Path under '/tmp/airflow-ssh-jobs' for safety.
```
Removing the `remote_base_dir` argument avoids this failure.
### What you think should happen instead?
Either the remote_base_dir should be rejected when instantiating the operator or succeed at the very end.
Looking at the code, https://github.com/apache/airflow/blob/7f60646cd9934dcea99dd4bbb33d75f5650eba74/providers/ssh/src/airflow/providers/ssh/operators/ssh_remote_job.py#L167 seems to have different validation criteria than https://github.com/apache/airflow/blob/7f60646cd9934dcea99dd4bbb33d75f5650eba74/providers/ssh/src/airflow/providers/ssh/utils/remote_job.py#L33 is very restrictive as it only allows paths beginning with the default path.
which used inside https://github.com/apache/airflow/blob/7f60646cd9934dcea99dd4bbb33d75f5650eba74/providers/ssh/src/airflow/providers/ssh/operators/ssh_remote_job.py#L455 ... i.e the cleanup fails at the very end.
### Operating System
Ubuntu 24.04
### Deployment
Virtualenv installation
### Apache Airflow Provider(s)
ssh
### Versions of Apache Airflow Providers
python 3.12
apache-airflow-providers-ssh==5.0.3
### Official Helm Chart version
Not Applicable
### Kubernetes Version
_No response_
### Helm Chart configuration
_No response_
### Docker Image customizations
_No response_
### Anything else?
Just occurred when updating from airflow 3.2.x to 3.3.0, incl apache-airflow-providers-ssh 5.0.3 ->5.0.2
### Are you willing to submit PR?
- [x] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SSHRemoteJobOperator: inconsistent "remote_base_dir" validation [airflow]
Posted by "AchimGaedkeLynker (via GitHub)" <gi...@apache.org>.
AchimGaedkeLynker commented on issue #69813:
URL: https://github.com/apache/airflow/issues/69813#issuecomment-5154716429
Thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SSHRemoteJobOperator: inconsistent "remote_base_dir" validation [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #69813: SSHRemoteJobOperator: inconsistent "remote_base_dir" validation
URL: https://github.com/apache/airflow/issues/69813
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org