[GitHub] [airflow] houqp commented on pull request #13299: fix 422 invalid value error caused by long k8s pod name

[GitBox <gi...@apache.org>]

houqp commented on pull request #13299:
URL: https://github.com/apache/airflow/pull/13299#issuecomment-755936064


   @potiuk I think i might have found the k8s test issue.
   
   I confirmed that the docker image built for the k8s test does contain the right code:
   
   ```
   3:07:30 ❯ docker run -it docker.pkg.github.com/apache/airflow/master-python3.6:460204505 bash
   Unable to find image 'docker.pkg.github.com/apache/airflow/master-python3.6:460204505' locally
   460204505: Pulling from apache/airflow/master-python3.6
   852e50cd189d: Already exists
   334ed303e4ad: Already exists
   209dcde762c7: Already exists
   f9abeb9ca099: Already exists
   f750bc3b4393: Already exists
   6dfb08d9ecf4: Pull complete
   df1d95662566: Pull complete
   7b5270f850a8: Pull complete
   cd0c014ccf64: Pull complete
   972813881f3c: Pull complete
   6f19c4064553: Pull complete
   e4656094ab4e: Pull complete
   8524ff833442: Pull complete
   a1d0974a0892: Pull complete
   24c4330fe9a2: Pull complete
   ed0c8b4977e8: Pull complete
   Digest: sha256:02e5c5c6175529a988e95143483c20dd42c7754d9219d4bbae9b64d655cb821e
   Status: Downloaded newer image for docker.pkg.github.com/apache/airflow/master-python3.6:460204505
   airflow@56f39731592a:/opt/airflow$ python
   Python 3.6.12 (default, Nov 25 2020, 03:59:00)
   [GCC 8.3.0] on linux
   Type "help", "copyright", "credits" or "license" for more information.
   >>> from airflow.executors.kubernetes_executor import MAX_POD_ID_LEN
   Traceback (most recent call last):
     File "<stdin>", line 1, in <module>
   ImportError: cannot import name 'MAX_POD_ID_LEN'
   >>>
   airflow@56f39731592a:/opt/airflow$ grep MAX_POD_ID_LEN  /home/airflow/.local/lib/python3.6/site-packages/airflow/kubernetes/pod_generator.py
   airflow@56f39731592a:/opt/airflow$ exit
   ```
   
   Noticed the image id from this image is `23c1f6187642`:
   
   ```bash
   23:13:31 ❯ docker images |grep docker.pkg.github.com/apache/airflow/master-python3.6
   docker.pkg.github.com/apache/airflow/master-python3.6          460204505                                       23c1f6187642        3 days ago          845MB
   ```
   
   However, if you look into the debug log from k8s test, both web and scheduler pods are launched with a different image with the following id:
   
   ```
     Containers:
       scheduler:
         Container ID:  containerd://ed87933da7e8d8e2b0b79d14c859650c78d040d2f48849369db476ce8ec5a00a
         Image:         apache/airflow:master-python3.6-kubernetes
         Image ID:      sha256:3b65120f9e29723f3dc97b057231ee9cec8e9fd32eddc08897b2501ff90775dd
   ```
   
   Do you know where does that `apache/airflow:master-python3.6-kubernetes` image come from?
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org