You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "romanzdk (via GitHub)" <gi...@apache.org> on 2023/09/15 09:17:14 UTC

[GitHub] [airflow] romanzdk opened a new issue, #34388: Kubernetes provider - Error parsing timestamp in logs

romanzdk opened a new issue, #34388:
URL: https://github.com/apache/airflow/issues/34388

   ### Apache Airflow version
   
   Other Airflow 2 version (please specify below)
   
   ### What happened
   
   We are experiencing issue with error log message being shown in every task that is KubernetesPodOperator. We get 
   
   ```
   {pod_manager.py:558} ERROR - Error parsing timestamp (no timestamp in message ''). Will continue execution but won't update timestamp
   ```
   
   after execution is finished in every task.
   
   ### What you think should happen instead
   
   No such error should be shown
   
   ### How to reproduce
   
   ```python
   '''doc'''
   from kubernetes.client import models as k8s
   from airflow.providers.cncf.kubernetes.operators.pod import KubernetesPodOperator
   from airflow.models import DAG
   
   DAG_ID = 'test-dag'
   
   default_args = {
   	'owner': 'owner',
   	'depends_on_past': False,
   	'start_date': datetime.datetime(2023, 9, 15),
   	'sla': datetime.timedelta(hours = 1),
   	'execution_timeout': datetime.timedelta(hours = 1, minutes = 30),
   	'email_on_failure': False,
   	'email_on_retry': False,
   	'retries': 3,
   	'retry_delay': datetime.timedelta(minutes = 1),
   	'retry_exponential_backoff': True,
   	'max_retry_delay': datetime.timedelta(minutes = 10),
   	'max_active_tis_per_dag': 8,
   	'pool': 'SomePool',
   	'get_logs': True,
   }
   
   dag = DAG(
   	dag_id = DAG_ID,
   	doc_md = __doc__,
   	tags = ['tag'],
   	schedule = AfterWorkdayTimetable(pendulum.Time(2, 0)),
   	default_args = default_args,
   	catchup = True,
   	dagrun_timeout = datetime.timedelta(hours = 6),
   	max_active_runs = 5
   )
   
   task = KubernetesPodOperator(
   	affinity = {
   		'nodeAffinity': {
   			'requiredDuringSchedulingIgnoredDuringExecution': {
   				'nodeSelectorTerms': [
   					{'matchExpressions': [{'key': 'dataDriveSizeClass', 'operator': 'In', 'values': ['large', 'medium']}]}
   				]
   			}
   		}
   	},
   	priority_class_name = 'l3',
   	namespace = 'some--namespace',
   	in_cluster = True,
   	image_pull_policy = 'IfNotPresent',
   	container_resources = k8s.V1ResourceRequirements(
   		requests = {'memory': '150Mi', 'cpu': '1m'},
   		limits = {'memory': '512Mi', 'cpu': '500m'},
   	),
   	cmds = [
   		'sleep',
   		'10'
   	],
   	dag = dag,
   	task_id = 'kubernetes_task',
   	labels = {
   		'runner': 'airflow',
   	},
   	annotations = {'version': '1.0.0'},
   	image = 'ubuntu',
   	env_vars = [k8s.V1EnvVar(name = name, value = value) for name, value in {'name':'value'}.items()]
   )
   
   task
   ```
   
   ### Operating System
   
   Debian GNU/Linux 10 (buster)
   
   ### Versions of Apache Airflow Providers
   
   ```
   apache-airflow-providers-amazon==8.4.0
   apache-airflow-providers-cncf-kubernetes==7.5.1
   apache-airflow-providers-common-sql==1.6.1
   apache-airflow-providers-ftp==3.4.2
   apache-airflow-providers-http==4.5.0
   apache-airflow-providers-imap==3.2.2
   apache-airflow-providers-postgres==5.6.0
   apache-airflow-providers-slack==7.3.2
   apache-airflow-providers-sqlite==3.4.3
   ```
   
   ### Deployment
   
   Other Docker-based deployment
   
   ### Deployment details
   
   Kubernetes 1.26.5
   airflow 2.6.3
   python 3.10.12
   LocalExecutor
   Database: Postgres 14.6
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Kubernetes provider - Error parsing timestamp in logs [airflow]

Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #34388:
URL: https://github.com/apache/airflow/issues/34388#issuecomment-1745636944

   > we are seeing this on airflow 2.7.0
   
   This is not related to Airflow version. It's related to `apache-airflow-providers-cncf-kubernetes` version.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Kubernetes provider - Error parsing timestamp in logs [airflow]

Posted by "romanzdk (via GitHub)" <gi...@apache.org>.
romanzdk commented on issue #34388:
URL: https://github.com/apache/airflow/issues/34388#issuecomment-1759398797

   @eladkal what are the release cycles for the `apache-airflow-providers-cncf-kubernetes` ? I see Airflow was released yesterday


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Kubernetes provider - Error parsing timestamp in logs [airflow]

Posted by "rudo-ro (via GitHub)" <gi...@apache.org>.
rudo-ro commented on issue #34388:
URL: https://github.com/apache/airflow/issues/34388#issuecomment-1745618398

   we are seeing this on airflow 2.7.0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Kubernetes provider - Error parsing timestamp in logs [airflow]

Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal closed issue #34388: Kubernetes provider - Error parsing timestamp in logs
URL: https://github.com/apache/airflow/issues/34388


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org