You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/01/16 16:22:30 UTC

[GitHub] [airflow] hmike96 commented on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

hmike96 commented on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file
URL: https://github.com/apache/airflow/pull/6230#issuecomment-575229660
 
 
   Is the full_pod_spec feature released yet?? I tried it out but get this bug as if it is not released?
   `
   │ /usr/local/lib/python3.7/site-packages/airflow/contrib/operators/kubernetes_pod_operator.py:158: PendingDeprecationWarning: Invalid arguments were passed to KubernetesPodOperator (task_id: fail-ivt-job-notification). Support for passing such arguments will be dropped in Airflow 2.0. Invalid arguments were:                                      │
   │ *args: ()                                                                                                                                                                    │
   │ **kwargs: {'full_pod_spec': {'api_version': 'v1',                                                                                                                            │
   │  'kind': 'Pod',                                                                                                                                                              │
   │  'metadata': {'annotations': None,                                                                                                                                           │
   │               'cluster_name': None,                                                                                                                                          │
   │               'creation_timestamp': None,                                                                                                                                    │
   │               'deletion_grace_period_seconds': None,                                                                                                                         │
   │               'deletion_timestamp': None,                                                                                                                                    │
   │               'finalizers': None,                                                                                                                                            │
   │               'generate_name': None,                                                                                                                                         │
   │               'generation': None,                                                                                                                                            │
   │               'initializers': None,                                                                                                                                          │
   │               'labels': {'datadog': 'alert'},                                                                                                                                │
   │               'managed_fields': None,                                                                                                                                        │
   │               'name': 'datadogFail',  
   │               'namespace': None,                                                                                                                                             │
   │               'owner_references': None,                                                                                                                                      │
   │               'resource_version': None,                                                                                                                                      │
   │               'self_link': None,                                                                                                                                             │
   │               'uid': None},                                                                                                                                                  │
   │  'spec': {'active_deadline_seconds': None,                                                                                                                                   │
   │           'affinity': None,                                                                                                                                                  │
   │           'automount_service_account_token': None,                                                                                                                           │
   │           'containers': [{'args': ['FAIL'],                                                                                                                                  │
   │                           'command': None,                                                                                                                                   │
   │                           'env': None,                                                                                                                                       │
   │                           'env_from': None,                                                                                                                                  │
   │                           'image': 'hmike96/datadog-notification:1.0.1',                                                                                                     │
   │                           'image_pull_policy': 'Always',                                                                                                                     │
   │                           'lifecycle': None,                                                                                                                                 │
   │                           'liveness_probe': None,                                                                                                                            │
   │                           'name': 'datadogFail',                                                                                                                             │
   │                           'ports': None,                                                                                                                                     │
   │                           'readiness_probe': None,                                                                                                                           │
   │                           'resources': None,                                                                                                                                 │
   │                           'security_context': None,                                                                                                                          │
   │                           'stdin': None,                                                                                                                                     │
   │                           'stdin_once': None,                                                                                                                                │
   │                           'termination_message_path': None,                                                                                                                  │
   │                           'termination_message_policy': None,                                                                                                                │
   │                           'tty': None,                                                                                                                                       │
   │                           'volume_devices': None,                                                                                                                            │
   │                           'volume_mounts': [{'mount_path': '/config',                                                                                                        │
   │                                              'mount_propagation': None,                                                                                                      │
   │                                              'name': 'datadogNotificationVolume',                                                                                            │
   │                                              'read_only': None,                                                                                                              │
   │                                              'sub_path': None,                                                                                                               │
   │                                              'sub_path_expr': None}],     
   │                           'working_dir': None}],                                                                                                                             │
   │           'dns_config': None,                                                                                                                                                │
   │           'dns_policy': None,                                                                                                                                                │
   │           'enable_service_links': None,                                                                                                                                      │
   │           'host_aliases': None,                                                                                                                                              │
   │           'host_ipc': None,                                                                                                                                                  │
   │           'host_network': None,                                                                                                                                              │
   │           'host_pid': None,                                                                                                                                                  │
   │           'hostname': None,                                                                                                                                                  │
   │           'image_pull_secrets': None,                                                                                                                                        │
   │           'init_containers': None,                                                                                                                                           │
   │           'node_name': None,                                                                                                                                                 │
   │           'node_selector': None,                                                                                                                                             │
   │           'priority': None,                                                                                                                                                  │
   │           'priority_class_name': None,                                                                                                                                       │
   │           'readiness_gates': None,                                                                                                                                           │
   │           'restart_policy': 'Never',                                                                                                                                         │
   │           'runtime_class_name': None,                                                                                                                                        │
   │           'scheduler_name': None,                                                                                                                                            │
   │           'security_context': None,                                                                                                                                          │
   │           'service_account': None,                                                                                                                                           │
   │           'service_account_name': None,                                                                                                                                      │
   │           'share_process_namespace': None,                                                                                                                                   │
   │           'subdomain': None,                                                                                                                                                 │
   │           'termination_grace_period_seconds': None,                                                                                                                          │
   │           'tolerations': None,                                                                                                                                               │
   │           'volumes': [{'aws_elastic_block_store': None,                                                                                                                      │
   │                        'azure_disk': None,                                                                                                                                   │
   │                        'azure_file': None,                                                                                                                                   │
   │                        'cephfs': None,                                                                                                                                       │
   │                        'cinder': None,                                                                                                                                       │
   │                        'config_map': {'default_mode': None, 
   │                                       'items': None,                                                                                                                         │
   │                                       'name': 'datadog-notification-configmap-ivt',                                                                                          │
   │                                       'optional': None},                                                                                                                     │
   │                        'csi': None,                                                                                                                                          │
   │                        'downward_api': None,                                                                                                                                 │
   │                        'empty_dir': None,                                                                                                                                    │
   │                        'fc': None,                                                                                                                                           │
   │                        'flex_volume': None,                                                                                                                                  │
   │                        'flocker': None,                                                                                                                                      │
   │                        'gce_persistent_disk': None,                                                                                                                          │
   │                        'git_repo': None,                                                                                                                                     │
   │                        'glusterfs': None,                                                                                                                                    │
   │                        'host_path': None,                                                                                                                                    │
   │                        'iscsi': None,                                                                                                                                        │
   │                        'name': 'datadogNotificationVolume',                                                                                                                  │
   │                        'nfs': None,                                                                                                                                          │
   │                        'persistent_volume_claim': None,                                                                                                                      │
   │                        'photon_persistent_disk': None,                                                                                                                       │
   │                        'portworx_volume': None,                                                                                                                              │
   │                        'projected': None,                                                                                                                                    │
   │                        'quobyte': None,                                                                                                                                      │
   │                        'rbd': None,                                                                                                                                          │
   │                        'scale_io': None,                                                                                                                                     │
   │                        'secret': None,                                                                                                                                       │
   │                        'storageos': None,                                                                                                                                    │
   │                        'vsphere_volume': None}]},                                                                                                                            │
   │  'status': None}}                                                                                                                                                            │
   │   super(KubernetesPodOperator, self).__init__(*args, resources=None, **kwargs) `

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services