You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/08/20 21:52:54 UTC
[GitHub] [airflow] mariuszliksza-kinesso opened a new issue #10435: Negsignal.SIGKILL error on Mac OS
mariuszliksza-kinesso opened a new issue #10435:
URL: https://github.com/apache/airflow/issues/10435
<!--
Welcome to Apache Airflow! For a smooth issue process, try to answer the following questions.
Don't worry if they're not all applicable; just try to include what you can :-)
If you need to include code snippets or logs, please put them in fenced code
blocks. If they're super-long, please use the details tag like
<details><summary>super-long log</summary> lots of stuff </details>
Please delete these comment blocks before submitting the issue.
-->
<!--
IMPORTANT!!!
PLEASE CHECK "SIMILAR TO X EXISTING ISSUES" OPTION IF VISIBLE
NEXT TO "SUBMIT NEW ISSUE" BUTTON!!!
PLEASE CHECK IF THIS ISSUE HAS BEEN REPORTED PREVIOUSLY USING SEARCH!!!
Please complete the next sections or the issue will be closed.
This questions are the first thing we need to know to understand the context.
-->
**Apache Airflow version**:
1.10.9
**Environment**:
macOS Catalina, 10.15.6
**What happened**:
When I am running my workflow in Apache Airflow using docker (especially using Local Executor) I am sometimes getting this error: **INFO - Task exited with return code Negsignal.SIGKILL**
This usually appears when the task consumes a lot of CPU resources.
But, the same process works fine on Windows machines of my colleagues.
<!-- (please include exact error messages if you can) -->
**What you expected to happen**:
I would like to understand why it happens only on macOS and how can I handle that.
<!-- What do you think went wrong? -->
**How to reproduce it**:
<!---
I can share the code that is always failing with the above issue when I am using Local Executor but it just works when I switch to Sequential Executor.
As minimally and precisely as possible. Keep in mind we do not have access to your cluster or dags.
If you are using kubernetes, please attempt to recreate the issue using minikube or kind.
## Install minikube/kind
- Minikube https://minikube.sigs.k8s.io/docs/start/
- Kind https://kind.sigs.k8s.io/docs/user/quick-start/
If this is a UI bug, please provide a screenshot of the bug or a link to a youtube video of the bug in action
You can include images using the .md style of
To record a screencast, mac users can use QuickTime and then create an unlisted youtube video with the resulting .mov file.
--->
**Anything else we need to know**:
<!--
How often does this problem occur? Once? Every time etc?
Any relevant logs to include? Put them here in side a detail tag:
<details><summary>x.log</summary> lots of stuff </details>
-->
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] popovpa commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
popovpa commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-709877519
We have same behavior.
Our environment: k8s, airflow 1.10.12 (in 1.10.9 was such error as well)
Sometimes watching: Task exited with return code Negsignal.SIGKILL
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariuszliksza-kinesso commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
mariuszliksza-kinesso commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-693199779
One update:
My process does not always work, even with Sequential Executor. There are 1-2 tasks that usually fail and return code Negsignal.SIGKILL. Please help as I can't run this process on my local machine due to that error.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #10435: Negsignal.SIGKILL error on Mac OS
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-677925468
Thanks for opening your first issue here! Be sure to follow the issue template!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] pbotros edited a comment on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
pbotros edited a comment on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-731351567
This is also happening to me on AWS EC2 instances with airflow 1.10.12, ubuntu 18.04.5. It's not consistent but I've just started seeing it with some newly written tasks that use high %s of CPU & GPU for sustained periods. Will hunt for something that can reproduce this as I go on.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] trsilva32 commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
trsilva32 commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-896451053
> I have the same issue. My airflow(1.10.12) is running on AWS ECS(Fargate).
> `INFO - Task exited with return code Negsignal.SIGKILL`
I'm facing the same issue on Airflow (mwaa), any solution for that, but it works fine in one env not the other,
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ashb commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
ashb commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-731454166
Are you also using a lot of memory? On Linux check `dmesg` or syslog and see if the OOMKiller is killing processes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ashb closed issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
ashb closed issue #10435:
URL: https://github.com/apache/airflow/issues/10435
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] nickrinaldi88 commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
nickrinaldi88 commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-1030657322
I have my local airflow being hosted on docker.
I am in development, and I'm using Sequential Executor.
As I said, I'm a mere employee of my company, and am limited to the choices our team has made. I'm not a liberty to make an executive changes to our production Airflow.
Simply posting here if anyone's had any other fixes. Thanks for your help though.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] hsahovic commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
hsahovic commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-693481166
Updating Airflow to 1.10.10 seems to have resolved the issue.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-756109858
Nice! Thanks @nielspedersen . It is great you did it!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariuszliksza-kinesso commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
mariuszliksza-kinesso commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-694276469
Update:
This process does not work on Windows using docker. So it seems that it only works on Linux.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariuszliksza-kinesso commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
mariuszliksza-kinesso commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-694157328
I have upgraded to 1.10.12 and still the same issue :(
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] nielspedersen commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
nielspedersen commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-756083946
It's not completely related, but I had a different error message and Google lead me here. So in the hopes that it will help anyone in my boat:
I was/am having this issue on macOS Mojave version 10.14.6 running airflow locally and trying to get it to run tasks on Amazon ECS/Fargate.
In the logs, I'd get the error:
```
{local_task_job.py:102} INFO - Task exited with return code Negsignal.SIGABRT
```
After a lot of Google, someone suggested trying to `$ export OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES`, and that seems to have worked.
The airflow scheduler running locally also hints at this:
```
objc[70653]: +[__NSPlaceholderDate initialize] may have been in progress in another thread when fork() was called.
objc[70653]: +[__NSPlaceholderDate initialize] may have been in progress in another thread when fork() was called. We cannot safely call it or ignore it in the fork() child process. Crashing instead. Set a breakpoint on objc_initializeAfterForkError to debug.
```
Sorry for commenting at a closed issue, but I hope this can help anyone having the same error
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] raburgos commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
raburgos commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-955958074
Hi there!
Im using MacOs Catalina 10.15.5; trying to run custom hook (using jdbchook) with python3.8/airflow 2.0 on virtual environment.
I search all over internet and try export OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES in any possible way. But dont work to me.
If anyone have another solution it would be awesome!
Thanks in advance!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] hsahovic commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
hsahovic commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-693442802
I'm running into the same issue using [astronomer](https://www.astronomer.io/)'s local dev environment, which uses Airflow 1.10.7, on macOS Catalina 10.15.6.
I'm going to test other versions of airflow supported by astronomer.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] nasir-bhanpuri commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
nasir-bhanpuri commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-692949804
I am running into a similar issue with Airflow 1.10.10 using Docker on macOS.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] vikramkoka commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
vikramkoka commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-730797893
@mariuszliksza-kinesso, Can you please share the procedure to reproduce this issue? Including the code.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-1030635659
SIGKILL can be cause by multiple reasons - most likely it's one of the libraries you use, not Airflow. I doubt migrating to newer version of Airlfow will help if this is one of your libraries.
What I can recommend you - if it's MacOS, use your "local" airflow on a virtual machine with Linux or remote machine. MacOS is NOT officially supported as execution environment (it's OK to use it for Airlfow development though). Only Linux is good to work.
BTW. Sequential Executor should never be used except for development. You seem to be doing everything to have troubles, Sequential Executor, MacOS, Airflow 1.10 which is "dead" for more than 7months. I am sorry to say, but you need to deal with consequences of your choices. Maybe accept the fact that you should follow the "supported" path of Airflow. That would be smart way to approach it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk edited a comment on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
potiuk edited a comment on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-1030658754
> Simply posting here if anyone's had any other fixes. Thanks for your help though.
Sure. But saying 'I have SIGKILL" is nowehere nearly being specicific SIGKILL is basically symptom that something forcefully killed your process. There are many reasons this can happen. And getting help without providing any details of the circumstances is extremely unlikely to even understand if anyone has any other fixes, because this one is specific to what you try to do in your DAGs I am afraid.
And it **might** be related to the fact that you use MacOS (which is not really supported because many libraries might simply not work there and it will provide "DIFFERENT" environment from what your employer uses (unless they use MacOS to run Airlfow). My suggestion was to switch to Virtualenv with Linux directly, or remote machine with Linux.
I just think you are shooting yourself in a foot a bit, but this is just advice. Treat the advice as a present - you can do whatever you want with it - ignore or apply or adapt to your case.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] pbotros commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
pbotros commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-731461394
That's likely - indeed, switching to an EC2 instance with more RAM and running fewer concurrent tasks seems to have stopped it so far. Unfortunately I can't confirm since the logs are now gone, but I bet you're right. TIL about overcommit! https://www.etalabs.net/overcommit.html
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ashb commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
ashb commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-732790644
I'm going to close this then -- if you have anyone has any more details we can look in to this -- commend (probably mention me directly) and I'll re-open this ticket.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] darwinyip commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
darwinyip commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-724933372
Experiencing the same on 1.10.12 running on AWS ECS(EC2).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] nickrinaldi88 edited a comment on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
nickrinaldi88 edited a comment on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-1030632363
Hi all, this issue has me banging my head. It occurs for some dags, but not others.
`export OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES`
does not work for me, neither does maximizing my docker resources.
I'm not in the state to update airflow, as my company uses 1.10.13, and we won't upgrade until later in the year.
If anyone has a personal solution that worked for them, let me know!
BTW, I'm using SequentialExecutor
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] nickrinaldi88 commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
nickrinaldi88 commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-1030632363
Hi all, This issue has me banging my head. It occurs for some dags, but not others.
`export OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES`
does not work for me, neither does maximizing my docker resources.
I'm not in the state to update airflow, as my company uses 1.10.13, and we won't upgrade until later in the year.
If anyone has a personal solution that worked for them, let me know!
BTW, I'm using SequentialExecutor
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] hsahovic commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
hsahovic commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-697544975
I encountered this issue - again - on another pipeline, using Airflow 1.10.10. Increasing docker resources resolved it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] jjjchens235 commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
jjjchens235 commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-765802234
I am running into a similar issue with Airflow 1.20.00 using Docker on macOS.
I ended up allocating more default memory to each docker container in Docker Desktop per this link, and it fixed it for me:
https://stackoverflow.com/questions/44533319/how-to-assign-more-memory-to-docker-container
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] pbotros commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
pbotros commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-731351567
This is also happening to me on AWS EC2 instances with airflow 1.10.12, ubuntu 18.04.5. It's not consistent but I've just started seeing it with some newly written tasks that use high %s of CPU & GPU for sustained periods. Will hunt for something that can reproduce that.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariuszliksza-kinesso removed a comment on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
mariuszliksza-kinesso removed a comment on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-694125941
Hmm, I have upgraded to version 1.10.12 and does not work for me.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] imsheth commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
imsheth commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-792285468
This doesn't solve the issue with DockerOperator on Mac with airflow 1.10.12
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] chsk-code commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
chsk-code commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-724926429
I have the same issue. My airflow(1.10.12) is running on AWS ECS(Fargate).
`INFO - Task exited with return code Negsignal.SIGKILL`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ignacioparicio commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
ignacioparicio commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-867576766
I got the same error on an EC2 instance with Ubuntu 20.04, Airflow 2.1.0, scheduler running locally. The cause was insufficient memory. I diagnosed it by running `sudo dmesg`:
```
Out of memory: Killed process 1282 (airflow task ru) total-vm:698780kB, anon-rss:186120kB, file-rss:628kB, shmem-rss:0kB, UID:1000 pgtables:964kB oom_score_adj:0
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mariuszliksza-kinesso commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
mariuszliksza-kinesso commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-694125941
Hmm, I have upgraded to version 1.10.12 and does not work for me.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #10435: Negsignal.SIGKILL error on macOS
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #10435:
URL: https://github.com/apache/airflow/issues/10435#issuecomment-1030658754
> Simply posting here if anyone's had any other fixes. Thanks for your help though.
Sure. But saying 'I have SIGKILL" is nowehere nearly being specicific SIGKILL is basically symptom that something forcefully killed your process. There are many reasons this can happen. And getting help without providing any details of the circumstances is extremely unlikely to even understand if anyone has any other fixes, because this one is specific to what you try to do in your DAGs I am afraid.
And it **might** be related to the fact that you use MacOS (which is not really supported because many libraries might simply not work there and it will provide "DIFFERENT" environment from what your employer uses (unless they use MacOS to run Airlfow). My suggestion was to switch to Virtualenv with Linux directly, or remote machine with Linux.
I just think you are shooting yourself in a foot a bit, but this is just advice. Treat it as a present - you can do whatever you want with it - ignore or apply or adapt to your case.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org