You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Zain Haider Nemati <za...@retailo.co> on 2022/05/15 11:04:37 UTC
taskexecutor .out files
Hi,
I have been running a streaming job which prints data to .out files the
size of the file has gotten really large and is choking the root memory for
my VM. Is it ok to delete the .out files? Would that affect any other
operation or functionality?
Re: taskexecutor .out files
Posted by Weihua Hu <hu...@gmail.com>.
Sorry, the command is parsed as reference.
The real command is :
" > taskmanager.out "
Best,
Weihua
> 2022年5月16日 下午9:52，Weihua Hu <hu...@gmail.com> 写道：
>
> Hi,
>
> Flink redirects stdout to the taskmanager.out when starting TaskManager.
> If taskmanager.out is deleted, Flink cannot automatically create taskmanager.out, which means any subsequent output to stdout will be lost.
>
> If you want to clean up the content of taskmanager.out, you can try using:
>
>> taskmanager.out
>
> This operation does not modify the Inode of the file and ensures that the Taskmanager can continue to redirects stdout to taskmanager.out
>
> Best,
> Weihua
>
>> 2022年5月15日 下午7:04，Zain Haider Nemati <za...@retailo.co> 写道：
>>
>> Hi,
>> I have been running a streaming job which prints data to .out files the size of the file has gotten really large and is choking the root memory for my VM. Is it ok to delete the .out files? Would that affect any other operation or functionality?
>
Re: taskexecutor .out files
Posted by Weihua Hu <hu...@gmail.com>.
Sorry, the command is parsed as reference.
The real command is :
" > taskmanager.out "
Best,
Weihua
> 2022年5月16日 下午9:52，Weihua Hu <hu...@gmail.com> 写道：
>
> Hi,
>
> Flink redirects stdout to the taskmanager.out when starting TaskManager.
> If taskmanager.out is deleted, Flink cannot automatically create taskmanager.out, which means any subsequent output to stdout will be lost.
>
> If you want to clean up the content of taskmanager.out, you can try using:
>
>> taskmanager.out
>
> This operation does not modify the Inode of the file and ensures that the Taskmanager can continue to redirects stdout to taskmanager.out
>
> Best,
> Weihua
>
>> 2022年5月15日 下午7:04，Zain Haider Nemati <za...@retailo.co> 写道：
>>
>> Hi,
>> I have been running a streaming job which prints data to .out files the size of the file has gotten really large and is choking the root memory for my VM. Is it ok to delete the .out files? Would that affect any other operation or functionality?
>
Re: taskexecutor .out files
Posted by Weihua Hu <hu...@gmail.com>.
Hi,
Flink redirects stdout to the taskmanager.out when starting TaskManager.
If taskmanager.out is deleted, Flink cannot automatically create taskmanager.out, which means any subsequent output to stdout will be lost.
If you want to clean up the content of taskmanager.out, you can try using:
> taskmanager.out
This operation does not modify the Inode of the file and ensures that the Taskmanager can continue to redirects stdout to taskmanager.out
Best,
Weihua
> 2022年5月15日 下午7:04，Zain Haider Nemati <za...@retailo.co> 写道：
>
> Hi,
> I have been running a streaming job which prints data to .out files the size of the file has gotten really large and is choking the root memory for my VM. Is it ok to delete the .out files? Would that affect any other operation or functionality?
Re: taskexecutor .out files
Posted by Weihua Hu <hu...@gmail.com>.
Hi,
Flink redirects stdout to the taskmanager.out when starting TaskManager.
If taskmanager.out is deleted, Flink cannot automatically create taskmanager.out, which means any subsequent output to stdout will be lost.
If you want to clean up the content of taskmanager.out, you can try using:
> taskmanager.out
This operation does not modify the Inode of the file and ensures that the Taskmanager can continue to redirects stdout to taskmanager.out
Best,
Weihua
> 2022年5月15日 下午7:04，Zain Haider Nemati <za...@retailo.co> 写道：
>
> Hi,
> I have been running a streaming job which prints data to .out files the size of the file has gotten really large and is choking the root memory for my VM. Is it ok to delete the .out files? Would that affect any other operation or functionality?
Re: taskexecutor .out files
Posted by Zhilong Hong <zh...@gmail.com>.
Hi, Zain:
The taskmanager.out only contains contents outputted by stdout. Sometimes
some fatal exceptions, like JVM exit exceptions and so on will be outputted
to the .out file. If you don't specify the file path for the gc log, the
content of the gc log will be saved into the .out file, too. However, it's
safe to delete the .out file on the TaskExecutors. Once it's deleted,
another new .out file will be created.
Best,
Zhilong
On Sun, May 15, 2022 at 7:05 PM Zain Haider Nemati <za...@retailo.co>
wrote:
> Hi,
> I have been running a streaming job which prints data to .out files the
> size of the file has gotten really large and is choking the root memory for
> my VM. Is it ok to delete the .out files? Would that affect any other
> operation or functionality?
>