You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/06/01 20:24:23 UTC

[GitHub] [arrow-datafusion] edrevo opened a new issue #472: [Ballista] Improve task and job metadata

edrevo opened a new issue #472:
URL: https://github.com/apache/arrow-datafusion/issues/472


   The task and job status we save in the scheduler state is currently lacking. See:
   
   https://github.com/apache/arrow-datafusion/blob/16011120a1b73798049c5be49f9548b00f8a0a00/ballista/rust/core/proto/ballista.proto#L669-L680
   
   And
   
   https://github.com/apache/arrow-datafusion/blob/16011120a1b73798049c5be49f9548b00f8a0a00/ballista/rust/core/proto/ballista.proto#L614-L624
   
   The job status should include:
   
   - Start time for the job (the moment it was queued)
   - Finish time for the job (for the completed state)
   - Number of pending/running/completed/failed tasks and stages (for the running state)
   
   The task status should include:
   
   - Start time for the task
   - Finish time for the task (for the completed state)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] edrevo commented on issue #472: [Ballista] Improve task and job metadata

Posted by GitBox <gi...@apache.org>.

edrevo commented on issue #472:
URL: https://github.com/apache/arrow-datafusion/issues/472#issuecomment-852422276


   cc @pradomota. I'm opening this one in case you want to take a stab at it 😉 We can do pair programming if you want.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] msathis commented on issue #472: [Ballista] Improve task and job metadata

Posted by GitBox <gi...@apache.org>.

msathis commented on issue #472:
URL: https://github.com/apache/arrow-datafusion/issues/472#issuecomment-852710260


   This will be great addition. We can expose this information to the UI as well.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org