You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Fay Wang (JIRA)" <ji...@apache.org> on 2017/05/01 15:20:04 UTC

[jira] [Issue Comment Deleted] (CHUKWA-819) Hadoop problem determination using computer vision and machine learning

     [ https://issues.apache.org/jira/browse/CHUKWA-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Fay Wang updated CHUKWA-819:
----------------------------
    Comment: was deleted

(was: For distributed system, diagnose service and application problems can be challenging sometimes.  The main challenge is that the information are scattered across nodes and services.  The amount of data involved to describe the problem becomes non-trivial.  For simple problems, it can be explained by mapping job and task logs to isolate a particular problem.  More complex problems will involve trace through Spark, YARN, HBase and HDFS log files.  This feature describes mechanism that can be developed to support debugging more complex problems by using computer vision and machine learning algorithm to filter out noise and identify similar patterns to find the root cause of problems.)

> Hadoop problem determination using computer vision and machine learning
> -----------------------------------------------------------------------
>
>                 Key: CHUKWA-819
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-819
>             Project: Chukwa
>          Issue Type: New Feature
>    Affects Versions: 0.8.0
>            Reporter: Fay Wang
>             Fix For: 0.9.0
>
>
> Add CaffeOnSpark to Chukwa docker image to support memory leak image machine training using Caffe.  



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)