You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Joe McDonnell (Jira)" <ji...@apache.org> on 2023/05/05 05:19:00 UTC

[jira] [Created] (IMPALA-12118) Consider using pytorch cpuinfo library for CPU detection / logging

Joe McDonnell created IMPALA-12118:
--------------------------------------

             Summary: Consider using pytorch cpuinfo library for CPU detection / logging
                 Key: IMPALA-12118
                 URL: https://issues.apache.org/jira/browse/IMPALA-12118
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
    Affects Versions: Impala 4.3.0
            Reporter: Joe McDonnell


The code in be/src/util/cpu-info.h/.cc provides information about the CPU that we run on, along with NUMA configurations, cache sizes, etc. 

Pytorch's cpuinfo package seems to cover most of what we want to do across a much broader set of processors / architectures. It has a compatible license. See [https://github.com/pytorch/cpuinfo]

We should see if this is useful for our cpu detection code.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)