You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Marvin Giessing (Jira)" <ji...@apache.org> on 2022/08/10 10:26:00 UTC

[jira] [Created] (ARROW-17372) Arrow parquet go is missing Power (ppc64le) specific utils implementations

Marvin Giessing created ARROW-17372:
---------------------------------------

             Summary: Arrow parquet go is missing Power (ppc64le) specific utils implementations
                 Key: ARROW-17372
                 URL: https://issues.apache.org/jira/browse/ARROW-17372
             Project: Apache Arrow
          Issue Type: Bug
          Components: Go
    Affects Versions: 8.0.1, 8.0.0
         Environment: Linux (RHEL) ppc64le
            Reporter: Marvin Giessing


When trying to build the [feast go lib|https://github.com/feast-dev/feast/tree/master/go] on ppc64le it fails because parquet internal seems to miss even the basic (pure go implementations for ppc64le) files. Providing e.g. bit_packing_ppc64le.go & unpack_bool_ppc64le.go should solve this issue in the first place.

It can then be enhanced by implementing the correct vector & matrix intrinsics for the Power architecture (e.g. VSX or MMA) in a second step.
go build -mod=mod -buildmode=c-shared -tags cgo,ccalloc -o embedded_go.so .
cmd had error: exit status 2  output:
# github.com/apache/arrow/go/v8/parquet/internal/utils
/root/go/pkg/mod/github.com/apache/arrow/go/v8@v8.0.0/parquet/internal/utils/bit_reader.go:230:18: undefined: unpack32
/root/go/pkg/mod/github.com/apache/arrow/go/v8@v8.0.0/parquet/internal/utils/bit_reader.go:274:3: undefined: BytesToBools
/root/go/pkg/mod/github.com/apache/arrow/go/v8@v8.0.0/parquet/internal/utils/bit_reader.go:318:18: undefined: unpack32


I tested this already locally (with success) and create an according PR.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)