[jira] [Created] (ARROW-17627) [GO][Parquet] Unable to pass metadata without StoreSchema

["Yan Zhou (Jira)" <ji...@apache.org>]

Yan Zhou created ARROW-17627:
--------------------------------

             Summary: [GO][Parquet] Unable to pass metadata without StoreSchema
                 Key: ARROW-17627
                 URL: https://issues.apache.org/jira/browse/ARROW-17627
             Project: Apache Arrow
          Issue Type: Bug
          Components: Go, Parquet
    Affects Versions: 9.0.0
            Reporter: Yan Zhou


[https://github.com/apache/arrow/blob/master/go/parquet/pqarrow/file_writer.go#L75|https://github.com/apache/arrow/blob/master/go/parquet/pqarrow/file_writer.go#L75,]

 

Right now the only way to pass in KV metadata is to enable StoreSchema and pass it as part of the schema. In otherwise we can't pass through metadata without also store ARROW:schema

 

I suggest change it to the following

 
{code:go}
	meta := make(metadata.KeyValueMetadata, 0)
	for i := 0; i < arrschema.Metadata().Len(); i++ {
		meta.Append(arrschema.Metadata().Keys()[i], arrschema.Metadata().Values()[i])
	}

	if arrprops.storeSchema {

		serializedSchema := flight.SerializeSchema(arrschema, props.Allocator())
		meta.Append("ARROW:schema", base64.StdEncoding.EncodeToString(serializedSchema))
	}
{code}
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)