[jira] [Created] (ARROW-15208) parquet StreamWriter nanosecond timestamp support

["Rob Ambalu (Jira)" <ji...@apache.org>]

Rob Ambalu created ARROW-15208:
----------------------------------

             Summary: parquet StreamWriter nanosecond timestamp support
                 Key: ARROW-15208
                 URL: https://issues.apache.org/jira/browse/ARROW-15208
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Rob Ambalu


I'm trying to use the parquet StreamWriter interface for convenience.  It works great, except it doesnt seem to have support for nanoseconds.  There are stream operators for std::chrono:milliseconds and std::chrono::microseconds but not std::chrono:nanoseconds.

Adding an overload would probably be simplest if that sounds reasonable.

I also tried to derive from StreamWriter myself in order to introduce the operator locally to get around this, but I hit a linker error on the constexpr variables defined in the base ( not really sure why honestly )

 
{code:java}
Python-3.6.4/lib/python3.6/site-packages/pyarrow/libparquet.a(stream_writer.cc.o):(.rodata+0x78): multiple definition of `parquet::StreamWriter::kRepLevelZero'; 
binutils-2.31/bin/ld: DWARF error: can't find .debug_ranges section.
mktdata_playback.dir/ParquetWriter.cpp.o:(.rodata._ZN7parquet12StreamWriter13kRepLevelZeroE[_ZN7parquet12StreamWriter13kRepLevelZeroE]+0x0): first defined here
binutils-2.31/bin/ld: Python-3.6.4/lib/python3.6/site-packages/pyarrow/libparquet.a(stream_writer.cc.o):(.rodata+0x7a): multiple definition of `parquet::StreamWriter::kDefLevelOne'; mktdata_playback.dir/ParquetWriter.cpp.o:(.rodata._ZN7parquet12StreamWriter12kDefLevelOneE[_ZN7parquet12StreamWriter12kDefLevelOneE]+0x0): first defined here
 {code}
I cant find any other way around this

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)