You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@texera.apache.org by "carloea2 (via GitHub)" <gi...@apache.org> on 2026/08/31 06:14:39 UTC

[I] Raw binary values with a pickle prefix fail Arrow decoding [texera]

carloea2 opened a new issue, #8268:
URL: https://github.com/apache/texera/issues/8268

   ### What happened?
   
   `ArrowTableTupleProvider` treats every binary value beginning with the six bytes `pickle` as Texera's pickled-object envelope. The actual envelope uses the ten-byte header `pickle` followed by four spaces. Legitimate raw bytes such as `b"picklehello"` are therefore passed to `pickle.loads` and fail instead of round-tripping unchanged.
   
   Before: a raw binary value beginning with `pickle` can raise `UnpicklingError` while being read from Arrow.
   
   Expected: only the complete Texera pickle header triggers unpickling; other binary values remain bytes.
   
   ### How to reproduce?
   
   1. Build an Arrow binary column containing `b"picklehello"`.
   2. Read it through `ArrowTableTupleProvider`.
   3. Access the field and observe `_pickle.UnpicklingError`.
   
   ### Version or branch
   
   1.3.0-incubating-SNAPSHOT on main
   
   ### Commit hash
   
   50321e403c82df299a13deb50a7f9849dd93bdba
   
   ### Relevant log output
   
   _pickle.UnpicklingError: could not find MARK


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Raw binary values with a pickle prefix fail Arrow decoding [texera]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #8268:
URL: https://github.com/apache/texera/issues/8268#issuecomment-5474493001

   <!-- texera:template-compliance -->
   👋 Thanks for opening this issue, @carloea2!
   
   It looks like the issue description doesn't quite follow our template yet:
   
   - This issue doesn't appear to use one of our templates (Bug, Feature, or Task). Please open it using a template so the required details are captured.
   
   Filling out the template helps reviewers understand and triage your contribution faster. Please edit the description to complete it. This message will disappear automatically once the template is followed.
   
   You can find the template prompts by editing the description, or see [CONTRIBUTING.md](https://github.com/apache/texera/blob/main/CONTRIBUTING.md) for the full contribution flow.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Raw binary values with a pickle prefix fail Arrow decoding [texera]

Posted by "carloea2 (via GitHub)" <gi...@apache.org>.
carloea2 commented on issue #8268:
URL: https://github.com/apache/texera/issues/8268#issuecomment-5548200258

   /take


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org