You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "Blajda (via GitHub)" <gi...@apache.org> on 2023/11/05 02:48:29 UTC

[I] Regression when serializing large json numbers [arrow-rs]

Blajda opened a new issue, #5038:
URL: https://github.com/apache/arrow-rs/issues/5038

   **Describe the bug**
   Serializing and writing a json Number `Number(1699148028689)` to parquet using `arrow_json` the value is not preserved.
   When the value is read back from the parquet file, we obtain `-1659020527`.
   
   
   **To Reproduce**
   ```rust
       #[test]
       fn test_serde_field() {
           let field = Field::new("int", DataType::Int64, true);
           let mut decoder = ReaderBuilder::new_with_field(field)
               .build_decoder()
               .unwrap();
           decoder.serialize(&[1699148028689_u64, 2, 3, 4]).unwrap();
           let b = decoder.flush().unwrap().unwrap();
           let values = b.column(0).as_primitive::<Int64Type>().values();
           assert_eq!(values, &[1699148028689, 2, 3, 4]);
       }
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Regression when serializing large json numbers [arrow-rs]

Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #5038:
URL: https://github.com/apache/arrow-rs/issues/5038#issuecomment-1799290949

   `label_issue.py` automatically added labels {'arrow'} from #5042


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Regression when serializing large json numbers [arrow-rs]

Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #5038:
URL: https://github.com/apache/arrow-rs/issues/5038#issuecomment-1793860332

   Possibly introduced by https://github.com/apache/arrow-rs/pull/4861. I can take a look


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Regression when serializing large json numbers [arrow-rs]

Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold closed issue #5038: Regression when serializing large json numbers
URL: https://github.com/apache/arrow-rs/issues/5038


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Regression when serializing large json numbers [arrow-rs]

Posted by "Blajda (via GitHub)" <gi...@apache.org>.
Blajda commented on issue #5038:
URL: https://github.com/apache/arrow-rs/issues/5038#issuecomment-1797148637

   Thanks for the fix @tustvold 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org