You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "nk-fouque (via GitHub)" <gi...@apache.org> on 2023/10/20 09:15:21 UTC

[I] Find the right pyarrow version for my GLIBC version (AWS Lambda) [arrow]

nk-fouque opened a new issue, #38373:
URL: https://github.com/apache/arrow/issues/38373

   ### Describe the usage question you have. Please include as many useful details as  possible.
   
   
   Hi, I am using pyarrow as a dependency of another library in my project running on AWS Lambda. 
   Sadly, when I try to run my lambda I get the error `lib64/libm.so.6: version 'GLIBC_2.27' not found (required by /mnt/efs/site-packages/pyarrow/libarrow.so.1300)",`
   Indeed AWS Lambda documentation specifies [here](https://docs.aws.amazon.com/AL2/latest/relnotes/relnotes-20230424.html) that the AmazonLinux 2 image only comes with glibc 2.26.
   I am trying to figure out how much I have to downgrade pyarrow to find the right version that uses glibc 2.26 but I can't find any indications on the matter.
   Help would be appreciated.
   
   ### Component(s)
   
   Continuous Integration, Python


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Find the right pyarrow version for my GLIBC version (AWS Lambda) [arrow]

Posted by "monkeyZhy (via GitHub)" <gi...@apache.org>.
monkeyZhy commented on issue #38373:
URL: https://github.com/apache/arrow/issues/38373#issuecomment-1880697740

   But my system has GLIBC version 2.17, what version of pyarrow supports it?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Find the right pyarrow version for my GLIBC version (AWS Lambda) [arrow]

Posted by "liuss-buaa (via GitHub)" <gi...@apache.org>.
liuss-buaa commented on issue #38373:
URL: https://github.com/apache/arrow/issues/38373#issuecomment-2677319980

   > But my system has GLIBC version 2.17, what version of pyarrow supports it?
   
   I get the same error. Have you fixed it?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Find the right pyarrow version for my GLIBC version (AWS Lambda) [arrow]

Posted by "nk-fouque (via GitHub)" <gi...@apache.org>.
nk-fouque commented on issue #38373:
URL: https://github.com/apache/arrow/issues/38373#issuecomment-1772696688

   Thanks, that version worked with no problem.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Find the right pyarrow version for my GLIBC version (AWS Lambda) [arrow]

Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on issue #38373:
URL: https://github.com/apache/arrow/issues/38373#issuecomment-1772402128

   Hi,
   We did drop support for Amazon Linux 2 on 13.0.0, see: https://github.com/apache/arrow/issues/36241
   12.0.0 was still supported. We added support for Amazon Linux 2023 on 13.0.0, see: https://github.com/apache/arrow/issues/36006


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Find the right pyarrow version for my GLIBC version (AWS Lambda) [arrow]

Posted by "meze-pomelo (via GitHub)" <gi...@apache.org>.
meze-pomelo commented on issue #38373:
URL: https://github.com/apache/arrow/issues/38373#issuecomment-1829807732

   I get the same error. 
   I fix it declaring the next versions
   
   pyarrow == 12.0.1
   boto3 == 1.26.76
   botocore == 1.29.76 
   
   Context: Amazon Linux 2, with python 3.8


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Find the right pyarrow version for my GLIBC version (AWS Lambda) [arrow]

Posted by "nk-fouque (via GitHub)" <gi...@apache.org>.
nk-fouque closed issue #38373: Find the right pyarrow version for my GLIBC version (AWS Lambda)
URL: https://github.com/apache/arrow/issues/38373


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Find the right pyarrow version for my GLIBC version (AWS Lambda) [arrow]

Posted by "monkeyZhy (via GitHub)" <gi...@apache.org>.
monkeyZhy commented on issue #38373:
URL: https://github.com/apache/arrow/issues/38373#issuecomment-2677325405

   > > But my system has GLIBC version 2.17, what version of pyarrow supports it?
   > 
   > I get the same error. Have you fixed it?
   
   yes! I remember that you need to downgrade the version of pyarrow to 8.x. You can downgrade bit by bit and debug it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Find the right pyarrow version for my GLIBC version (AWS Lambda) [arrow]

Posted by "liuss-buaa (via GitHub)" <gi...@apache.org>.
liuss-buaa commented on issue #38373:
URL: https://github.com/apache/arrow/issues/38373#issuecomment-2677327271

   > > > But my system has GLIBC version 2.17, what version of pyarrow supports it?
   > > 
   > > 
   > > I get the same error. Have you fixed it?
   > 
   > yes! I remember that you need to downgrade the version of pyarrow to 8.x. You can downgrade bit by bit and debug it.
   
   thank you very much!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org