You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2023/01/05 15:28:31 UTC

[GitHub] [beam] AnandInguva opened a new issue, #24903: [Task]: Create a script to train sklearn model for IT test.

AnandInguva opened a new issue, #24903:
URL: https://github.com/apache/beam/issues/24903

   ### What needs to happen?
   
   Sklearn doesn't offer backward compatibility wrt models on newer versions. In the Sklearn IT tests, we use models trained manually and this can get outdated when there is an update to sklearn. 
   
   So to tackle this, we need to create a script which trains the sklearn models on the data and then publish this model to a GCS bucket, once this is done we can use this model to run Sklearn IT test.
   
   ### Issue Priority
   
   Priority: 2 (default / most normal work should be filed as P2)
   
   ### Issue Components
   
   - [X] Component: Python SDK
   - [ ] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [ ] Component: IO connector
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [ ] Component: Spark Runner
   - [ ] Component: Flink Runner
   - [ ] Component: Samza Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [ ] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1469981327

   Hello Anand,
   Hope you are doing well,waiting for your feedback on this issue .
   
   Best Regards
   Siddharth Aryan.
   
   On Sat, Mar 11, 2023, 4:17 PM Siddharth Aryan ***@***.***>
   wrote:
   
   > And HAPPY BELATED HOLI to you and your family...Hope you had a fabulous
   > Holi.
   >
   > On Fri, Mar 10, 2023 at 1:52 PM Siddharth Aryan <
   > ***@***.***> wrote:
   >
   >> Hey Anand,
   >> I am attaching a file which contains the script that train the housing
   >> data and saves the trained models to GCS i dont have an GCS account so i
   >> hve just put in the code that will save the model to Gcs location.This file
   >> just contains the code and reflect the things that it will do. I have
   >> limitations in my system which i am trying to fix to run this in a
   >> pipeline.In the moment just want your feedback on the code which will help
   >> me to fix the issue.And thank you for tremendous support throughout and
   >> patience.
   >>
   >> On Tue, Feb 28, 2023 at 10:20 PM Anand Inguva ***@***.***>
   >> wrote:
   >>
   >>> Hey Anand, Sorry but because of my other stuff (my mid sem
   >>> exams,tutoring and GSOC preparation)i was not able to focus on this
   >>> project.To inform you about my progress i have already learnt about the
   >>> respective things to create a script.i need some more days to finish it
   >>> off.And again i am sorry for not updating you with my progress
   >>> previously.Hope you understand.
   >>>
   >>> Hi, please take your time and work when you can on Beam. I am here to
   >>> help you in anyway I can. Thanks for the update,
   >>>
   >>> —
   >>> Reply to this email directly, view it on GitHub
   >>> <https://github.com/apache/beam/issues/24903#issuecomment-1448514686>,
   >>> or unsubscribe
   >>> <https://github.com/notifications/unsubscribe-auth/AUA2XLWHYXOU7JDI4ZFTJRTWZYUGPANCNFSM6AAAAAATSCNU4Y>
   >>> .
   >>> You are receiving this because you commented.Message ID:
   >>> ***@***.***>
   >>>
   >>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1479810763

   Hello Anand,
   Hope you are doing well.Can you please review the pull request [
   https://github.com/apache/beam/pull/25926].And thanks for tremendous
   support and patience.
   
   On Fri, Feb 3, 2023 at 12:27 AM Anand Inguva ***@***.***>
   wrote:
   
   > The script here
   > <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da>
   > trains the Sklearn model required to run inference on Japanese housing
   > dataset IT test
   > <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   > .
   >
   > Now, the problem is we have a set of Sklearn models trained and saved in
   > GCS path. So we use that models for IT testing. But these models are not
   > forward compatible with newer version of sklearn. So to resolve this issue,
   > we would like to
   >
   >    - create a script that could run and train the script
   >    <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da>
   >    - Save the trained models on a GCS location
   >    - Run the pipeline in the example
   >    <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   >    as IT test using the above saved model.
   >    - Add this setup to the Beam infra and make sure this gets run as part
   >    of postcommit tests(I can help here once the above thing is done)
   >
   > —
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/beam/issues/24903#issuecomment-1414215656>, or
   > unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLT34RXU7SD7ENEPOADWVP7Q5ANCNFSM6AAAAAATSCNU4Y>
   > .
   > You are receiving this because you commented.Message ID:
   > ***@***.***>
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] AnandInguva commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "AnandInguva (via GitHub)" <gi...@apache.org>.
AnandInguva commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1414217446

   You can go through the Sklearn beam example and the sklearn training script. If you are ready to do it, please let me know and we can forward with setting up data.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1480594134

   I tried adding you as a reviewer but I think because my code is not able to
   pass the RAT test it is not giving me the permission of adding a reviewer.
   
   On Thu, Mar 23, 2023 at 2:37 AM Anand Inguva ***@***.***>
   wrote:
   
   > Hello Anand, Hope you are doing well.Can you please review the pull
   > request [ #25926 <https://github.com/apache/beam/pull/25926>] <#25926
   > <https://github.com/apache/beam/pull/25926>%5D.And>.
   > … <#m_-1917160400074648902_>
   > On Fri, Feb 3, 2023 at 12:27 AM Anand Inguva *@*.*> wrote: The script
   > here https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da
   > <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da>
   > trains the Sklearn model required to run inference on Japanese housing
   > dataset IT test
   > https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py
   > <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   > . Now, the problem is we have a set of Sklearn models trained and saved in
   > GCS path. So we use that models for IT testing. But these models are not
   > forward compatible with newer version of sklearn. So to resolve this issue,
   > we would like to - create a script that could run and train the script
   > https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da
   > <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da> -
   > Save the trained models on a GCS location - Run the pipeline in the example
   > https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py
   > <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   > as IT test using the above saved model. - Add this setup to the Beam infra
   > and make sure this gets run as part of postcommit tests(I can help here
   > once the above thing is done) — Reply to this email directly, view it on
   > GitHub <#24903 (comment)
   > <https://github.com/apache/beam/issues/24903#issuecomment-1414215656>>, or
   > unsubscribe
   > https://github.com/notifications/unsubscribe-auth/AUA2XLT34RXU7SD7ENEPOADWVP7Q5ANCNFSM6AAAAAATSCNU4Y
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLT34RXU7SD7ENEPOADWVP7Q5ANCNFSM6AAAAAATSCNU4Y>
   > . You are receiving this because you commented.Message ID: @.*>
   >
   > Thanks I will take a look soon
   >
   > —
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/beam/issues/24903#issuecomment-1480261200>, or
   > unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLQKWU4DP5TUTCWBJJLW5NSZ7ANCNFSM6AAAAAATSCNU4Y>
   > .
   > You are receiving this because you were assigned.Message ID:
   > ***@***.***>
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1411535220

   Hey Anand,
   Can you please assign me this issue as i would like to contribute.And if you can also guide me it will be perfect.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1479817660

   Hello Anand,
   Hope you are doing well.Can you please review the pull request [
   https://github.com/apache/beam/pull/25926]
   <https://github.com/apache/beam/pull/25926%5D.And>.
   
   On Fri, Feb 3, 2023 at 12:27 AM Anand Inguva ***@***.***>
   wrote:
   
   > The script here
   > <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da>
   > trains the Sklearn model required to run inference on Japanese housing
   > dataset IT test
   > <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   > .
   >
   > Now, the problem is we have a set of Sklearn models trained and saved in
   > GCS path. So we use that models for IT testing. But these models are not
   > forward compatible with newer version of sklearn. So to resolve this issue,
   > we would like to
   >
   >    - create a script that could run and train the script
   >    <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da>
   >    - Save the trained models on a GCS location
   >    - Run the pipeline in the example
   >    <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   >    as IT test using the above saved model.
   >    - Add this setup to the Beam infra and make sure this gets run as part
   >    of postcommit tests(I can help here once the above thing is done)
   >
   > —
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/beam/issues/24903#issuecomment-1414215656>, or
   > unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLT34RXU7SD7ENEPOADWVP7Q5ANCNFSM6AAAAAATSCNU4Y>
   > .
   > You are receiving this because you commented.Message ID:
   > ***@***.***>
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1445392294

   Hey Anand,
   Sorry but because of my other stuff (my mid sem exams,tutoring and GSOC preparation)i was not able to focus on this project.To inform you about my progress i have already learnt about the respective things to create a script.i need some more days to finish it off.And again i am sorry for not updating you with my progress previously.Hope you understand.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1480563547

   Thanks for the reply.Can you do me favour Anand  actually i prepared a
   Proposal for a project named Sentimental Analysis can you please review it
   and reply me with a feedback.
   Proposal Link: [
   https://docs.google.com/document/d/1U6zcXAWsDCrWlbf14f5VlLqPZFucwXR48tD7mrERW-g/edit
   ]
   
   
   On Thu, Mar 23, 2023 at 2:37 AM Anand Inguva ***@***.***>
   wrote:
   
   > Hello Anand, Hope you are doing well.Can you please review the pull
   > request [ #25926 <https://github.com/apache/beam/pull/25926>] <#25926
   > <https://github.com/apache/beam/pull/25926>%5D.And>.
   > … <#m_-6043284037195056831_>
   > On Fri, Feb 3, 2023 at 12:27 AM Anand Inguva *@*.*> wrote: The script
   > here https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da
   > <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da>
   > trains the Sklearn model required to run inference on Japanese housing
   > dataset IT test
   > https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py
   > <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   > . Now, the problem is we have a set of Sklearn models trained and saved in
   > GCS path. So we use that models for IT testing. But these models are not
   > forward compatible with newer version of sklearn. So to resolve this issue,
   > we would like to - create a script that could run and train the script
   > https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da
   > <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da> -
   > Save the trained models on a GCS location - Run the pipeline in the example
   > https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py
   > <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   > as IT test using the above saved model. - Add this setup to the Beam infra
   > and make sure this gets run as part of postcommit tests(I can help here
   > once the above thing is done) — Reply to this email directly, view it on
   > GitHub <#24903 (comment)
   > <https://github.com/apache/beam/issues/24903#issuecomment-1414215656>>, or
   > unsubscribe
   > https://github.com/notifications/unsubscribe-auth/AUA2XLT34RXU7SD7ENEPOADWVP7Q5ANCNFSM6AAAAAATSCNU4Y
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLT34RXU7SD7ENEPOADWVP7Q5ANCNFSM6AAAAAATSCNU4Y>
   > . You are receiving this because you commented.Message ID: @.*>
   >
   > Thanks I will take a look soon
   >
   > —
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/beam/issues/24903#issuecomment-1480261200>, or
   > unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLQKWU4DP5TUTCWBJJLW5NSZ7ANCNFSM6AAAAAATSCNU4Y>
   > .
   > You are receiving this because you were assigned.Message ID:
   > ***@***.***>
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1415642988

   Thank you for the reply.And yes i am up for the task but first please give
   me atleast 2 days to go through the Sklearn beam  example,the sklearn
   training
   
   On Fri, Feb 3, 2023 at 12:28 AM Anand Inguva ***@***.***>
   wrote:
   
   > You can go through the Sklearn beam example and the sklearn training
   > script. If you are ready to do it, please let me know and we can forward
   > with setting up data.
   >
   > —
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/beam/issues/24903#issuecomment-1414217446>, or
   > unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLX2ZJ5EP2PTOPEWCKLWVP7WXANCNFSM6AAAAAATSCNU4Y>
   > .
   > You are receiving this because you commented.Message ID:
   > ***@***.***>
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1415402653

   Thank you for the reply and I am looking forward to working under
   your guidance ,just give me a day to go through it.
   
   On Fri, Feb 3, 2023, 12:28 AM Anand Inguva ***@***.***> wrote:
   
   > You can go through the Sklearn beam example and the sklearn training
   > script. If you are ready to do it, please let me know and we can forward
   > with setting up data.
   >
   > —
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/beam/issues/24903#issuecomment-1414217446>, or
   > unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLX2ZJ5EP2PTOPEWCKLWVP7WXANCNFSM6AAAAAATSCNU4Y>
   > .
   > You are receiving this because you commented.Message ID:
   > ***@***.***>
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] AnandInguva commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "AnandInguva (via GitHub)" <gi...@apache.org>.
AnandInguva commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1448514686

   > Hey Anand, Sorry but because of my other stuff (my mid sem exams,tutoring and GSOC preparation)i was not able to focus on this project.To inform you about my progress i have already learnt about the respective things to create a script.i need some more days to finish it off.And again i am sorry for not updating you with my progress previously.Hope you understand.
   
   Hi, please take your time and work when you can on Beam. I am here to help you in anyway I can. Thanks for the update,


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] AnandInguva commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "AnandInguva (via GitHub)" <gi...@apache.org>.
AnandInguva commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1412612515

   You can comment `.take-issue` for self assigning.
   
   Let me take a look on what we need for this task.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1482211240

   I have provided the google doc link.You can now go and review it..And thanks for the tremendous support and patience.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1480565640

   Thanks for the reply Anand .And can you please do me a favour ,I have
   prepared a Proposal for a project named Sentimental Analysis for GSOC2023
   can you please review it and give me a feedback.I did sent to the dev
   mailing list but no one replied,so can you please take some time out and do
   it , it would mean great to me.
   Project link:
   https://docs.google.com/document/d/1U6zcXAWsDCrWlbf14f5VlLqPZFucwXR48tD7mrERW-g/edit
   
   Your Sincerely
   Siddharth Aryan
   
   On Thu, Mar 23, 2023 at 2:37 AM Anand Inguva ***@***.***>
   wrote:
   
   > Hello Anand, Hope you are doing well.Can you please review the pull
   > request [ #25926 <https://github.com/apache/beam/pull/25926>] <#25926
   > <https://github.com/apache/beam/pull/25926>%5D.And>.
   > … <#m_-6043284037195056831_>
   > On Fri, Feb 3, 2023 at 12:27 AM Anand Inguva *@*.*> wrote: The script
   > here https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da
   > <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da>
   > trains the Sklearn model required to run inference on Japanese housing
   > dataset IT test
   > https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py
   > <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   > . Now, the problem is we have a set of Sklearn models trained and saved in
   > GCS path. So we use that models for IT testing. But these models are not
   > forward compatible with newer version of sklearn. So to resolve this issue,
   > we would like to - create a script that could run and train the script
   > https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da
   > <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da> -
   > Save the trained models on a GCS location - Run the pipeline in the example
   > https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py
   > <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   > as IT test using the above saved model. - Add this setup to the Beam infra
   > and make sure this gets run as part of postcommit tests(I can help here
   > once the above thing is done) — Reply to this email directly, view it on
   > GitHub <#24903 (comment)
   > <https://github.com/apache/beam/issues/24903#issuecomment-1414215656>>, or
   > unsubscribe
   > https://github.com/notifications/unsubscribe-auth/AUA2XLT34RXU7SD7ENEPOADWVP7Q5ANCNFSM6AAAAAATSCNU4Y
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLT34RXU7SD7ENEPOADWVP7Q5ANCNFSM6AAAAAATSCNU4Y>
   > . You are receiving this because you commented.Message ID: @.*>
   >
   > Thanks I will take a look soon
   >
   > —
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/beam/issues/24903#issuecomment-1480261200>, or
   > unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLQKWU4DP5TUTCWBJJLW5NSZ7ANCNFSM6AAAAAATSCNU4Y>
   > .
   > You are receiving this because you were assigned.Message ID:
   > ***@***.***>
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1476286408

   .take-issue
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] AnandInguva commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "AnandInguva (via GitHub)" <gi...@apache.org>.
AnandInguva commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1480261200

   > Hello Anand, Hope you are doing well.Can you please review the pull request [ #25926] <#25926%5D.And>.
   > […](#)
   > On Fri, Feb 3, 2023 at 12:27 AM Anand Inguva ***@***.***> wrote: The script here <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da> trains the Sklearn model required to run inference on Japanese housing dataset IT test <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py> . Now, the problem is we have a set of Sklearn models trained and saved in GCS path. So we use that models for IT testing. But these models are not forward compatible with newer version of sklearn. So to resolve this issue, we would like to - create a script that could run and train the script <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da> - Save the trained models on a GCS location - Run the pipeline in the example <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py> as IT test using the above saved model. - Add this set
 up to the Beam infra and make sure this gets run as part of postcommit tests(I can help here once the above thing is done) — Reply to this email directly, view it on GitHub <[#24903 (comment)](https://github.com/apache/beam/issues/24903#issuecomment-1414215656)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AUA2XLT34RXU7SD7ENEPOADWVP7Q5ANCNFSM6AAAAAATSCNU4Y> . You are receiving this because you commented.Message ID: ***@***.***>
   
   Thanks I will take a look soon


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] liferoad commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "liferoad (via GitHub)" <gi...@apache.org>.
liferoad commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1476272930

   @nervoussidd If you plan to work on this issue, please add the comment .take-issue for self assigning. Feel free to do some small PRs for code reviewing.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1464883717

   And HAPPY BELATED HOLI to you and your family...Hope you had a fabulous
   Holi.
   
   On Fri, Mar 10, 2023 at 1:52 PM Siddharth Aryan ***@***.***>
   wrote:
   
   > Hey Anand,
   > I am attaching a file which contains the script that train the housing
   > data and saves the trained models to GCS i dont have an GCS account so i
   > hve just put in the code that will save the model to Gcs location.This file
   > just contains the code and reflect the things that it will do. I have
   > limitations in my system which i am trying to fix to run this in a
   > pipeline.In the moment just want your feedback on the code which will help
   > me to fix the issue.And thank you for tremendous support throughout and
   > patience.
   >
   > On Tue, Feb 28, 2023 at 10:20 PM Anand Inguva ***@***.***>
   > wrote:
   >
   >> Hey Anand, Sorry but because of my other stuff (my mid sem exams,tutoring
   >> and GSOC preparation)i was not able to focus on this project.To inform you
   >> about my progress i have already learnt about the respective things to
   >> create a script.i need some more days to finish it off.And again i am sorry
   >> for not updating you with my progress previously.Hope you understand.
   >>
   >> Hi, please take your time and work when you can on Beam. I am here to
   >> help you in anyway I can. Thanks for the update,
   >>
   >> —
   >> Reply to this email directly, view it on GitHub
   >> <https://github.com/apache/beam/issues/24903#issuecomment-1448514686>,
   >> or unsubscribe
   >> <https://github.com/notifications/unsubscribe-auth/AUA2XLWHYXOU7JDI4ZFTJRTWZYUGPANCNFSM6AAAAAATSCNU4Y>
   >> .
   >> You are receiving this because you commented.Message ID:
   >> ***@***.***>
   >>
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1463418019

   Hey Anand,
   I am attaching a file which contains the script that train the housing data
   and saves the trained models to GCS i dont have an GCS account so i hve
   just put in the code that will save the model to Gcs location.This file
   just contains the code and reflect the things that it will do. I have
   limitations in respect ot my system which i am trying to fix to run this in
   a pipeline.In the moment just want your feedback on the code which will
   help me to fix the issue.And thank you for tremendous support throughout
   and patience.
   
   On Tue, Feb 28, 2023 at 10:20 PM Anand Inguva ***@***.***>
   wrote:
   
   > Hey Anand, Sorry but because of my other stuff (my mid sem exams,tutoring
   > and GSOC preparation)i was not able to focus on this project.To inform you
   > about my progress i have already learnt about the respective things to
   > create a script.i need some more days to finish it off.And again i am sorry
   > for not updating you with my progress previously.Hope you understand.
   >
   > Hi, please take your time and work when you can on Beam. I am here to help
   > you in anyway I can. Thanks for the update,
   >
   > —
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/beam/issues/24903#issuecomment-1448514686>, or
   > unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLWHYXOU7JDI4ZFTJRTWZYUGPANCNFSM6AAAAAATSCNU4Y>
   > .
   > You are receiving this because you commented.Message ID:
   > ***@***.***>
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1415779394

   Thank You for the reply.YES i am ready to work under your guidance.But
   please give me atleast 2 days to go through the Sklearn beam example and
   the sklearn training script..
   
   On Fri, Feb 3, 2023 at 12:27 AM Anand Inguva ***@***.***>
   wrote:
   
   > The script here
   > <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da>
   > trains the Sklearn model required to run inference on Japanese housing
   > dataset IT test
   > <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   > .
   >
   > Now, the problem is we have a set of Sklearn models trained and saved in
   > GCS path. So we use that models for IT testing. But these models are not
   > forward compatible with newer version of sklearn. So to resolve this issue,
   > we would like to
   >
   >    - create a script that could run and train the script
   >    <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da>
   >    - Save the trained models on a GCS location
   >    - Run the pipeline in the example
   >    <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   >    as IT test using the above saved model.
   >    - Add this setup to the Beam infra and make sure this gets run as part
   >    of postcommit tests(I can help here once the above thing is done)
   >
   > —
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/beam/issues/24903#issuecomment-1414215656>, or
   > unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLT34RXU7SD7ENEPOADWVP7Q5ANCNFSM6AAAAAATSCNU4Y>
   > .
   > You are receiving this because you commented.Message ID:
   > ***@***.***>
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] AnandInguva commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "AnandInguva (via GitHub)" <gi...@apache.org>.
AnandInguva commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1414215656

   The script [here](https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da) trains the Sklearn model required to run inference on Japanese housing dataset IT [test](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py). 
   
   Now, the problem is we have a set of Sklearn models trained and saved in GCS path. So we use that models for IT testing. But these models are not forward compatible with newer version of sklearn. So to resolve this issue, we would like to 
   
   * create a script that could run and train the [script](https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da)
   * Save the trained models on a GCS location
   * Run the pipeline in the [example](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py) as  IT test using the above saved model. 
   * Add this setup to the Beam infra and make sure this gets run as part of postcommit tests(I can help here once the above thing is done)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1415372867

   I am ready for it.And also looking forward to work under your guidance.
   
   On Fri, Feb 3, 2023, 12:28 AM Anand Inguva ***@***.***> wrote:
   
   > You can go through the Sklearn beam example and the sklearn training
   > script. If you are ready to do it, please let me know and we can forward
   > with setting up data.
   >
   > —
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/beam/issues/24903#issuecomment-1414217446>, or
   > unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLX2ZJ5EP2PTOPEWCKLWVP7WXANCNFSM6AAAAAATSCNU4Y>
   > .
   > You are receiving this because you commented.Message ID:
   > ***@***.***>
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1411533268

   Hey Danny ,
   Can you please assign this issue to me as i would love to contribute. And it will be great if you can guide me solving this issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1416738802

   Hello Anand,
   I have gone through the example and the script.And now i am going to learn
   somethings about the Sklearn as i am new to this things.Keeping you updated
   with my progress.
   
   On Fri, Feb 3, 2023 at 5:34 PM Siddharth Aryan ***@***.***>
   wrote:
   
   > Thank You for the reply.YES i am ready to work under your guidance.But
   > please give me atleast 2 days to go through the Sklearn beam example and
   > the sklearn training script..
   >
   > On Fri, Feb 3, 2023 at 12:27 AM Anand Inguva ***@***.***>
   > wrote:
   >
   >> The script here
   >> <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da>
   >> trains the Sklearn model required to run inference on Japanese housing
   >> dataset IT test
   >> <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   >> .
   >>
   >> Now, the problem is we have a set of Sklearn models trained and saved in
   >> GCS path. So we use that models for IT testing. But these models are not
   >> forward compatible with newer version of sklearn. So to resolve this issue,
   >> we would like to
   >>
   >>    - create a script that could run and train the script
   >>    <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da>
   >>    - Save the trained models on a GCS location
   >>    - Run the pipeline in the example
   >>    <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py>
   >>    as IT test using the above saved model.
   >>    - Add this setup to the Beam infra and make sure this gets run as
   >>    part of postcommit tests(I can help here once the above thing is done)
   >>
   >> —
   >> Reply to this email directly, view it on GitHub
   >> <https://github.com/apache/beam/issues/24903#issuecomment-1414215656>,
   >> or unsubscribe
   >> <https://github.com/notifications/unsubscribe-auth/AUA2XLT34RXU7SD7ENEPOADWVP7Q5ANCNFSM6AAAAAATSCNU4Y>
   >> .
   >> You are receiving this because you commented.Message ID:
   >> ***@***.***>
   >>
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] nervoussidd commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "nervoussidd (via GitHub)" <gi...@apache.org>.
nervoussidd commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1463440208

   Hey Anand,
   I am attaching a file which contains the script that train the housing data
   and saves the trained models to GCS i dont have an GCS account so i hve
   just put in the code that will save the model to Gcs location.This file
   just contains the code and reflect the things that it will do. I have
   limitations in my system which i am trying to fix to run this in a
   pipeline.In the moment just want your feedback on the code which will help
   me to fix the issue.And thank you for tremendous support throughout and
   patience.
   
   On Tue, Feb 28, 2023 at 10:20 PM Anand Inguva ***@***.***>
   wrote:
   
   > Hey Anand, Sorry but because of my other stuff (my mid sem exams,tutoring
   > and GSOC preparation)i was not able to focus on this project.To inform you
   > about my progress i have already learnt about the respective things to
   > create a script.i need some more days to finish it off.And again i am sorry
   > for not updating you with my progress previously.Hope you understand.
   >
   > Hi, please take your time and work when you can on Beam. I am here to help
   > you in anyway I can. Thanks for the update,
   >
   > —
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/beam/issues/24903#issuecomment-1448514686>, or
   > unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AUA2XLWHYXOU7JDI4ZFTJRTWZYUGPANCNFSM6AAAAAATSCNU4Y>
   > .
   > You are receiving this because you commented.Message ID:
   > ***@***.***>
   >
   
   import pickle
   import pandas as pd
   from sklearn.linear_model import LinearRegression
   from google.cloud import storage
   
   BUCKET_NAME = "your-bucket-name"
   MODEL_NAME = "linear_regression_model.pkl"
   TRAINING_DATA = "gs://{}/data/housing_train.csv".format(BUCKET_NAME)
   
   # loading the training data
   housing_data = pd.read_csv(TRAINING_DATA)
   
   # separating the features and target variable
   X_train = housing_data.drop("median_house_value", axis=1)
   y_train = housing_data["median_house_value"].values
   
   # train the model
   model = LinearRegression()
   model.fit(X_train, y_train)
   
   # save the trained model to GCS
   model_file = pickle.dumps(model)
   storage_client = storage.Client()
   bucket = storage_client.bucket(BUCKET_NAME)
   blob = bucket.blob(MODEL_NAME)
   blob.upload_from_string(model_file)
   print("Trained model saved to GCS path: gs://{}/{}".format(BUCKET_NAME, MODEL_NAME))


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] AnandInguva commented on issue #24903: [Task]: Create a script to train sklearn model for IT test.

Posted by "AnandInguva (via GitHub)" <gi...@apache.org>.
AnandInguva commented on issue #24903:
URL: https://github.com/apache/beam/issues/24903#issuecomment-1481356841

   > Thanks for the reply Anand .And can you please do me a favour ,I have prepared a Proposal for a project named Sentimental Analysis for GSOC2023 can you please review it and give me a feedback.I did sent to the dev mailing list but no one replied,so can you please take some time out and do it , it would mean great to me. Project link: https://docs.google.com/document/d/1U6zcXAWsDCrWlbf14f5VlLqPZFucwXR48tD7mrERW-g/edit Your Sincerely Siddharth Aryan On Thu, Mar 23, 2023 at 2:37 AM Anand Inguva ***@***.***> wrote:
   > […](#)
   > Hello Anand, Hope you are doing well.Can you please review the pull request [ #25926 <#25926>] <#25926 <#25926>%5D.And>. … <#m_-6043284037195056831_> On Fri, Feb 3, 2023 at 12:27 AM Anand Inguva *@*.*> wrote: The script here https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da> trains the Sklearn model required to run inference on Japanese housing dataset IT test https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py> . Now, the problem is we have a set of Sklearn models trained and saved in GCS path. So we use that models for IT testing. But these models are not forward compatible with newer version of sklearn. So to resolve this issue, we would like to - create a script that could run and train t
 he script https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da <https://gist.github.com/AnandInguva/1ce58c7df98ade4efe6bc95a157b82da> - Save the trained models on a GCS location - Run the pipeline in the example https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py <https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/sklearn_japanese_housing_regression.py> as IT test using the above saved model. - Add this setup to the Beam infra and make sure this gets run as part of postcommit tests(I can help here once the above thing is done) — Reply to this email directly, view it on GitHub <#24903 (comment) <[#24903 (comment)](https://github.com/apache/beam/issues/24903#issuecomment-1414215656)>>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AUA2XLT34RXU7SD7ENEPOADWVP7Q5ANCNFSM6AAAAAATSCNU4Y <https://github.com/notifications/unsubscribe-auth/AUA2XLT34RX
 U7SD7ENEPOADWVP7Q5ANCNFSM6AAAAAATSCNU4Y> . You are receiving this because you commented.Message ID: @.*> Thanks I will take a look soon — Reply to this email directly, view it on GitHub <[#24903 (comment)](https://github.com/apache/beam/issues/24903#issuecomment-1480261200)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AUA2XLQKWU4DP5TUTCWBJJLW5NSZ7ANCNFSM6AAAAAATSCNU4Y> . You are receiving this because you were assigned.Message ID: ***@***.***>
   
   Yes, I will take a look. I see that you have attached the doc itself. I replied on the dev@ to share the doc link for better visibility and feedback from the others as well. Please share the google doc link of your proposal there. In the mean time, I will go through the proposal soon.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org