You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/09/24 23:15:50 UTC

[GitHub] [airflow] Wuerike opened a new issue #18514: Add BigQuery to Mongo operator at providers.mongo.transfers

Wuerike opened a new issue #18514:
URL: https://github.com/apache/airflow/issues/18514


   ### Description
   
   I've developed a BigQuery to MongoDB operator and I was thinking about contributing on adding it to the project.
   
   I've basically merged BigQueryGetDataOperator (providers.google.cloud.operators) with MongoToS3Operator (providers.amazon.aws.transfers), following the same code style.
   
   Has features like:
   - Fetchs all fields on a line, or can receive witch fields should be fetch
   - Stores the last fecthed line to read incrementaly between execution
   - Supports this mongo methods: inserting, replacing and upserting 
   
   I'd like to know if its good enough, and if someone is available to help me during the process of contributing.
   
   ### Use case/motivation
   
   First of all, I'd like to make my first contribution on an open source project ever.
   
   Talking about the application itself, it lacks of mongo operators, so I think it will be great to the community having one more example and application with it.
   
   BigQuery already has a lot of operators this is why my idea was to add this on mongo folder.
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] eladkal commented on issue #18514: Add BigQuery to Mongo operator at providers.mongo.transfers

Posted by GitBox <gi...@apache.org>.
eladkal commented on issue #18514:
URL: https://github.com/apache/airflow/issues/18514#issuecomment-1026238189


   @Wuerike  are you still working on this issue?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #18514: Add BigQuery to Mongo operator at providers.mongo.transfers

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18514:
URL: https://github.com/apache/airflow/issues/18514#issuecomment-927115315


   Go for it! No  need to evan open an issue for it - but feel free. I assign you to it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #18514: Add BigQuery to Mongo operator at providers.mongo.transfers

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #18514:
URL: https://github.com/apache/airflow/issues/18514#issuecomment-926965130


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] Wuerike commented on issue #18514: Add BigQuery to Mongo operator at providers.mongo.transfers

Posted by GitBox <gi...@apache.org>.
Wuerike commented on issue #18514:
URL: https://github.com/apache/airflow/issues/18514#issuecomment-1026244234


   My idea was to do it, but I've forgotten about it actually


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org