You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/07/10 11:43:02 UTC

[GitHub] [airflow] subkanthi opened a new issue #16921: Add support for Salesforce Bulk API

subkanthi opened a new issue #16921:
URL: https://github.com/apache/airflow/issues/16921


   **Description**
   
   Salesforce Bulk API is very popular to retrieve/push data to Salesforce, a maximum of 10k records can be pushed in the bulk API. Add a separate hook to support bulk Api SalesforceBulkApiHook
   https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/asynch_api_intro.htm
   
   **Use case / motivation**
   
   In a lot of organizations this might be useful for performing ETL from Bigquery or data storage platforms to Salesforce using Bulk API.
   
   **Are you willing to submit a PR?**
   
   Yes
   
   **Related Issues**
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] alexbegg commented on issue #16921: Add support for Salesforce Bulk API

Posted by GitBox <gi...@apache.org>.

alexbegg commented on issue #16921:
URL: https://github.com/apache/airflow/issues/16921#issuecomment-964831154


   I just want to share that it is fairly simple to use a SalesforceHook for a SalesforceBulk connection, I am doing it at my company (you just have to `pip install salesforce-bulk`: https://github.com/heroku/salesforce-bulk):
   
   ```
   from airflow.providers.salesforce.hooks.salesforce import SalesforceHook
   from salesforce_bulk import SalesforceBulk
   
   ...
   
   sf_hook = SalesforceHook()
   sf_conn = sf_hook.get_conn()
   bulk = SalesforceBulk(sessionId=sf_conn.session_id, host=sf_conn.sf_instance)
   ```
   
   So it should be fairly simple to make this into a `SalesforceBulkHook` (I think "Api" in the name is a bit unnecessary since we aren't calling the existing hook SalesforceApiHook).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] mrbazzan commented on issue #16921: Add support for Salesforce Bulk API

Posted by GitBox <gi...@apache.org>.

mrbazzan commented on issue #16921:
URL: https://github.com/apache/airflow/issues/16921#issuecomment-946140083


   @eladkal Are you still working on this issue or should I pick it up?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] subkanthi commented on issue #16921: Add support for Salesforce Bulk API

Posted by GitBox <gi...@apache.org>.

subkanthi commented on issue #16921:
URL: https://github.com/apache/airflow/issues/16921#issuecomment-946141910


   @mrbazzan I should have the PR this week hopefully


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #16921: Add support for Salesforce Bulk API

Posted by GitBox <gi...@apache.org>.

potiuk commented on issue #16921:
URL: https://github.com/apache/airflow/issues/16921#issuecomment-877624759


   Assigned you :)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] mrbazzan edited a comment on issue #16921: Add support for Salesforce Bulk API

Posted by GitBox <gi...@apache.org>.

mrbazzan edited a comment on issue #16921:
URL: https://github.com/apache/airflow/issues/16921#issuecomment-946140083






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] mrbazzan commented on issue #16921: Add support for Salesforce Bulk API

Posted by GitBox <gi...@apache.org>.

mrbazzan commented on issue #16921:
URL: https://github.com/apache/airflow/issues/16921#issuecomment-946155926


   @subkanthi Alright


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org