You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Arina Ielchiieva (Jira)" <ji...@apache.org> on 2019/11/04 12:55:00 UTC

[jira] [Updated] (DRILL-6794) Document the JDBC properties required to retrieve result sets in batches while querying large tables

     [ https://issues.apache.org/jira/browse/DRILL-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arina Ielchiieva updated DRILL-6794:
------------------------------------
    Fix Version/s:     (was: 1.17.0)

> Document the JDBC properties required to retrieve result sets in batches while querying large tables
> ----------------------------------------------------------------------------------------------------
>
>                 Key: DRILL-6794
>                 URL: https://issues.apache.org/jira/browse/DRILL-6794
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Documentation
>    Affects Versions: 1.14.0
>            Reporter: Rahul Raj
>            Assignee: Bridget Bevens
>            Priority: Major
>              Labels: doc-impacting
>
> Document the JDBC properties required to retrieve result sets in batches while querying large tables
> Querying large tables using JDBC plugin causes OOM as most JDBC drivers cache the entire result set at the client by default.
> To avoid this additional parameters needs to be specified with the JDBC connection string so that the driver fetches records in batches and reloads when exhausted.
> For postgres driver set autocommit mode to false - jdbc:postgresql://url:port/schema?defaultAutoCommit=false
> Links
> [1] https://issues.apache.org/jira/browse/DRILL-4177
> [2] https://jdbc.postgresql.org/documentation/93/query.html#fetchsize-example
> [3] https://www.postgresql.org/docs/9.3/static/ecpg-sql-set-autocommit.html
> [4] https://jdbc.postgresql.org/documentation/head/ds-cpds.htm



--
This message was sent by Atlassian Jira
(v8.3.4#803005)