You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@drill.apache.org by GitBox <gi...@apache.org> on 2020/03/04 21:19:41 UTC

[GitHub] [drill] dobesv opened a new pull request #2013: Clean up a bit, add example for s3 storage of query profiles

dobesv opened a new pull request #2013: Clean up a bit, add example for s3 storage of query profiles
URL: https://github.com/apache/drill/pull/2013
 
 
   Try to improve PStore configuration docs to be a bit less confusing (to me at least), and also add an example showing how you could store the query profiles on Amazon S3 (which would have been useful information to me)
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [drill] arina-ielchiieva commented on issue #2013: Clean up a bit, add example for s3 storage of query profiles

Posted by GitBox <gi...@apache.org>.

arina-ielchiieva commented on issue #2013: Clean up a bit, add example for s3 storage of query profiles
URL: https://github.com/apache/drill/pull/2013#issuecomment-595729739
 
 
   +1, @dobesv please squash the commits.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [drill] arina-ielchiieva commented on a change in pull request #2013: Clean up a bit, add example for s3 storage of query profiles

Posted by GitBox <gi...@apache.org>.

arina-ielchiieva commented on a change in pull request #2013: Clean up a bit, add example for s3 storage of query profiles
URL: https://github.com/apache/drill/pull/2013#discussion_r388146977

##########
File path: _docs/configure-drill/configuration-options/040-persistent-configuration-storage.md
##########
@@ -18,32 +18,25 @@ modes:

## Configuring ZooKeeper PStore

-Drill uses ZooKeeper to
-store persistent configuration data. The ZooKeeper PStore provider stores all
-of the persistent configuration data in ZooKeeper except for query profile
-data. The ZooKeeper PStore provider offloads query profile data to the Drill log directory on Drill nodes.
+Drill uses ZooKeeper to store persistent configuration data. The ZooKeeper PStore provider stores all of the persistent configuration data in ZooKeeper except for query profile data. By default, drill stores query profile data to the Drill log directory on Drill nodes.

-You need to configure the ZooKeeper PStore to use the Drill Web UI when running multiple Drillbits.
+If you are running multiple drillbits, it is likely that the log folder is not shared between them. In this case each drillbit will only have access to profiles for the queries where it was the foreman. To make query profiles visible globally, configure drill to use a shared location for query profiles by setting the `drill.exec.sys.store.provider.zk.blobroot` in `drill-override.conf`.

Review comment:
```suggestion
If you are running multiple drillbits, it is likely that the log folder is not shared between them. In this case each drillbit will only have access to profiles for the queries where it was the foreman. To make query profiles visible globally, configure drill to use a shared location for query profiles by setting the `drill.exec.sys.store.provider.zk.blobroot` in `drill-override.conf`.
```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

With regards,
Apache Git Services

[GitHub] [drill] arina-ielchiieva commented on a change in pull request #2013: Clean up a bit, add example for s3 storage of query profiles

Posted by GitBox <gi...@apache.org>.

arina-ielchiieva commented on a change in pull request #2013: Clean up a bit, add example for s3 storage of query profiles
URL: https://github.com/apache/drill/pull/2013#discussion_r388146704

##########
File path: _docs/configure-drill/configuration-options/040-persistent-configuration-storage.md
##########
@@ -18,32 +18,25 @@ modes:

## Configuring ZooKeeper PStore

Review comment:
```suggestion
Drill uses ZooKeeper to store persistent configuration data. The ZooKeeper PStore provider stores all of the persistent configuration data in ZooKeeper except for query profile data. By default, Drill stores query profile data to the Drill log directory on Drill nodes.
```

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

With regards,
Apache Git Services

[GitHub] [drill] vvysotskyi merged pull request #2013: Clean up a bit, add example for s3 storage of query profiles

Posted by GitBox <gi...@apache.org>.

vvysotskyi merged pull request #2013: Clean up a bit, add example for s3 storage of query profiles
URL: https://github.com/apache/drill/pull/2013
 
 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services