You are viewing a plain text version of this content. The canonical link for it is here.
Posted to codereview@trafodion.apache.org by liuyu000 <gi...@git.apache.org> on 2017/03/07 11:08:36 UTC
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
GitHub user liuyu000 opened a pull request:
https://github.com/apache/incubator-trafodion/pull/995
[TRAFODION-2521] Add SCRATCH_DISKS CQD
Changes proposed in this pull request:
1. Add "SCRATCH_DISKS CQD".
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/liuyu000/incubator-trafodion scratch_disks_CQD
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-trafodion/pull/995.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #995
----
commit fb6c16e89679b23879bd62efac5bfc9426286340
Author: liu.yu <yu...@esgyn.cn>
Date: 2017-03-07T11:04:56Z
add scratch_disks_CQD
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by liuyu000 <gi...@git.apache.org>.
Github user liuyu000 commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r105141615
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,27 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-disks]]
+== SCRATCH_DISKS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the env settings for STFS locations.
+| *Values* | Scratch disk locations for overflow (linux path names).
--- End diff --
Thank Hans and Prashanth.
The details have been added. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by liuyu000 <gi...@git.apache.org>.
Github user liuyu000 commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r107580922
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
+| *Values* |
+Scratch disk locations for overflow (linux path names).
+
+Multiple locations can be specified, separated by a colon. For example, /tmp/scratch1:/tmp/scratch2.
+
+| *Usage* a|
+
+*Two ways to change scratch directory location permanently*:
+
+* Specify this location at installation time.
+
++
+Currently the scratch directory locations are set at installation time. The layer of scratch and temporary file system that manages the scratch file creation and reads the envvar in $TRAF_HOME/etc/ms.env to determine where to create the scratch files.
+
++
+The CQD will override envvar settings, there are two envvar settings: one is STFS_HDD_LOACTION (default), the other is STFS_SSD_LOCATION (SSD disk).
+
++
+If the CQD is not set (empty), the envvar setting will work.
+
++
+The requirement is that the directories MUST exist on every node and Trafodion user will need permission to write to those directories. If not, an error will be returned when a query involving sort/hash overflow is executed.
+
+* Set it in sqconfig.
+
+*One way to change scratch directory location temporarily*:
+
+* If the scratch directory location is not set at installation time, this CQD is valid only for the duration of the session.
+
++
+These settings will not be stored in $TRAF_HOME/etc/ms.env and will override the envvar settings as long as the CQD is in effect.
+
+| *Production Usage* | Please contact {project-support}.
+| *Impact* |
+More volume of data can be processed. For example, large data set.
+
+Larger disk space can process larger data set.
--- End diff --
Got, thanks Dave. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-trafodion/pull/995
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by DaveBirdsall <gi...@git.apache.org>.
Github user DaveBirdsall commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r105720100
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
+| *Values* |
+Scratch disk locations for overflow (linux path names).
+
+Multiple locations can be specified, separated by a colon. For example, /tmp/scratch1:/tmp/scratch2.
+
+| *Usage* a|
+
+*Two ways to change scratch directory location permanently*:
+
+* Specify this location at installation time.
+
++
+Currently the scratch directory locations are set at installation time. The layer of scratch and temporary file system that manages the scratch file creation and reads the envvar in $TRAF_HOME/etc/ms.env to determine where to create the scratch files.
+
++
+The CQD will override envvar settings, there are two envvar settings: one is STFS_HDD_LOACTION (default), the other is STFS_SSD_LOCATION (SSD disk).
+
++
+If the CQD is not set (empty), the envvar setting will work.
+
++
+The requirement is that the directories MUST exist on every node and Trafodion user will need permission to write to those directories. If not, an error will be returned when a query involving sort/hash overflow is executed.
+
+* Set it in sqconfig.
+
+*One way to change scratch directory location temporarily*:
+
+* If the scratch directory location is not set at installation time, this CQD is valid only for the duration of the session.
+
++
+These settings will not be stored in $TRAF_HOME/etc/ms.env and will override the envvar settings as long as the CQD is in effect.
--- End diff --
Suggest "environment variables" instead of "envvar".
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by DaveBirdsall <gi...@git.apache.org>.
Github user DaveBirdsall commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r105717989
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
+| *Values* |
+Scratch disk locations for overflow (linux path names).
+
+Multiple locations can be specified, separated by a colon. For example, /tmp/scratch1:/tmp/scratch2.
+
+| *Usage* a|
+
+*Two ways to change scratch directory location permanently*:
+
+* Specify this location at installation time.
+
++
+Currently the scratch directory locations are set at installation time. The layer of scratch and temporary file system that manages the scratch file creation and reads the envvar in $TRAF_HOME/etc/ms.env to determine where to create the scratch files.
--- End diff --
Suggested wordsmith: "Currently the scratch directory locations are set at installation time. The code that manages scratch and temporary files reads environment variables in $TRAF_HOME/etc/ms.env to determine where to create scratch files."
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by DaveBirdsall <gi...@git.apache.org>.
Github user DaveBirdsall commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r105718881
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
+| *Values* |
+Scratch disk locations for overflow (linux path names).
+
+Multiple locations can be specified, separated by a colon. For example, /tmp/scratch1:/tmp/scratch2.
+
+| *Usage* a|
+
+*Two ways to change scratch directory location permanently*:
+
+* Specify this location at installation time.
+
++
+Currently the scratch directory locations are set at installation time. The layer of scratch and temporary file system that manages the scratch file creation and reads the envvar in $TRAF_HOME/etc/ms.env to determine where to create the scratch files.
+
++
+The CQD will override envvar settings, there are two envvar settings: one is STFS_HDD_LOACTION (default), the other is STFS_SSD_LOCATION (SSD disk).
+
++
+If the CQD is not set (empty), the envvar setting will work.
+
++
+The requirement is that the directories MUST exist on every node and Trafodion user will need permission to write to those directories. If not, an error will be returned when a query involving sort/hash overflow is executed.
--- End diff --
Suggested wordsmith: "The directories MUST exist on every node and the Trafodion user must have permission to write to those directories. ..."
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by liuyu000 <gi...@git.apache.org>.
Github user liuyu000 commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r105141654
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,27 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-disks]]
+== SCRATCH_DISKS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the env settings for STFS locations.
+| *Values* | Scratch disk locations for overflow (linux path names).
+| *Usage* | Currently the scratch directory locations are set at installation time. The STFS layer that manages the scratch file creation reads the envvar in ms.env to determine where to create the scratch files.
+
+The CQD is allowed to be specified that will override the envvar setting. This will give the user some flexibility to change scratch directory locations.
--- End diff --
Thanks Hans.
Your comment has beem implemented. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by liuyu000 <gi...@git.apache.org>.
Github user liuyu000 commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r107580630
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
+| *Values* |
+Scratch disk locations for overflow (linux path names).
+
+Multiple locations can be specified, separated by a colon. For example, /tmp/scratch1:/tmp/scratch2.
+
+| *Usage* a|
+
+*Two ways to change scratch directory location permanently*:
+
+* Specify this location at installation time.
+
++
+Currently the scratch directory locations are set at installation time. The layer of scratch and temporary file system that manages the scratch file creation and reads the envvar in $TRAF_HOME/etc/ms.env to determine where to create the scratch files.
+
++
+The CQD will override envvar settings, there are two envvar settings: one is STFS_HDD_LOACTION (default), the other is STFS_SSD_LOCATION (SSD disk).
+
++
+If the CQD is not set (empty), the envvar setting will work.
+
++
+The requirement is that the directories MUST exist on every node and Trafodion user will need permission to write to those directories. If not, an error will be returned when a query involving sort/hash overflow is executed.
--- End diff --
Got, thanks Dave. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by DaveBirdsall <gi...@git.apache.org>.
Github user DaveBirdsall commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r105720499
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
+| *Values* |
+Scratch disk locations for overflow (linux path names).
+
+Multiple locations can be specified, separated by a colon. For example, /tmp/scratch1:/tmp/scratch2.
+
+| *Usage* a|
+
+*Two ways to change scratch directory location permanently*:
+
+* Specify this location at installation time.
+
++
+Currently the scratch directory locations are set at installation time. The layer of scratch and temporary file system that manages the scratch file creation and reads the envvar in $TRAF_HOME/etc/ms.env to determine where to create the scratch files.
+
++
+The CQD will override envvar settings, there are two envvar settings: one is STFS_HDD_LOACTION (default), the other is STFS_SSD_LOCATION (SSD disk).
+
++
+If the CQD is not set (empty), the envvar setting will work.
+
++
+The requirement is that the directories MUST exist on every node and Trafodion user will need permission to write to those directories. If not, an error will be returned when a query involving sort/hash overflow is executed.
+
+* Set it in sqconfig.
+
+*One way to change scratch directory location temporarily*:
+
+* If the scratch directory location is not set at installation time, this CQD is valid only for the duration of the session.
+
++
+These settings will not be stored in $TRAF_HOME/etc/ms.env and will override the envvar settings as long as the CQD is in effect.
+
+| *Production Usage* | Please contact {project-support}.
+| *Impact* |
+More volume of data can be processed. For example, large data set.
+
+Larger disk space can process larger data set.
--- End diff --
Suggested wordsmith: "More disk space can process larger data sets."
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by DaveBirdsall <gi...@git.apache.org>.
Github user DaveBirdsall commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r105718426
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
+| *Values* |
+Scratch disk locations for overflow (linux path names).
+
+Multiple locations can be specified, separated by a colon. For example, /tmp/scratch1:/tmp/scratch2.
+
+| *Usage* a|
+
+*Two ways to change scratch directory location permanently*:
+
+* Specify this location at installation time.
+
++
+Currently the scratch directory locations are set at installation time. The layer of scratch and temporary file system that manages the scratch file creation and reads the envvar in $TRAF_HOME/etc/ms.env to determine where to create the scratch files.
+
++
+The CQD will override envvar settings, there are two envvar settings: one is STFS_HDD_LOACTION (default), the other is STFS_SSD_LOCATION (SSD disk).
--- End diff --
Suggested wordsmith: "The CQD overrides the STFS_HDD_LOCATION (disk) and STFS_SSD_LOCATION (SSD disk) environment variables."
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by zellerh <gi...@git.apache.org>.
Github user zellerh commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r104718380
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,27 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-disks]]
+== SCRATCH_DISKS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the env settings for STFS locations.
+| *Values* | Scratch disk locations for overflow (linux path names).
--- End diff --
@prashanth-vasudev do you know what the separator between the names is? A blank or comma or something else?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by zellerh <gi...@git.apache.org>.
Github user zellerh commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r104718639
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,27 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-disks]]
+== SCRATCH_DISKS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the env settings for STFS locations.
+| *Values* | Scratch disk locations for overflow (linux path names).
+| *Usage* | Currently the scratch directory locations are set at installation time. The STFS layer that manages the scratch file creation reads the envvar in ms.env to determine where to create the scratch files.
+
+The CQD is allowed to be specified that will override the envvar setting. This will give the user some flexibility to change scratch directory locations.
--- End diff --
I assume the environment variable is set in $TRAF_HOME/etc/ms.env?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by liuyu000 <gi...@git.apache.org>.
Github user liuyu000 commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r107576981
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
+| *Values* |
+Scratch disk locations for overflow (linux path names).
+
+Multiple locations can be specified, separated by a colon. For example, /tmp/scratch1:/tmp/scratch2.
+
+| *Usage* a|
+
+*Two ways to change scratch directory location permanently*:
+
+* Specify this location at installation time.
+
++
+Currently the scratch directory locations are set at installation time. The layer of scratch and temporary file system that manages the scratch file creation and reads the envvar in $TRAF_HOME/etc/ms.env to determine where to create the scratch files.
--- End diff --
Got, thanks Dave. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by DaveBirdsall <gi...@git.apache.org>.
Github user DaveBirdsall commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r104996070
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,27 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-disks]]
+== SCRATCH_DISKS
--- End diff --
There is no SCRATCH_DISKS CQD in Trafodion. There is a SCRATCH_DIRS CQD, which gives a colon-separated list of directories to use for scratch space. I'm guessing that's what was intended here.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by liuyu000 <gi...@git.apache.org>.
Github user liuyu000 commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r107580254
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
+| *Values* |
+Scratch disk locations for overflow (linux path names).
+
+Multiple locations can be specified, separated by a colon. For example, /tmp/scratch1:/tmp/scratch2.
+
+| *Usage* a|
+
+*Two ways to change scratch directory location permanently*:
+
+* Specify this location at installation time.
+
++
+Currently the scratch directory locations are set at installation time. The layer of scratch and temporary file system that manages the scratch file creation and reads the envvar in $TRAF_HOME/etc/ms.env to determine where to create the scratch files.
+
++
+The CQD will override envvar settings, there are two envvar settings: one is STFS_HDD_LOACTION (default), the other is STFS_SSD_LOCATION (SSD disk).
+
++
+If the CQD is not set (empty), the envvar setting will work.
--- End diff --
Got, thanks Dave. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by liuyu000 <gi...@git.apache.org>.
Github user liuyu000 commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r105581614
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,27 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-disks]]
+== SCRATCH_DISKS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the env settings for STFS locations.
--- End diff --
Thanks Hans & Dave .
Your comment hava beem implemented. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by DaveBirdsall <gi...@git.apache.org>.
Github user DaveBirdsall commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r104996057
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,27 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-disks]]
+== SCRATCH_DISKS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the env settings for STFS locations.
--- End diff --
The text mentions "env settings". Can someone describe what that means? Is there a run-time environment variable that is consulted, for example? And if so, what's the name of that variable?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by liuyu000 <gi...@git.apache.org>.
Github user liuyu000 commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r107576890
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
--- End diff --
Got, thanks Dave. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by prashanth-vasudev <gi...@git.apache.org>.
Github user prashanth-vasudev commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r104981163
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,27 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-disks]]
+== SCRATCH_DISKS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the env settings for STFS locations.
+| *Values* | Scratch disk locations for overflow (linux path names).
--- End diff --
They are colon ':' separated. Ex /tmp/scratch1:/tmp/scratch2
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by liuyu000 <gi...@git.apache.org>.
Github user liuyu000 commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r107580745
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
+| *Values* |
+Scratch disk locations for overflow (linux path names).
+
+Multiple locations can be specified, separated by a colon. For example, /tmp/scratch1:/tmp/scratch2.
+
+| *Usage* a|
+
+*Two ways to change scratch directory location permanently*:
+
+* Specify this location at installation time.
+
++
+Currently the scratch directory locations are set at installation time. The layer of scratch and temporary file system that manages the scratch file creation and reads the envvar in $TRAF_HOME/etc/ms.env to determine where to create the scratch files.
+
++
+The CQD will override envvar settings, there are two envvar settings: one is STFS_HDD_LOACTION (default), the other is STFS_SSD_LOCATION (SSD disk).
+
++
+If the CQD is not set (empty), the envvar setting will work.
+
++
+The requirement is that the directories MUST exist on every node and Trafodion user will need permission to write to those directories. If not, an error will be returned when a query involving sort/hash overflow is executed.
+
+* Set it in sqconfig.
+
+*One way to change scratch directory location temporarily*:
+
+* If the scratch directory location is not set at installation time, this CQD is valid only for the duration of the session.
+
++
+These settings will not be stored in $TRAF_HOME/etc/ms.env and will override the envvar settings as long as the CQD is in effect.
--- End diff --
Got, thanks Dave. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by liuyu000 <gi...@git.apache.org>.
Github user liuyu000 commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r105143678
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,27 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-disks]]
+== SCRATCH_DISKS
--- End diff --
Yes, thanks Dave, the CQD name has been corrected. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by DaveBirdsall <gi...@git.apache.org>.
Github user DaveBirdsall commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r105712283
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
--- End diff --
Grammar: "which gives user" should be either "which gives the user" or "which gives users" (either one is fine)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by liuyu000 <gi...@git.apache.org>.
Github user liuyu000 commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r107580165
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
+| *Values* |
+Scratch disk locations for overflow (linux path names).
+
+Multiple locations can be specified, separated by a colon. For example, /tmp/scratch1:/tmp/scratch2.
+
+| *Usage* a|
+
+*Two ways to change scratch directory location permanently*:
+
+* Specify this location at installation time.
+
++
+Currently the scratch directory locations are set at installation time. The layer of scratch and temporary file system that manages the scratch file creation and reads the envvar in $TRAF_HOME/etc/ms.env to determine where to create the scratch files.
+
++
+The CQD will override envvar settings, there are two envvar settings: one is STFS_HDD_LOACTION (default), the other is STFS_SSD_LOCATION (SSD disk).
--- End diff --
Got, thanks Dave. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by zellerh <gi...@git.apache.org>.
Github user zellerh commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r104717884
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,27 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-disks]]
+== SCRATCH_DISKS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the env settings for STFS locations.
--- End diff --
Could replace STFS with "scratch and temporary file"
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-trafodion pull request #995: [TRAFODION-2521] Add SCRATCH_DISKS CQ...
Posted by DaveBirdsall <gi...@git.apache.org>.
Github user DaveBirdsall commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/995#discussion_r105718596
--- Diff: docs/cqd_reference/src/asciidoc/_chapters/query_execution.adoc ---
@@ -237,3 +237,54 @@ If you enable small scanner on large size scan incorrectly, then you are likely
| *Deprecated In Release* | Not applicable.
|===
+<<<
+[[scratch-dirs]]
+== SCRATCH_DIRS
+
+[cols="25%h,75%"]
+|===
+| *Description* | Allows a CQD specification to override the envvar settings for scatch and temporary file locations, which gives user more flexibility to change scratch directory locations.
+| *Values* |
+Scratch disk locations for overflow (linux path names).
+
+Multiple locations can be specified, separated by a colon. For example, /tmp/scratch1:/tmp/scratch2.
+
+| *Usage* a|
+
+*Two ways to change scratch directory location permanently*:
+
+* Specify this location at installation time.
+
++
+Currently the scratch directory locations are set at installation time. The layer of scratch and temporary file system that manages the scratch file creation and reads the envvar in $TRAF_HOME/etc/ms.env to determine where to create the scratch files.
+
++
+The CQD will override envvar settings, there are two envvar settings: one is STFS_HDD_LOACTION (default), the other is STFS_SSD_LOCATION (SSD disk).
+
++
+If the CQD is not set (empty), the envvar setting will work.
--- End diff --
Suggested wordsmith: "If the CQD is not set, the environment variable settings will be used."
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---