You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Araceli Henley (JIRA)" <ji...@apache.org> on 2011/02/18 19:41:38 UTC
[jira] Created: (PIG-1861) The pig script stored in the Hadoop
History logs is stored as a concatenated string without whitespace this
causes problems when attempting to extract and execute the script
The pig script stored in the Hadoop History logs is stored as a concatenated string without whitespace this causes problems when attempting to extract and execute the script
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Key: PIG-1861
URL: https://issues.apache.org/jira/browse/PIG-1861
Project: Pig
Issue Type: Bug
Components: build
Affects Versions: 0.8.0, 0.9.0
Reporter: Araceli Henley
Fix For: 0.9.0, 0.8.0
a = load '$in' using com.yahoo.grid.sath.JobHistoryLoader() as
(job:map[],maps:bag{},reducers:bag{},other:bag{},conf:map[]);
The pig script stored in: conf#'pig.script' has the whitespace removed, this makes it difficult to extract and run the
script. In particular, statements that terminate in ";" work correctly as
"statement1;statement2;statement99" but statements that do not end in ";" result in
"statement1statement2statement3" and it's difficult to parse the pig script and fix the concatenated string.
On a side note, I also noticed that in many of the scripts the last statement is missing ";"
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (PIG-1861) The pig script stored in the Hadoop
History logs is stored as a concatenated string without whitespace this
causes problems when attempting to extract and execute the script
Posted by "Araceli Henley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Araceli Henley updated PIG-1861:
--------------------------------
Description:
a = load '$in' using com.yahoo.grid.sath.JobHistoryLoader() as
(job:map[],maps:bag{},reducers:bag{},other:bag{},conf:map[]);
The pig script stored in: conf#'pig.script' has the whitespace removed, this makes it difficult to extract and run the
script. In particular, statements that terminate in ";" work correctly as
"statement1;statement2;statement99" but statements that do not end in ";" result in
"statement1statement2statement3" and it's difficult to parse the pig script and fix the concatenated string.
There's also a problem with comments as in:
/*mycomment*//*more comments*/ PIG_CODE //comment PIG_CODE
On a side note, I also noticed that in many of the scripts the last statement is missing ";"
was:
a = load '$in' using com.yahoo.grid.sath.JobHistoryLoader() as
(job:map[],maps:bag{},reducers:bag{},other:bag{},conf:map[]);
The pig script stored in: conf#'pig.script' has the whitespace removed, this makes it difficult to extract and run the
script. In particular, statements that terminate in ";" work correctly as
"statement1;statement2;statement99" but statements that do not end in ";" result in
"statement1statement2statement3" and it's difficult to parse the pig script and fix the concatenated string.
On a side note, I also noticed that in many of the scripts the last statement is missing ";"
> The pig script stored in the Hadoop History logs is stored as a concatenated string without whitespace this causes problems when attempting to extract and execute the script
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1861
> URL: https://issues.apache.org/jira/browse/PIG-1861
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Araceli Henley
> Fix For: 0.8.0, 0.9.0
>
>
> a = load '$in' using com.yahoo.grid.sath.JobHistoryLoader() as
> (job:map[],maps:bag{},reducers:bag{},other:bag{},conf:map[]);
> The pig script stored in: conf#'pig.script' has the whitespace removed, this makes it difficult to extract and run the
> script. In particular, statements that terminate in ";" work correctly as
> "statement1;statement2;statement99" but statements that do not end in ";" result in
> "statement1statement2statement3" and it's difficult to parse the pig script and fix the concatenated string.
> There's also a problem with comments as in:
> /*mycomment*//*more comments*/ PIG_CODE //comment PIG_CODE
> On a side note, I also noticed that in many of the scripts the last statement is missing ";"
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (PIG-1861) The pig script stored in the Hadoop
History logs is stored as a concatenated string without whitespace this
causes problems when attempting to extract and execute the script
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1861:
------------------------------
Attachment: PIG-1861.patch
Output of test-patch:
{code}
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 3 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
{code}
> The pig script stored in the Hadoop History logs is stored as a concatenated string without whitespace this causes problems when attempting to extract and execute the script
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1861
> URL: https://issues.apache.org/jira/browse/PIG-1861
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Araceli Henley
> Assignee: Richard Ding
> Fix For: 0.8.0, 0.9.0
>
> Attachments: PIG-1861.patch
>
>
> a = load '$in' using com.yahoo.grid.sath.JobHistoryLoader() as
> (job:map[],maps:bag{},reducers:bag{},other:bag{},conf:map[]);
> The pig script stored in: conf#'pig.script' has the whitespace removed, this makes it difficult to extract and run the
> script. In particular, statements that terminate in ";" work correctly as
> "statement1;statement2;statement99" but statements that do not end in ";" result in
> "statement1statement2statement3" and it's difficult to parse the pig script and fix the concatenated string.
> There's also a problem with comments as in:
> /*mycomment*//*more comments*/ PIG_CODE //comment PIG_CODE
> On a side note, I also noticed that in many of the scripts the last statement is missing ";"
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (PIG-1861) The pig script stored in the Hadoop
History logs is stored as a concatenated string without whitespace this
causes problems when attempting to extract and execute the script
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13001511#comment-13001511 ]
Daniel Dai commented on PIG-1861:
---------------------------------
+1
> The pig script stored in the Hadoop History logs is stored as a concatenated string without whitespace this causes problems when attempting to extract and execute the script
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1861
> URL: https://issues.apache.org/jira/browse/PIG-1861
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Araceli Henley
> Assignee: Richard Ding
> Fix For: 0.8.0, 0.9.0
>
> Attachments: PIG-1861.patch
>
>
> a = load '$in' using com.yahoo.grid.sath.JobHistoryLoader() as
> (job:map[],maps:bag{},reducers:bag{},other:bag{},conf:map[]);
> The pig script stored in: conf#'pig.script' has the whitespace removed, this makes it difficult to extract and run the
> script. In particular, statements that terminate in ";" work correctly as
> "statement1;statement2;statement99" but statements that do not end in ";" result in
> "statement1statement2statement3" and it's difficult to parse the pig script and fix the concatenated string.
> There's also a problem with comments as in:
> /*mycomment*//*more comments*/ PIG_CODE //comment PIG_CODE
> On a side note, I also noticed that in many of the scripts the last statement is missing ";"
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (PIG-1861) The pig script stored in the Hadoop
History logs is stored as a concatenated string without whitespace this
causes problems when attempting to extract and execute the script
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1861:
------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Patch committed to trunk.
> The pig script stored in the Hadoop History logs is stored as a concatenated string without whitespace this causes problems when attempting to extract and execute the script
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1861
> URL: https://issues.apache.org/jira/browse/PIG-1861
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Araceli Henley
> Assignee: Richard Ding
> Fix For: 0.9.0, 0.8.0
>
> Attachments: PIG-1861.patch
>
>
> a = load '$in' using com.yahoo.grid.sath.JobHistoryLoader() as
> (job:map[],maps:bag{},reducers:bag{},other:bag{},conf:map[]);
> The pig script stored in: conf#'pig.script' has the whitespace removed, this makes it difficult to extract and run the
> script. In particular, statements that terminate in ";" work correctly as
> "statement1;statement2;statement99" but statements that do not end in ";" result in
> "statement1statement2statement3" and it's difficult to parse the pig script and fix the concatenated string.
> There's also a problem with comments as in:
> /*mycomment*//*more comments*/ PIG_CODE //comment PIG_CODE
> On a side note, I also noticed that in many of the scripts the last statement is missing ";"
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Assigned: (PIG-1861) The pig script stored in the Hadoop
History logs is stored as a concatenated string without whitespace this
causes problems when attempting to extract and execute the script
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding reassigned PIG-1861:
---------------------------------
Assignee: Richard Ding
> The pig script stored in the Hadoop History logs is stored as a concatenated string without whitespace this causes problems when attempting to extract and execute the script
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1861
> URL: https://issues.apache.org/jira/browse/PIG-1861
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Araceli Henley
> Assignee: Richard Ding
> Fix For: 0.8.0, 0.9.0
>
>
> a = load '$in' using com.yahoo.grid.sath.JobHistoryLoader() as
> (job:map[],maps:bag{},reducers:bag{},other:bag{},conf:map[]);
> The pig script stored in: conf#'pig.script' has the whitespace removed, this makes it difficult to extract and run the
> script. In particular, statements that terminate in ";" work correctly as
> "statement1;statement2;statement99" but statements that do not end in ";" result in
> "statement1statement2statement3" and it's difficult to parse the pig script and fix the concatenated string.
> There's also a problem with comments as in:
> /*mycomment*//*more comments*/ PIG_CODE //comment PIG_CODE
> On a side note, I also noticed that in many of the scripts the last statement is missing ";"
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (PIG-1861) The pig script stored in the Hadoop
History logs is stored as a concatenated string without whitespace this
causes problems when attempting to extract and execute the script
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Richard Ding updated PIG-1861:
------------------------------
Status: Patch Available (was: Open)
> The pig script stored in the Hadoop History logs is stored as a concatenated string without whitespace this causes problems when attempting to extract and execute the script
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1861
> URL: https://issues.apache.org/jira/browse/PIG-1861
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Araceli Henley
> Assignee: Richard Ding
> Fix For: 0.9.0, 0.8.0
>
> Attachments: PIG-1861.patch
>
>
> a = load '$in' using com.yahoo.grid.sath.JobHistoryLoader() as
> (job:map[],maps:bag{},reducers:bag{},other:bag{},conf:map[]);
> The pig script stored in: conf#'pig.script' has the whitespace removed, this makes it difficult to extract and run the
> script. In particular, statements that terminate in ";" work correctly as
> "statement1;statement2;statement99" but statements that do not end in ";" result in
> "statement1statement2statement3" and it's difficult to parse the pig script and fix the concatenated string.
> There's also a problem with comments as in:
> /*mycomment*//*more comments*/ PIG_CODE //comment PIG_CODE
> On a side note, I also noticed that in many of the scripts the last statement is missing ";"
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-1861) The pig script stored in the Hadoop
History logs is stored as a concatenated string without whitespace this
causes problems when attempting to extract and execute the script
Posted by "Richard Ding (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13010477#comment-13010477 ]
Richard Ding commented on PIG-1861:
-----------------------------------
Patch committed to 0.8 branch.
> The pig script stored in the Hadoop History logs is stored as a concatenated string without whitespace this causes problems when attempting to extract and execute the script
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-1861
> URL: https://issues.apache.org/jira/browse/PIG-1861
> Project: Pig
> Issue Type: Bug
> Components: build
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Araceli Henley
> Assignee: Richard Ding
> Fix For: 0.8.0, 0.9.0
>
> Attachments: PIG-1861.patch
>
>
> a = load '$in' using com.yahoo.grid.sath.JobHistoryLoader() as
> (job:map[],maps:bag{},reducers:bag{},other:bag{},conf:map[]);
> The pig script stored in: conf#'pig.script' has the whitespace removed, this makes it difficult to extract and run the
> script. In particular, statements that terminate in ";" work correctly as
> "statement1;statement2;statement99" but statements that do not end in ";" result in
> "statement1statement2statement3" and it's difficult to parse the pig script and fix the concatenated string.
> There's also a problem with comments as in:
> /*mycomment*//*more comments*/ PIG_CODE //comment PIG_CODE
> On a side note, I also noticed that in many of the scripts the last statement is missing ";"
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira