You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Mridul Muralidharan (JIRA)" <ji...@apache.org> on 2010/10/18 20:21:23 UTC

[jira] Created: (PIG-1685) Pig is unable to handle counters for glob paths ?

Pig is unable to handle counters for glob paths ?
-------------------------------------------------

                 Key: PIG-1685
                 URL: https://issues.apache.org/jira/browse/PIG-1685
             Project: Pig
          Issue Type: Bug
          Components: impl
    Affects Versions: 0.8.0
            Reporter: Mridul Muralidharan



We get the following exception, which seems to be related to processing counters per path :


java.net.URISyntaxException: Illegal character in path at index 71: /projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
        at java.net.URI$Parser.fail(URI.java:2809)
        at java.net.URI$Parser.checkChars(URI.java:2982)
        at java.net.URI$Parser.parseHierarchical(URI.java:3066)
        at java.net.URI$Parser.parse(URI.java:3024)
        at java.net.URI.<init>(URI.java:578)
        at org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
        at org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
        at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
        at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
        at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
        at org.apache.pig.PigServer.execute(PigServer.java:1189)
        at org.apache.pig.PigServer.access$100(PigServer.java:127)
        at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
        at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
        at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
        at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
        at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
        at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
        at org.apache.pig.Main.run(Main.java:498)
        at org.apache.pig.Main.main(Main.java:107)




It results is (notice -1) among others:

Input(s):
Successfully read -1 records from: "/projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"



Thankfully, there is no direct functional impact except for inability to depend on counters.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Assigned: (PIG-1685) Pig is unable to handle counters for glob paths ?

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/PIG-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai reassigned PIG-1685:
-------------------------------

    Assignee: Daniel Dai

> Pig is unable to handle counters for glob paths ?
> -------------------------------------------------
>
>                 Key: PIG-1685
>                 URL: https://issues.apache.org/jira/browse/PIG-1685
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.8.0
>            Reporter: Mridul Muralidharan
>            Assignee: Daniel Dai
>
> We get the following exception, which seems to be related to processing counters per path :
> java.net.URISyntaxException: Illegal character in path at index 71: /projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
>         at java.net.URI$Parser.fail(URI.java:2809)
>         at java.net.URI$Parser.checkChars(URI.java:2982)
>         at java.net.URI$Parser.parseHierarchical(URI.java:3066)
>         at java.net.URI$Parser.parse(URI.java:3024)
>         at java.net.URI.<init>(URI.java:578)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
>         at org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
>         at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
>         at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
>         at org.apache.pig.PigServer.execute(PigServer.java:1189)
>         at org.apache.pig.PigServer.access$100(PigServer.java:127)
>         at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
>         at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
>         at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
>         at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
>         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
>         at org.apache.pig.Main.run(Main.java:498)
>         at org.apache.pig.Main.main(Main.java:107)
> It results is (notice -1) among others:
> Input(s):
> Successfully read -1 records from: "/projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"
> Thankfully, there is no direct functional impact except for inability to depend on counters.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (PIG-1685) Pig is unable to handle counters for glob paths ?

Posted by "Thejas M Nair (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/PIG-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12923049#action_12923049 ] 

Thejas M Nair commented on PIG-1685:
------------------------------------

+1

> Pig is unable to handle counters for glob paths ?
> -------------------------------------------------
>
>                 Key: PIG-1685
>                 URL: https://issues.apache.org/jira/browse/PIG-1685
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.8.0
>            Reporter: Mridul Muralidharan
>            Assignee: Daniel Dai
>         Attachments: PIG-1685-1.patch
>
>
> We get the following exception, which seems to be related to processing counters per path :
> java.net.URISyntaxException: Illegal character in path at index 71: /projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
>         at java.net.URI$Parser.fail(URI.java:2809)
>         at java.net.URI$Parser.checkChars(URI.java:2982)
>         at java.net.URI$Parser.parseHierarchical(URI.java:3066)
>         at java.net.URI$Parser.parse(URI.java:3024)
>         at java.net.URI.<init>(URI.java:578)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
>         at org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
>         at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
>         at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
>         at org.apache.pig.PigServer.execute(PigServer.java:1189)
>         at org.apache.pig.PigServer.access$100(PigServer.java:127)
>         at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
>         at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
>         at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
>         at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
>         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
>         at org.apache.pig.Main.run(Main.java:498)
>         at org.apache.pig.Main.main(Main.java:107)
> It results is (notice -1) among others:
> Input(s):
> Successfully read -1 records from: "/projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"
> Thankfully, there is no direct functional impact except for inability to depend on counters.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (PIG-1685) Pig is unable to handle counters for glob paths ?

Posted by "Mridul Muralidharan (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/PIG-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12923156#action_12923156 ] 

Mridul Muralidharan commented on PIG-1685:
------------------------------------------

Thanks guys, that was real quick !

> Pig is unable to handle counters for glob paths ?
> -------------------------------------------------
>
>                 Key: PIG-1685
>                 URL: https://issues.apache.org/jira/browse/PIG-1685
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.8.0
>            Reporter: Mridul Muralidharan
>            Assignee: Daniel Dai
>             Fix For: 0.8.0
>
>         Attachments: PIG-1685-1.patch
>
>
> We get the following exception, which seems to be related to processing counters per path :
> java.net.URISyntaxException: Illegal character in path at index 71: /projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
>         at java.net.URI$Parser.fail(URI.java:2809)
>         at java.net.URI$Parser.checkChars(URI.java:2982)
>         at java.net.URI$Parser.parseHierarchical(URI.java:3066)
>         at java.net.URI$Parser.parse(URI.java:3024)
>         at java.net.URI.<init>(URI.java:578)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
>         at org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
>         at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
>         at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
>         at org.apache.pig.PigServer.execute(PigServer.java:1189)
>         at org.apache.pig.PigServer.access$100(PigServer.java:127)
>         at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
>         at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
>         at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
>         at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
>         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
>         at org.apache.pig.Main.run(Main.java:498)
>         at org.apache.pig.Main.main(Main.java:107)
> It results is (notice -1) among others:
> Input(s):
> Successfully read -1 records from: "/projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"
> Thankfully, there is no direct functional impact except for inability to depend on counters.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Resolved: (PIG-1685) Pig is unable to handle counters for glob paths ?

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/PIG-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai resolved PIG-1685.
-----------------------------

       Resolution: Fixed
    Fix Version/s: 0.8.0
     Hadoop Flags: [Reviewed]

Patch committed to both trunk and 0.8 branch.

> Pig is unable to handle counters for glob paths ?
> -------------------------------------------------
>
>                 Key: PIG-1685
>                 URL: https://issues.apache.org/jira/browse/PIG-1685
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.8.0
>            Reporter: Mridul Muralidharan
>            Assignee: Daniel Dai
>             Fix For: 0.8.0
>
>         Attachments: PIG-1685-1.patch
>
>
> We get the following exception, which seems to be related to processing counters per path :
> java.net.URISyntaxException: Illegal character in path at index 71: /projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
>         at java.net.URI$Parser.fail(URI.java:2809)
>         at java.net.URI$Parser.checkChars(URI.java:2982)
>         at java.net.URI$Parser.parseHierarchical(URI.java:3066)
>         at java.net.URI$Parser.parse(URI.java:3024)
>         at java.net.URI.<init>(URI.java:578)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
>         at org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
>         at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
>         at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
>         at org.apache.pig.PigServer.execute(PigServer.java:1189)
>         at org.apache.pig.PigServer.access$100(PigServer.java:127)
>         at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
>         at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
>         at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
>         at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
>         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
>         at org.apache.pig.Main.run(Main.java:498)
>         at org.apache.pig.Main.main(Main.java:107)
> It results is (notice -1) among others:
> Input(s):
> Successfully read -1 records from: "/projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"
> Thankfully, there is no direct functional impact except for inability to depend on counters.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (PIG-1685) Pig is unable to handle counters for glob paths ?

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/PIG-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-1685:
----------------------------

    Attachment: PIG-1685-1.patch

> Pig is unable to handle counters for glob paths ?
> -------------------------------------------------
>
>                 Key: PIG-1685
>                 URL: https://issues.apache.org/jira/browse/PIG-1685
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.8.0
>            Reporter: Mridul Muralidharan
>            Assignee: Daniel Dai
>         Attachments: PIG-1685-1.patch
>
>
> We get the following exception, which seems to be related to processing counters per path :
> java.net.URISyntaxException: Illegal character in path at index 71: /projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
>         at java.net.URI$Parser.fail(URI.java:2809)
>         at java.net.URI$Parser.checkChars(URI.java:2982)
>         at java.net.URI$Parser.parseHierarchical(URI.java:3066)
>         at java.net.URI$Parser.parse(URI.java:3024)
>         at java.net.URI.<init>(URI.java:578)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
>         at org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
>         at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
>         at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
>         at org.apache.pig.PigServer.execute(PigServer.java:1189)
>         at org.apache.pig.PigServer.access$100(PigServer.java:127)
>         at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
>         at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
>         at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
>         at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
>         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
>         at org.apache.pig.Main.run(Main.java:498)
>         at org.apache.pig.Main.main(Main.java:107)
> It results is (notice -1) among others:
> Input(s):
> Successfully read -1 records from: "/projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"
> Thankfully, there is no direct functional impact except for inability to depend on counters.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (PIG-1685) Pig is unable to handle counters for glob paths ?

Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/PIG-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12923070#action_12923070 ] 

Daniel Dai commented on PIG-1685:
---------------------------------

test-patch result:

     [exec] +1 overall.  
     [exec] 
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec] 
     [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
     [exec] 
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec] 
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler warnings.
     [exec] 
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec] 
     [exec]     +1 release audit.  The applied patch does not increase the total number of release audit warnings.

All unit tests pass.

> Pig is unable to handle counters for glob paths ?
> -------------------------------------------------
>
>                 Key: PIG-1685
>                 URL: https://issues.apache.org/jira/browse/PIG-1685
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.8.0
>            Reporter: Mridul Muralidharan
>            Assignee: Daniel Dai
>         Attachments: PIG-1685-1.patch
>
>
> We get the following exception, which seems to be related to processing counters per path :
> java.net.URISyntaxException: Illegal character in path at index 71: /projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
>         at java.net.URI$Parser.fail(URI.java:2809)
>         at java.net.URI$Parser.checkChars(URI.java:2982)
>         at java.net.URI$Parser.parseHierarchical(URI.java:3066)
>         at java.net.URI$Parser.parse(URI.java:3024)
>         at java.net.URI.<init>(URI.java:578)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
>         at org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
>         at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
>         at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
>         at org.apache.pig.PigServer.execute(PigServer.java:1189)
>         at org.apache.pig.PigServer.access$100(PigServer.java:127)
>         at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
>         at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
>         at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
>         at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
>         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
>         at org.apache.pig.Main.run(Main.java:498)
>         at org.apache.pig.Main.main(Main.java:107)
> It results is (notice -1) among others:
> Input(s):
> Successfully read -1 records from: "/projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"
> Thankfully, there is no direct functional impact except for inability to depend on counters.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (PIG-1685) Pig is unable to handle counters for glob paths ?

Posted by "Mridul Muralidharan (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/PIG-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mridul Muralidharan updated PIG-1685:
-------------------------------------

    Description: 
We get the following exception, which seems to be related to processing counters per path :


java.net.URISyntaxException: Illegal character in path at index 71: $path_prefix/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
        at java.net.URI$Parser.fail(URI.java:2809)
        at java.net.URI$Parser.checkChars(URI.java:2982)
        at java.net.URI$Parser.parseHierarchical(URI.java:3066)
        at java.net.URI$Parser.parse(URI.java:3024)
        at java.net.URI.<init>(URI.java:578)
        at org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
        at org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
        at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
        at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
        at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
        at org.apache.pig.PigServer.execute(PigServer.java:1189)
        at org.apache.pig.PigServer.access$100(PigServer.java:127)
        at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
        at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
        at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
        at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
        at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
        at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
        at org.apache.pig.Main.run(Main.java:498)
        at org.apache.pig.Main.main(Main.java:107)




It results is (notice -1) among others:

Input(s):
Successfully read -1 records from: "$path_prefix/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"



Thankfully, there is no direct functional impact except for inability to depend on counters.

  was:

We get the following exception, which seems to be related to processing counters per path :


java.net.URISyntaxException: Illegal character in path at index 71: /projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
        at java.net.URI$Parser.fail(URI.java:2809)
        at java.net.URI$Parser.checkChars(URI.java:2982)
        at java.net.URI$Parser.parseHierarchical(URI.java:3066)
        at java.net.URI$Parser.parse(URI.java:3024)
        at java.net.URI.<init>(URI.java:578)
        at org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
        at org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
        at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
        at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
        at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
        at org.apache.pig.PigServer.execute(PigServer.java:1189)
        at org.apache.pig.PigServer.access$100(PigServer.java:127)
        at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
        at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
        at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
        at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
        at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
        at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
        at org.apache.pig.Main.run(Main.java:498)
        at org.apache.pig.Main.main(Main.java:107)




It results is (notice -1) among others:

Input(s):
Successfully read -1 records from: "/projects/gridfaces/mridulm/doopdex/k_data_index/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"



Thankfully, there is no direct functional impact except for inability to depend on counters.


Modified description to remove internal path ... my mistake.

> Pig is unable to handle counters for glob paths ?
> -------------------------------------------------
>
>                 Key: PIG-1685
>                 URL: https://issues.apache.org/jira/browse/PIG-1685
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.8.0
>            Reporter: Mridul Muralidharan
>            Assignee: Daniel Dai
>             Fix For: 0.8.0
>
>         Attachments: PIG-1685-1.patch
>
>
> We get the following exception, which seems to be related to processing counters per path :
> java.net.URISyntaxException: Illegal character in path at index 71: $path_prefix/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2
>         at java.net.URI$Parser.fail(URI.java:2809)
>         at java.net.URI$Parser.checkChars(URI.java:2982)
>         at java.net.URI$Parser.parseHierarchical(URI.java:3066)
>         at java.net.URI$Parser.parse(URI.java:3024)
>         at java.net.URI.<init>(URI.java:578)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.getMultiInputsCounterName(PigStatsUtil.java:128)
>         at org.apache.pig.tools.pigstats.JobStats.addInputStatistics(JobStats.java:523)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateSuccessStatistics(PigStatsUtil.java:340)
>         at org.apache.pig.tools.pigstats.PigStatsUtil.accumulateStats(PigStatsUtil.java:249)
>         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:315)
>         at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:301)
>         at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1197)
>         at org.apache.pig.PigServer.execute(PigServer.java:1189)
>         at org.apache.pig.PigServer.access$100(PigServer.java:127)
>         at org.apache.pig.PigServer$Graph.execute(PigServer.java:1513)
>         at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1560)
>         at org.apache.pig.PigServer.registerQuery(PigServer.java:522)
>         at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:868)
>         at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
>         at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141)
>         at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:90)
>         at org.apache.pig.Main.run(Main.java:498)
>         at org.apache.pig.Main.main(Main.java:107)
> It results is (notice -1) among others:
> Input(s):
> Successfully read -1 records from: "$path_prefix/20100830_cdxcore_10.7_{00,01,02,03,04,05,06,07,08}.bz2"
> Thankfully, there is no direct functional impact except for inability to depend on counters.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.