You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2014/12/08 21:03:13 UTC
[jira] [Comment Edited] (PIG-4350) Port local mode tests to Tez -
part2
[ https://issues.apache.org/jira/browse/PIG-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14230753#comment-14230753 ]
Daniel Dai edited comment on PIG-4350 at 12/8/14 8:02 PM:
----------------------------------------------------------
Here is a list of tests covered:
TestOrcStorage
TestOrcStoragePushdown
TestPluckTuple
TestMockStorage
TestStreamingUDF
TestImplicitSplitOnTuple
TestSchemaResetter
TestLocationInPhysicalPlan
TestLogicalPlanGenerator
TestAlgebraicEvalLocal
TestAssert
TestBatchAliases
TestBlackAndWhitelistValidator
TestBuiltin
TestBuiltInBagToTupleOrString
TestBuiltinInvoker
TestCase
TestCommit
TestDataBagAccess
TestFilterOpNumeric
TestFilterOpString
TestForEachNestedPlanLocal
TestForEachStar
TestIn
TestInfixArithmetic
TestInputOutputFileValidator
TestJsonLoaderStorage
TestLimitSchemaStore
TestLoad
TestLocal
TestLocal2
TestLOLoadDeterminedSchema
TestMacroExpansion
TestNullConstant
TestOrderBy3
TestParser
TestPigContext
TestPigSplit
TestPigStorage
TestPoissonSampleLoader
TestPONegative
TestProject
TestProjectStarExpander
TestRank1
TestRank2
TestRegisteredJarVisibility
TestRelationToExprProject
TestScriptingLanguagePython
TestSplit
TestSplitIndex
TestStoreInstances
TestStreamingLocal
TestTypedMap
TestUDF
TestUDFContext
TestUDFGroovy
TestUDFWithoutParameter
TestUnion
TestUTF8
TestGruntParser
Most are simple cases. Major issue found:
1. hard code part filename: eg, part-m-00000 is not applicable in tez
2. part file name convention change (MockStorage)
3. Mixed tez local tests and MiniTezCluster fail sometimes (TEZ-1802)
4. Some tests need more heap memory (TestMultiQueryBasic)
5. Different invocation for storer func (TestLoadStoreFuncLifeCycle)
6. Some test need to change to check differently in tez and mr
was (Author: daijy):
Here is a list of tests covered:
TestLoadStoreFuncLifeCycle
TestOrcStorage
TestOrcStoragePushdown
TestPluckTuple
TestMockStorage
TestStreamingUDF
TestImplicitSplitOnTuple
TestSchemaResetter
TestLocationInPhysicalPlan
TestLogicalPlanGenerator
TestAlgebraicEvalLocal
TestAssert
TestBatchAliases
TestBlackAndWhitelistValidator
TestBuiltin
TestBuiltInBagToTupleOrString
TestBuiltinInvoker
TestCase
TestCommit
TestDataBagAccess
TestFilterOpNumeric
TestFilterOpString
TestForEachNestedPlanLocal
TestForEachStar
TestIn
TestInfixArithmetic
TestInputOutputFileValidator
TestJsonLoaderStorage
TestLimitSchemaStore
TestLoad
TestLocal
TestLocal2
TestLOLoadDeterminedSchema
TestMacroExpansion
TestMultiQueryBasic
TestNullConstant
TestOrderBy3
TestParser
TestPigContext
TestPigSplit
TestPigStorage
TestPoissonSampleLoader
TestPONegative
TestProject
TestProjectStarExpander
TestRank1
TestRank2
TestRegisteredJarVisibility
TestRelationToExprProject
TestScriptingLanguagePython
TestSplit
TestSplitIndex
TestStoreInstances
TestStreamingLocal
TestTypedMap
TestUDF
TestUDFContext
TestUDFGroovy
TestUDFWithoutParameter
TestUnion
TestUTF8
TestGruntParser
Most are simple cases. Major issue found:
1. hard code part filename: eg, part-m-00000 is not applicable in tez
2. part file name convention change (MockStorage)
3. Mixed tez local tests and MiniTezCluster fail sometimes (TEZ-1802)
4. Some tests need more heap memory (TestMultiQueryBasic)
5. Different invocation for storer func (TestLoadStoreFuncLifeCycle)
6. Some test need to change to check differently in tez and mr
> Port local mode tests to Tez - part2
> ------------------------------------
>
> Key: PIG-4350
> URL: https://issues.apache.org/jira/browse/PIG-4350
> Project: Pig
> Issue Type: Sub-task
> Components: tez
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.15.0
>
> Attachments: PIG-4350-1.patch, PIG-4350-2.patch, PIG-4350-3.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)