You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Srinivasulu Punuru (JIRA)" <ji...@apache.org> on 2018/09/04 23:29:00 UTC
[jira] [Closed] (SAMZA-1821) Fetching systemStream configs causes
duplicate key exception
[ https://issues.apache.org/jira/browse/SAMZA-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Srinivasulu Punuru closed SAMZA-1821.
-------------------------------------
https://github.com/apache/samza/pull/616
> Fetching systemStream configs causes duplicate key exception
> ------------------------------------------------------------
>
> Key: SAMZA-1821
> URL: https://issues.apache.org/jira/browse/SAMZA-1821
> Project: Samza
> Issue Type: Bug
> Components: sql
> Reporter: Weiqing Yang
> Priority: Major
> Fix For: 1.0
>
>
> If users input a samza.sql file including multiple Sql statements which have the same input sources or output destinations, for example,
> {code:java}
> insert into log.outputStream select * from brooklin.espresso.elasticsearchEnterpriseAccounts
> insert into log.outputstream select sfdcAccountId as key, organizationUrn as name2, description as name3 from brooklin.espresso.elasticsearchEnterpriseAccounts
> {code}
> an exception of "java.lang.IllegalStateException: Duplicate key org.apache.samza.sql.interfaces.SqlIOConfig" is thrown when fetching input/output systemStream configs:
> {code:java}
> java.lang.IllegalStateException: Duplicate key org.apache.samza.sql.interfaces.SqlIOConfig@1bf0f6f6
> at java.util.stream.Collectors.lambda$throwingMerger$0(Collectors.java:133)
> at java.util.HashMap.merge(HashMap.java:1245)
> at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1320)
> at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169)
> at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374)
> at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
> at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:270)
> at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
> at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374)
> at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
> at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
> at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
> at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
> at org.apache.samza.sql.runner.SamzaSqlApplicationConfig.<init>(SamzaSqlApplicationConfig.java:116)
> at com.linkedin.samza.sql.SamzaLiSqlParser.getSamzaSqlResources(SamzaLiSqlParser.java:58)
> at com.linkedin.samza.sql.SamzaLiSqlParser.parseSqlResources(SamzaLiSqlParser.java:51)
> at com.linkedin.samza.sql.SamzaLiSqlParserTest.testParseSqlResources_mixedKinds(SamzaLiSqlParserTest.java:60)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108)
> at org.testng.internal.Invoker.invokeMethod(Invoker.java:661)
> at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:869)
> at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1193)
> at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:126)
> at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109)
> at org.testng.TestRunner.privateRun(TestRunner.java:744)
> at org.testng.TestRunner.run(TestRunner.java:602)
> at org.testng.SuiteRunner.runTest(SuiteRunner.java:380)
> at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375)
> at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340)
> at org.testng.SuiteRunner.run(SuiteRunner.java:289)
> at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
> at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
> at org.testng.TestNG.runSuitesSequentially(TestNG.java:1301)
> at org.testng.TestNG.runSuitesLocally(TestNG.java:1226)
> at org.testng.TestNG.runSuites(TestNG.java:1144)
> at org.testng.TestNG.run(TestNG.java:1115)
> at org.testng.IDEARemoteTestNG.run(IDEARemoteTestNG.java:72)
> at org.testng.RemoteTestNGStarter.main(RemoteTestNGStarter.java:123)
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)