You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@eagle.apache.org by "Liangfei.Su" <su...@gmail.com> on 2016/02/04 02:16:16 UTC

Re: HDFS topology not working.

Errors from the siddhi parser. Can you also the post the policy definition?

On Thu, Feb 4, 2016 at 9:13 AM, Dendukuri, Hemanth <hd...@ebay.com>
wrote:

> Hi,
>
>
> I see below exception in the log.
>
>
>
> org.wso2.siddhi.query.api.exception.ExecutionPlanValidationException:
> contains is neither a function extension nor an aggregated attribute
> extension, when creating query copyFromLocal in execution plan
> "ab205b61-cc34-4e7a-87fc-f234b38a1909"
>
> at
> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:127)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:51)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:59)
> ~[stormjar.jar:na]
>
> at
> org.apache.eagle.security.auditlog.HdfsUserCommandReassembler.init(HdfsUserCommandReassembler.java:130)
> ~[stormjar.jar:na]
>
> at
> org.apache.eagle.datastream.storm.JavaStormBoltWrapper.prepare(JavaStormBoltWrapper.scala:36)
> ~[stormjar.jar:na]
>
> at
> backtype.storm.daemon.executor$fn__5017$fn__5030.invoke(executor.clj:732)
> ~[storm-core-0.9.3.2.2.4.2-2.jar:0.9.3.2.2.4.2-2]
>
> at backtype.storm.util$async_loop$fn__452.invoke(util.clj:463)
> ~[storm-core-0.9.3.2.2.4.2-2.jar:0.9.3.2.2.4.2-2]
>
> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
>
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_79]
>
> Caused by: org.wso2.siddhi.core.exception.ExecutionPlanCreationException:
> contains is neither a function extension nor an aggregated attribute
> extension, when creating query copyFromLocal
>
> at
> org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:109)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:117)
> ~[stormjar.jar:na]
>
> ... 8 common frames omitted
>
> Caused by: org.wso2.siddhi.core.exception.ExecutionPlanCreationException:
> contains is neither a function extension nor an aggregated attribute
> extension
>
> at
> org.wso2.siddhi.core.util.parser.ExpressionParser.parseExpression(ExpressionParser.java:244)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.util.parser.ExpressionParser.parseExpression(ExpressionParser.java:103)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.util.parser.SingleInputStreamParser.generateProcessor(SingleInputStreamParser.java:129)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.util.parser.SingleInputStreamParser.parseInputStream(SingleInputStreamParser.java:86)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:92)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:171)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parseInputStream(StateInputStreamParser.java:72)
> ~[stormjar.jar:na]
>
> at
> org.wso2.siddhi.core.util.parser.InputStreamParser.parse(InputStreamParser.java:57)
> ~[stormjar.jar:na]
>
> at org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:64)
> ~[stormjar.jar:na]
>
> ... 9 common frames omitted
>
> 2016-02-04 01:08:51 b.s.d.executor [ERROR]
>
>
> Regards
>
> Hemanth
>

Re: HDFS topology not working.

Posted by "Dendukuri, Hemanth" <hd...@ebay.com>.

Hao, 

      I am still able to reproduce this issue.

Regards
Hemanth  




On 2/4/16, 10:42 AM, "Dendukuri, Hemanth" <hd...@ebay.com> wrote:

>Hao, 
>
>      I am just using "mvn clean install” command to build the and script "examples/eagle-sandbox-starter.sh" to deploy. Please find content of file “str.siddhiext”, below. 
>
>
>  charAt=org.wso2.siddhi.extension.string.CharAtFunctionExtension
>coalesce=org.wso2.siddhi.extension.string.CoalesceFunctionExtension
>concat=org.wso2.siddhi.extension.string.ConcatFunctionExtension
>length=org.wso2.siddhi.extension.string.LengthFunctionExtension
>lower=org.wso2.siddhi.extension.string.LowerFunctionExtension
>regexp=org.wso2.siddhi.extension.string.RegexpFunctionExtension
>repeat=org.wso2.siddhi.extension.string.RepeatFunctionExtension
>replaceAll=org.wso2.siddhi.extension.string.ReplaceAllFunctionExtension
>replaceFirst=org.wso2.siddhi.extension.string.ReplaceFirstFunctionExtension
>reverse=org.wso2.siddhi.extension.string.ReverseFunctionExtension
>strcmp=org.wso2.siddhi.extension.string.StrcmpFunctionExtension
>substr=org.wso2.siddhi.extension.string.SubstrFunctionExtension
>trim=org.wso2.siddhi.extension.string.TrimFunctionExtension
>upper=org.wso2.siddhi.extension.string.UpperFunctionExtension
>hex=org.wso2.siddhi.extension.string.HexFunctionExtension
>unhex=org.wso2.siddhi.extension.string.UnhexFunctionExtension
>equalsIgnoreCase=org.apache.eagle.policy.siddhi.extension.EqualsIgnoreCaseExtension
>containsIgnoreCase=org.apache.eagle.policy.siddhi.extension.ContainsIgnoreCaseExtension
>regexpIgnoreCase=org.apache.eagle.policy.siddhi.extension.RegexpIgnoreCaseFunctionExtension
>
>  
> 
>Regards
>Hemanth
>
>
>
>
>On 2/3/16, 5:41 PM, "Hao Chen" <ha...@apache.org> wrote:
>
>>Hemanth,
>>
>>How do you build the package? Could you extract the siddhiext file in your
>>topology.jar and paste in this thread?
>>
>>Regards,
>>Hao
>>
>>On Thu, Feb 4, 2016 at 9:38 AM, Hao Chen <ha...@apache.org> wrote:
>>
>>> It has nothing to do with policy definition, it should be because the
>>> str.siddhiext file is not correctly packaged.
>>>
>>> Regards,
>>> Hao
>>>
>>> On Thu, Feb 4, 2016 at 9:22 AM, Dendukuri, Hemanth <hd...@ebay.com>
>>> wrote:
>>>
>>>> I have only one HDFS policy, which is the default one
>>>>
>>>> from hdfsAuditLogEventStream[(cmd=='open') and (src=='/tmp/private')]
>>>> select * insert into outputStream
>>>>
>>>>
>>>> Regards
>>>> Hemanth
>>>>
>>>>
>>>>
>>>>
>>>> On 2/3/16, 5:16 PM, "Liangfei.Su" <su...@gmail.com> wrote:
>>>>
>>>> >Errors from the siddhi parser. Can you also the post the policy
>>>> definition?
>>>> >
>>>> >On Thu, Feb 4, 2016 at 9:13 AM, Dendukuri, Hemanth <hd...@ebay.com>
>>>> >wrote:
>>>> >
>>>> >> Hi,
>>>> >>
>>>> >>
>>>> >> I see below exception in the log.
>>>> >>
>>>> >>
>>>> >>
>>>> >> org.wso2.siddhi.query.api.exception.ExecutionPlanValidationException:
>>>> >> contains is neither a function extension nor an aggregated attribute
>>>> >> extension, when creating query copyFromLocal in execution plan
>>>> >> "ab205b61-cc34-4e7a-87fc-f234b38a1909"
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:127)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:51)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:59)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.apache.eagle.security.auditlog.HdfsUserCommandReassembler.init(HdfsUserCommandReassembler.java:130)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.apache.eagle.datastream.storm.JavaStormBoltWrapper.prepare(JavaStormBoltWrapper.scala:36)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> backtype.storm.daemon.executor$fn__5017$fn__5030.invoke(executor.clj:732)
>>>> >> ~[storm-core-0.9.3.2.2.4.2-2.jar:0.9.3.2.2.4.2-2]
>>>> >>
>>>> >> at backtype.storm.util$async_loop$fn__452.invoke(util.clj:463)
>>>> >> ~[storm-core-0.9.3.2.2.4.2-2.jar:0.9.3.2.2.4.2-2]
>>>> >>
>>>> >> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
>>>> >>
>>>> >> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_79]
>>>> >>
>>>> >> Caused by:
>>>> org.wso2.siddhi.core.exception.ExecutionPlanCreationException:
>>>> >> contains is neither a function extension nor an aggregated attribute
>>>> >> extension, when creating query copyFromLocal
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:109)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:117)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> ... 8 common frames omitted
>>>> >>
>>>> >> Caused by:
>>>> org.wso2.siddhi.core.exception.ExecutionPlanCreationException:
>>>> >> contains is neither a function extension nor an aggregated attribute
>>>> >> extension
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.ExpressionParser.parseExpression(ExpressionParser.java:244)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.ExpressionParser.parseExpression(ExpressionParser.java:103)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.SingleInputStreamParser.generateProcessor(SingleInputStreamParser.java:129)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.SingleInputStreamParser.parseInputStream(SingleInputStreamParser.java:86)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:92)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:171)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parseInputStream(StateInputStreamParser.java:72)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> >>
>>>> org.wso2.siddhi.core.util.parser.InputStreamParser.parse(InputStreamParser.java:57)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> at
>>>> org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:64)
>>>> >> ~[stormjar.jar:na]
>>>> >>
>>>> >> ... 9 common frames omitted
>>>> >>
>>>> >> 2016-02-04 01:08:51 b.s.d.executor [ERROR]
>>>> >>
>>>> >>
>>>> >> Regards
>>>> >>
>>>> >> Hemanth
>>>> >>
>>>>
>>>
>>>

Re: HDFS topology not working.

Posted by "Dendukuri, Hemanth" <hd...@ebay.com>.

Hao, 

      I am just using "mvn clean install” command to build the and script "examples/eagle-sandbox-starter.sh" to deploy. Please find content of file “str.siddhiext”, below. 


  charAt=org.wso2.siddhi.extension.string.CharAtFunctionExtension
coalesce=org.wso2.siddhi.extension.string.CoalesceFunctionExtension
concat=org.wso2.siddhi.extension.string.ConcatFunctionExtension
length=org.wso2.siddhi.extension.string.LengthFunctionExtension
lower=org.wso2.siddhi.extension.string.LowerFunctionExtension
regexp=org.wso2.siddhi.extension.string.RegexpFunctionExtension
repeat=org.wso2.siddhi.extension.string.RepeatFunctionExtension
replaceAll=org.wso2.siddhi.extension.string.ReplaceAllFunctionExtension
replaceFirst=org.wso2.siddhi.extension.string.ReplaceFirstFunctionExtension
reverse=org.wso2.siddhi.extension.string.ReverseFunctionExtension
strcmp=org.wso2.siddhi.extension.string.StrcmpFunctionExtension
substr=org.wso2.siddhi.extension.string.SubstrFunctionExtension
trim=org.wso2.siddhi.extension.string.TrimFunctionExtension
upper=org.wso2.siddhi.extension.string.UpperFunctionExtension
hex=org.wso2.siddhi.extension.string.HexFunctionExtension
unhex=org.wso2.siddhi.extension.string.UnhexFunctionExtension
equalsIgnoreCase=org.apache.eagle.policy.siddhi.extension.EqualsIgnoreCaseExtension
containsIgnoreCase=org.apache.eagle.policy.siddhi.extension.ContainsIgnoreCaseExtension
regexpIgnoreCase=org.apache.eagle.policy.siddhi.extension.RegexpIgnoreCaseFunctionExtension

  
 
Regards
Hemanth




On 2/3/16, 5:41 PM, "Hao Chen" <ha...@apache.org> wrote:

>Hemanth,
>
>How do you build the package? Could you extract the siddhiext file in your
>topology.jar and paste in this thread?
>
>Regards,
>Hao
>
>On Thu, Feb 4, 2016 at 9:38 AM, Hao Chen <ha...@apache.org> wrote:
>
>> It has nothing to do with policy definition, it should be because the
>> str.siddhiext file is not correctly packaged.
>>
>> Regards,
>> Hao
>>
>> On Thu, Feb 4, 2016 at 9:22 AM, Dendukuri, Hemanth <hd...@ebay.com>
>> wrote:
>>
>>> I have only one HDFS policy, which is the default one
>>>
>>> from hdfsAuditLogEventStream[(cmd=='open') and (src=='/tmp/private')]
>>> select * insert into outputStream
>>>
>>>
>>> Regards
>>> Hemanth
>>>
>>>
>>>
>>>
>>> On 2/3/16, 5:16 PM, "Liangfei.Su" <su...@gmail.com> wrote:
>>>
>>> >Errors from the siddhi parser. Can you also the post the policy
>>> definition?
>>> >
>>> >On Thu, Feb 4, 2016 at 9:13 AM, Dendukuri, Hemanth <hd...@ebay.com>
>>> >wrote:
>>> >
>>> >> Hi,
>>> >>
>>> >>
>>> >> I see below exception in the log.
>>> >>
>>> >>
>>> >>
>>> >> org.wso2.siddhi.query.api.exception.ExecutionPlanValidationException:
>>> >> contains is neither a function extension nor an aggregated attribute
>>> >> extension, when creating query copyFromLocal in execution plan
>>> >> "ab205b61-cc34-4e7a-87fc-f234b38a1909"
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:127)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:51)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:59)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.apache.eagle.security.auditlog.HdfsUserCommandReassembler.init(HdfsUserCommandReassembler.java:130)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.apache.eagle.datastream.storm.JavaStormBoltWrapper.prepare(JavaStormBoltWrapper.scala:36)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> backtype.storm.daemon.executor$fn__5017$fn__5030.invoke(executor.clj:732)
>>> >> ~[storm-core-0.9.3.2.2.4.2-2.jar:0.9.3.2.2.4.2-2]
>>> >>
>>> >> at backtype.storm.util$async_loop$fn__452.invoke(util.clj:463)
>>> >> ~[storm-core-0.9.3.2.2.4.2-2.jar:0.9.3.2.2.4.2-2]
>>> >>
>>> >> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
>>> >>
>>> >> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_79]
>>> >>
>>> >> Caused by:
>>> org.wso2.siddhi.core.exception.ExecutionPlanCreationException:
>>> >> contains is neither a function extension nor an aggregated attribute
>>> >> extension, when creating query copyFromLocal
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:109)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:117)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> ... 8 common frames omitted
>>> >>
>>> >> Caused by:
>>> org.wso2.siddhi.core.exception.ExecutionPlanCreationException:
>>> >> contains is neither a function extension nor an aggregated attribute
>>> >> extension
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.ExpressionParser.parseExpression(ExpressionParser.java:244)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.ExpressionParser.parseExpression(ExpressionParser.java:103)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.SingleInputStreamParser.generateProcessor(SingleInputStreamParser.java:129)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.SingleInputStreamParser.parseInputStream(SingleInputStreamParser.java:86)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:92)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:171)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parseInputStream(StateInputStreamParser.java:72)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> >>
>>> org.wso2.siddhi.core.util.parser.InputStreamParser.parse(InputStreamParser.java:57)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> at
>>> org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:64)
>>> >> ~[stormjar.jar:na]
>>> >>
>>> >> ... 9 common frames omitted
>>> >>
>>> >> 2016-02-04 01:08:51 b.s.d.executor [ERROR]
>>> >>
>>> >>
>>> >> Regards
>>> >>
>>> >> Hemanth
>>> >>
>>>
>>
>>

Re: HDFS topology not working.

Posted by Hao Chen <ha...@apache.org>.

Hemanth,

How do you build the package? Could you extract the siddhiext file in your
topology.jar and paste in this thread?

Regards,
Hao

On Thu, Feb 4, 2016 at 9:38 AM, Hao Chen <ha...@apache.org> wrote:

> It has nothing to do with policy definition, it should be because the
> str.siddhiext file is not correctly packaged.
>
> Regards,
> Hao
>
> On Thu, Feb 4, 2016 at 9:22 AM, Dendukuri, Hemanth <hd...@ebay.com>
> wrote:
>
>> I have only one HDFS policy, which is the default one
>>
>> from hdfsAuditLogEventStream[(cmd=='open') and (src=='/tmp/private')]
>> select * insert into outputStream
>>
>>
>> Regards
>> Hemanth
>>
>>
>>
>>
>> On 2/3/16, 5:16 PM, "Liangfei.Su" <su...@gmail.com> wrote:
>>
>> >Errors from the siddhi parser. Can you also the post the policy
>> definition?
>> >
>> >On Thu, Feb 4, 2016 at 9:13 AM, Dendukuri, Hemanth <hd...@ebay.com>
>> >wrote:
>> >
>> >> Hi,
>> >>
>> >>
>> >> I see below exception in the log.
>> >>
>> >>
>> >>
>> >> org.wso2.siddhi.query.api.exception.ExecutionPlanValidationException:
>> >> contains is neither a function extension nor an aggregated attribute
>> >> extension, when creating query copyFromLocal in execution plan
>> >> "ab205b61-cc34-4e7a-87fc-f234b38a1909"
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:127)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:51)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:59)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.apache.eagle.security.auditlog.HdfsUserCommandReassembler.init(HdfsUserCommandReassembler.java:130)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.apache.eagle.datastream.storm.JavaStormBoltWrapper.prepare(JavaStormBoltWrapper.scala:36)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> backtype.storm.daemon.executor$fn__5017$fn__5030.invoke(executor.clj:732)
>> >> ~[storm-core-0.9.3.2.2.4.2-2.jar:0.9.3.2.2.4.2-2]
>> >>
>> >> at backtype.storm.util$async_loop$fn__452.invoke(util.clj:463)
>> >> ~[storm-core-0.9.3.2.2.4.2-2.jar:0.9.3.2.2.4.2-2]
>> >>
>> >> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
>> >>
>> >> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_79]
>> >>
>> >> Caused by:
>> org.wso2.siddhi.core.exception.ExecutionPlanCreationException:
>> >> contains is neither a function extension nor an aggregated attribute
>> >> extension, when creating query copyFromLocal
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:109)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:117)
>> >> ~[stormjar.jar:na]
>> >>
>> >> ... 8 common frames omitted
>> >>
>> >> Caused by:
>> org.wso2.siddhi.core.exception.ExecutionPlanCreationException:
>> >> contains is neither a function extension nor an aggregated attribute
>> >> extension
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.ExpressionParser.parseExpression(ExpressionParser.java:244)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.ExpressionParser.parseExpression(ExpressionParser.java:103)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.SingleInputStreamParser.generateProcessor(SingleInputStreamParser.java:129)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.SingleInputStreamParser.parseInputStream(SingleInputStreamParser.java:86)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:92)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:171)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parseInputStream(StateInputStreamParser.java:72)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> >>
>> org.wso2.siddhi.core.util.parser.InputStreamParser.parse(InputStreamParser.java:57)
>> >> ~[stormjar.jar:na]
>> >>
>> >> at
>> org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:64)
>> >> ~[stormjar.jar:na]
>> >>
>> >> ... 9 common frames omitted
>> >>
>> >> 2016-02-04 01:08:51 b.s.d.executor [ERROR]
>> >>
>> >>
>> >> Regards
>> >>
>> >> Hemanth
>> >>
>>
>
>

Re: HDFS topology not working.

Posted by Hao Chen <ha...@apache.org>.

It has nothing to do with policy definition, it should be because the
str.siddhiext file is not correctly packaged.

Regards,
Hao

On Thu, Feb 4, 2016 at 9:22 AM, Dendukuri, Hemanth <hd...@ebay.com>
wrote:

> I have only one HDFS policy, which is the default one
>
> from hdfsAuditLogEventStream[(cmd=='open') and (src=='/tmp/private')]
> select * insert into outputStream
>
>
> Regards
> Hemanth
>
>
>
>
> On 2/3/16, 5:16 PM, "Liangfei.Su" <su...@gmail.com> wrote:
>
> >Errors from the siddhi parser. Can you also the post the policy
> definition?
> >
> >On Thu, Feb 4, 2016 at 9:13 AM, Dendukuri, Hemanth <hd...@ebay.com>
> >wrote:
> >
> >> Hi,
> >>
> >>
> >> I see below exception in the log.
> >>
> >>
> >>
> >> org.wso2.siddhi.query.api.exception.ExecutionPlanValidationException:
> >> contains is neither a function extension nor an aggregated attribute
> >> extension, when creating query copyFromLocal in execution plan
> >> "ab205b61-cc34-4e7a-87fc-f234b38a1909"
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:127)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:51)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:59)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.apache.eagle.security.auditlog.HdfsUserCommandReassembler.init(HdfsUserCommandReassembler.java:130)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.apache.eagle.datastream.storm.JavaStormBoltWrapper.prepare(JavaStormBoltWrapper.scala:36)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> backtype.storm.daemon.executor$fn__5017$fn__5030.invoke(executor.clj:732)
> >> ~[storm-core-0.9.3.2.2.4.2-2.jar:0.9.3.2.2.4.2-2]
> >>
> >> at backtype.storm.util$async_loop$fn__452.invoke(util.clj:463)
> >> ~[storm-core-0.9.3.2.2.4.2-2.jar:0.9.3.2.2.4.2-2]
> >>
> >> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
> >>
> >> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_79]
> >>
> >> Caused by:
> org.wso2.siddhi.core.exception.ExecutionPlanCreationException:
> >> contains is neither a function extension nor an aggregated attribute
> >> extension, when creating query copyFromLocal
> >>
> >> at
> >> org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:109)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:117)
> >> ~[stormjar.jar:na]
> >>
> >> ... 8 common frames omitted
> >>
> >> Caused by:
> org.wso2.siddhi.core.exception.ExecutionPlanCreationException:
> >> contains is neither a function extension nor an aggregated attribute
> >> extension
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.ExpressionParser.parseExpression(ExpressionParser.java:244)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.ExpressionParser.parseExpression(ExpressionParser.java:103)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.SingleInputStreamParser.generateProcessor(SingleInputStreamParser.java:129)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.SingleInputStreamParser.parseInputStream(SingleInputStreamParser.java:86)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:92)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:171)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parseInputStream(StateInputStreamParser.java:72)
> >> ~[stormjar.jar:na]
> >>
> >> at
> >>
> org.wso2.siddhi.core.util.parser.InputStreamParser.parse(InputStreamParser.java:57)
> >> ~[stormjar.jar:na]
> >>
> >> at
> org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:64)
> >> ~[stormjar.jar:na]
> >>
> >> ... 9 common frames omitted
> >>
> >> 2016-02-04 01:08:51 b.s.d.executor [ERROR]
> >>
> >>
> >> Regards
> >>
> >> Hemanth
> >>
>

Re: HDFS topology not working.

Posted by "Dendukuri, Hemanth" <hd...@ebay.com>.

I have only one HDFS policy, which is the default one 

from hdfsAuditLogEventStream[(cmd=='open') and (src=='/tmp/private')] select * insert into outputStream


Regards
Hemanth




On 2/3/16, 5:16 PM, "Liangfei.Su" <su...@gmail.com> wrote:

>Errors from the siddhi parser. Can you also the post the policy definition?
>
>On Thu, Feb 4, 2016 at 9:13 AM, Dendukuri, Hemanth <hd...@ebay.com>
>wrote:
>
>> Hi,
>>
>>
>> I see below exception in the log.
>>
>>
>>
>> org.wso2.siddhi.query.api.exception.ExecutionPlanValidationException:
>> contains is neither a function extension nor an aggregated attribute
>> extension, when creating query copyFromLocal in execution plan
>> "ab205b61-cc34-4e7a-87fc-f234b38a1909"
>>
>> at
>> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:127)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:51)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.SiddhiManager.createExecutionPlanRuntime(SiddhiManager.java:59)
>> ~[stormjar.jar:na]
>>
>> at
>> org.apache.eagle.security.auditlog.HdfsUserCommandReassembler.init(HdfsUserCommandReassembler.java:130)
>> ~[stormjar.jar:na]
>>
>> at
>> org.apache.eagle.datastream.storm.JavaStormBoltWrapper.prepare(JavaStormBoltWrapper.scala:36)
>> ~[stormjar.jar:na]
>>
>> at
>> backtype.storm.daemon.executor$fn__5017$fn__5030.invoke(executor.clj:732)
>> ~[storm-core-0.9.3.2.2.4.2-2.jar:0.9.3.2.2.4.2-2]
>>
>> at backtype.storm.util$async_loop$fn__452.invoke(util.clj:463)
>> ~[storm-core-0.9.3.2.2.4.2-2.jar:0.9.3.2.2.4.2-2]
>>
>> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
>>
>> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_79]
>>
>> Caused by: org.wso2.siddhi.core.exception.ExecutionPlanCreationException:
>> contains is neither a function extension nor an aggregated attribute
>> extension, when creating query copyFromLocal
>>
>> at
>> org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:109)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.util.parser.ExecutionPlanParser.parse(ExecutionPlanParser.java:117)
>> ~[stormjar.jar:na]
>>
>> ... 8 common frames omitted
>>
>> Caused by: org.wso2.siddhi.core.exception.ExecutionPlanCreationException:
>> contains is neither a function extension nor an aggregated attribute
>> extension
>>
>> at
>> org.wso2.siddhi.core.util.parser.ExpressionParser.parseExpression(ExpressionParser.java:244)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.util.parser.ExpressionParser.parseExpression(ExpressionParser.java:103)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.util.parser.SingleInputStreamParser.generateProcessor(SingleInputStreamParser.java:129)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.util.parser.SingleInputStreamParser.parseInputStream(SingleInputStreamParser.java:86)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:92)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:134)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parse(StateInputStreamParser.java:171)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.util.parser.StateInputStreamParser.parseInputStream(StateInputStreamParser.java:72)
>> ~[stormjar.jar:na]
>>
>> at
>> org.wso2.siddhi.core.util.parser.InputStreamParser.parse(InputStreamParser.java:57)
>> ~[stormjar.jar:na]
>>
>> at org.wso2.siddhi.core.util.parser.QueryParser.parse(QueryParser.java:64)
>> ~[stormjar.jar:na]
>>
>> ... 9 common frames omitted
>>
>> 2016-02-04 01:08:51 b.s.d.executor [ERROR]
>>
>>
>> Regards
>>
>> Hemanth
>>