You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@eagle.apache.org by DadanielZ <gi...@git.apache.org> on 2016/08/05 21:07:42 UTC
[GitHub] incubator-eagle pull request #307: EAGLE-283: Convert fid,uid in MapR's audi...
GitHub user DadanielZ opened a pull request:
https://github.com/apache/incubator-eagle/pull/307
EAGLE-283: Convert fid,uid in MapR's audit log to FIle/folder name, user name
1. Added resolver for user's input of "volume", "file/folder", "Status"
- These resolver provide drop down list for user to select
2. Added NameConvertor to convert user's input to corresponding id and saved it in policy
- volume value will be used to call MapR's REST API to get volume id
- status code will be resolved to status id
- file/folder name will be passed to MapR's command line class to get its id.
3. Modified controller.js
- As soon as user input a value for "volume", "file", "status", it will fetch user's input and call rest service to get corresponding id
- Save ids as a new match criteria in the policy
Eg: user select "== '/test'" in field "dst", a new match criteria "== 234.567.890" will appear automatically under it, and the policy will end up as:
dst == 'test' or dst == '234.567.890'
Same for volume and status input.
In this way, the policy is human readable and can be used to match the ids in maprfsAuditLog.
4. Added maprfs resource resolver to provide drop down list for user
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/DadanielZ/incubator-eagle develop
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-eagle/pull/307.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #307
----
commit c6d10261e5ba32bf22c1fcee07c8c0ebf6f43a68
Author: Daniel <dz...@binghamton.edu>
Date: 2016-07-05T18:11:12Z
Merge pull request #12 from apache/develop
EAGLE-276 eagle support for mr & spark history job monitoring
commit 92d7a14a529b17608f018fb624039bb9115b9dff
Author: Daniel <dz...@binghamton.edu>
Date: 2016-07-21T05:18:22Z
Merge pull request #13 from apache/develop
update from Eagle develop
commit 2d97d281ec10eb24dca76f64557733d412ce6a19
Author: Daniel <dz...@binghamton.edu>
Date: 2016-07-28T17:56:52Z
Merge pull request #14 from apache/develop
update from eagle-develop
commit 1e2e6a98569d2000f3561c420067e2f926fa2a75
Author: Daniel <dz...@binghamton.edu>
Date: 2016-07-29T19:38:01Z
Merge pull request #15 from apache/develop
update from apache-eagle develop branch
commit 55b6e1d8279be9b72b3958c52fc36bbe72a2ceb0
Author: Daniel <da...@apache.org>
Date: 2016-08-04T05:10:29Z
Merge pull request #16 from apache/develop
update from eagle-develop
commit 7340451cbb0621bfc1eebae1deeed730349ee8a6
Author: Daniel <da...@dataguise.com>
Date: 2016-08-04T21:19:37Z
EAGLE-283: Convert fid,uid in MapR's audit log to FIle/folder name, user name
1. Added resolver for user's input of "volume", "file/folder", "Status"
- These resolver provide drop down list for user to select
2. Added NameConvertor to convert user's input to corresponding id and saved it in policy
- volume value will be used to call MapR's REST API to get volume id
- status code will be resolved to status id
- file/folder name will be passed to MapR's command line class to get its id.
3. Modified controller.js
- As soon as user input a value for "volume", "file", "status", it will fetch user's input and call rest service to get corresponding id
- Save ids as a new match criteria in the policy
Eg: user select "== '/test'" in field "dst", a new match criteria "== 234.567.890" will appear automatically under it, and the policy will end up as:
dst == 'test' or dst == '234.567.890'
Same for volume and status input.
In this way, the policy is human readable and can be used to match the ids in maprfsAuditLog.
4. Added maprfs resource resolver to provide drop down list for user
5. Added license for "/eagle-app-example/src/main/java/org/apache/eagle/app/example/ExampleStormConfig.java" to pass rat check.
commit bc574057e11133a7410aeb4eca24f883ab7d41ba
Author: Daniel <da...@dataguise.com>
Date: 2016-08-05T19:04:18Z
EAGLE-283: Convert fid,uid in MapR's audit log to FIle/folder name, user name
1. Added resolver for user's input of "volume", "file/folder", "Status"
- These resolver provide drop down list for user to select
2. Added NameConvertor to convert user's input to corresponding id and saved it in policy
- volume value will be used to call MapR's REST API to get volume id
- status code will be resolved to status id
- file/folder name will be passed to MapR's command line class to get its id.
3. Modified controller.js
- As soon as user input a value for "volume", "file", "status", it will fetch user's input and call rest service to get corresponding id
- Save ids as a new match criteria in the policy
4. Added maprfs resource resolver to provide drop down list for user
5. Added license for "/eagle-app-example/src/main/java/org/apache/eagle/app/example/ExampleStormConfig.java" to pass rat check.
PS:how the id converter works: user select "== '/test'" in field "dst", a new match criteria "== 234.567.890" will appear automatically under it, and the policy will end up as:
dst == 'test' or dst == '234.567.890'
Same thing will happen for volume and status input.
In this way, the policy is human readable and can be used to match the ids in maprfsAuditLog.
===============================================================
6. refactored "main" to unit test
7. Removed explicit version of httpclient and define it in dependency-management
8. use hbase as default database
commit aee19a6dce52a99eba81a7c89520836299eb79b5
Author: Daniel <da...@apache.org>
Date: 2016-08-05T19:13:04Z
Merge pull request #17 from DadanielZ/EAGLE-283
EAGLE-283: Convert fid,uid in MapR's audit log to FIle/folder name, u\u2026
commit 0896dba26c94c035ad2e01b6bd2822d311e47a2a
Author: Daniel <da...@dataguise.com>
Date: 2016-08-05T20:40:41Z
Update from Apache-Eagle
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-eagle issue #307: EAGLE-283: Convert fid,uid in MapR's audit log t...
Posted by haoch <gi...@git.apache.org>.
Github user haoch commented on the issue:
https://github.com/apache/incubator-eagle/pull/307
The branch has conflicts, could @DadanielZ fix them by your side firstly?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-eagle issue #307: EAGLE-283: Convert fid,uid in MapR's audit log t...
Posted by yonzhang <gi...@git.apache.org>.
Github user yonzhang commented on the issue:
https://github.com/apache/incubator-eagle/pull/307
LM-SJN-00876985:incubator-eagle yonzhang$ git apply 307.patch
307.patch:59: trailing whitespace.
/*
307.patch:60: trailing whitespace.
* Licensed to the Apache Software Foundation (ASF) under one or more
307.patch:61: trailing whitespace.
* contributor license agreements. See the NOTICE file distributed with
307.patch:62: trailing whitespace.
* this work for additional information regarding copyright ownership.
307.patch:63: trailing whitespace.
* The ASF licenses this file to You under the Apache License, Version 2.0
error: patch failed: eagle-examples/eagle-app-example/src/main/java/org/apache/eagle/app/example/ExampleStormConfig.java:1
error: eagle-examples/eagle-app-example/src/main/java/org/apache/eagle/app/example/ExampleStormConfig.java: patch does not apply
error: .travis.yml: already exists in working directory
error: patch failed: eagle-core/eagle-alert-parent/eagle-alert-process/src/test/java/org/apache/eagle/alert/cep/TestSiddhiEvaluator.java:34
error: eagle-core/eagle-alert-parent/eagle-alert-process/src/test/java/org/apache/eagle/alert/cep/TestSiddhiEvaluator.java: patch does not apply
error: patch failed: eagle-core/eagle-alert-parent/eagle-alert-process/src/test/java/org/apache/eagle/alert/siddhi/TestExternalBatchWindow.java:41
error: eagle-core/eagle-alert-parent/eagle-alert-process/src/test/java/org/apache/eagle/alert/siddhi/TestExternalBatchWindow.java: patch does not apply
error: patch failed: eagle-core/eagle-alert-parent/eagle-alert/alert-engine/src/main/resources/eagle.siddhiext:15
error: eagle-core/eagle-alert-parent/eagle-alert/alert-engine/src/main/resources/eagle.siddhiext: patch does not apply
error: patch failed: eagle-core/eagle-alert-parent/eagle-alert/alert-engine/src/test/java/org/apache/eagle/alert/engine/sorter/StreamWindowBenchmarkTest.java:31
error: eagle-core/eagle-alert-parent/eagle-alert/alert-engine/src/test/java/org/apache/eagle/alert/engine/sorter/StreamWindowBenchmarkTest.java: patch does not apply
error: patch failed: eagle-core/eagle-app/eagle-app-base/src/main/java/org/apache/eagle/app/environment/impl/StormExecutionRuntime.java:40
error: eagle-core/eagle-app/eagle-app-base/src/main/java/org/apache/eagle/app/environment/impl/StormExecutionRuntime.java: patch does not apply
error: patch failed: eagle-core/eagle-app/eagle-app-base/src/main/java/org/apache/eagle/app/service/impl/ApplicationProviderSPILoader.java:67
error: eagle-core/eagle-app/eagle-app-base/src/main/java/org/apache/eagle/app/service/impl/ApplicationProviderSPILoader.java: patch does not apply
error: patch failed: eagle-core/eagle-app/eagle-app-base/src/test/java/org/apache/eagle/app/TestStormApplication.java:25
error: eagle-core/eagle-app/eagle-app-base/src/test/java/org/apache/eagle/app/TestStormApplication.java: patch does not apply
error: patch failed: eagle-core/eagle-app/eagle-app-base/src/test/java/org/apache/eagle/app/storm/MockStormApplicationTest.java:52
error: eagle-core/eagle-app/eagle-app-base/src/test/java/org/apache/eagle/app/storm/MockStormApplicationTest.java: patch does not apply
error: patch failed: eagle-core/eagle-app/eagle-app-base/src/test/resources/application.conf:53
error: eagle-core/eagle-app/eagle-app-base/src/test/resources/application.conf: patch does not apply
error: patch failed: eagle-core/eagle-common/pom.xml:32
error: eagle-core/eagle-common/pom.xml: patch does not apply
error: eagle-core/eagle-common/src/main/java/org/apache/eagle/common/agg/Agg.java: already exists in working directory
error: eagle-core/eagle-common/src/main/java/org/apache/eagle/common/agg/AggregateHandler.java: already exists in working directory
error: eagle-core/eagle-common/src/main/java/org/apache/eagle/common/agg/AggregateResult.java: already exists in working directory
error: eagle-core/eagle-common/src/main/java/org/apache/eagle/common/agg/Column.java: already exists in working directory
error: eagle-core/eagle-common/src/main/java/org/apache/eagle/common/agg/Groupby.java: already exists in working directory
error: eagle-core/eagle-common/src/main/java/org/apache/eagle/common/agg/SiddhiAggregator.java: already exists in working directory
error: eagle-core/eagle-common/src/main/java/org/apache/eagle/common/agg/StreamAggregator.java: already exists in working directory
error: eagle-core/eagle-common/src/main/java/org/apache/eagle/common/agg/StreamDefinition.java: already exists in working directory
error: eagle-core/eagle-common/src/main/java/org/apache/eagle/common/agg/TimeBatchAggSpec.java: already exists in working directory
error: eagle-core/eagle-common/src/main/java/org/apache/eagle/common/agg/TimeBatchWindowSpec.java: already exists in working directory
error: eagle-core/eagle-common/src/test/java/org/apache/eagle/common/TestSiddhiAggregator.java: already exists in working directory
error: eagle-core/eagle-common/src/test/java/org/apache/eagle/common/agg/TestSiddhiAggregator.java: already exists in working directory
error: eagle-core/eagle-common/src/test/java/org/apache/eagle/common/agg/TestSiddhiExternalTimeBatch.java: already exists in working directory
error: eagle-core/eagle-common/src/test/java/org/apache/eagle/common/agg/TestStreamAggregator.java: already exists in working directory
error: eagle-core/eagle-policy/eagle-policy-base/src/main/java/org/apache/eagle/policy/siddhi/extension/ExternalTimeBatchWindowProcessor.java: No such file or directory
error: patch failed: eagle-core/eagle-policy/eagle-policy-base/src/main/resources/eagle.siddhiext:14
error: eagle-core/eagle-policy/eagle-policy-base/src/main/resources/eagle.siddhiext: patch does not apply
error: patch failed: eagle-core/eagle-query/eagle-storage-hbase/src/test/java/org/apache/eagle/storage/hbase/spi/TestHBaseStorageLoader.java:20
error: eagle-core/eagle-query/eagle-storage-hbase/src/test/java/org/apache/eagle/storage/hbase/spi/TestHBaseStorageLoader.java: patch does not apply
error: patch failed: eagle-core/eagle-query/eagle-storage-jdbc/src/test/java/org/apache/eagle/storage/jdbc/TestJdbcStorage.java:27
error: eagle-core/eagle-query/eagle-storage-jdbc/src/test/java/org/apache/eagle/storage/jdbc/TestJdbcStorage.java: patch does not apply
error: patch failed: eagle-examples/eagle-app-example/src/main/java/org/apache/eagle/app/example/ExampleStormApplication.java:23
error: eagle-examples/eagle-app-example/src/main/java/org/apache/eagle/app/example/ExampleStormApplication.java: patch does not apply
error: patch failed: eagle-examples/eagle-app-example/src/main/java/org/apache/eagle/app/example/ExampleStormConfig.java:1
error: eagle-examples/eagle-app-example/src/main/java/org/apache/eagle/app/example/ExampleStormConfig.java: patch does not apply
error: patch failed: eagle-hadoop-metric/src/test/java/org/apache/eagle/hadoop/metric/TestHadoopMetricSiddhiQL.java:117
error: eagle-hadoop-metric/src/test/java/org/apache/eagle/hadoop/metric/TestHadoopMetricSiddhiQL.java: patch does not apply
error: patch failed: eagle-security/eagle-security-hbase-auditlog/pom.xml:39
error: eagle-security/eagle-security-hbase-auditlog/pom.xml: patch does not apply
error: eagle-security/eagle-security-hbase-auditlog/src/main/java/org/apache/eagle/security/hbase/HBaseAuditLogApplication.java: already exists in working directory
error: patch failed: eagle-server/pom.xml:146
error: eagle-server/pom.xml: patch does not apply
error: patch failed: pom.xml:274
error: pom.xml: patch does not apply
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-eagle issue #307: EAGLE-283: Convert fid,uid in MapR's audit log t...
Posted by DadanielZ <gi...@git.apache.org>.
Github user DadanielZ commented on the issue:
https://github.com/apache/incubator-eagle/pull/307
@yonzhang to make it clean, I will close this pr and create a new one.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-eagle pull request #307: EAGLE-283: Convert fid,uid in MapR's audi...
Posted by DadanielZ <gi...@git.apache.org>.
Github user DadanielZ closed the pull request at:
https://github.com/apache/incubator-eagle/pull/307
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-eagle issue #307: EAGLE-283: Convert fid,uid in MapR's audit log t...
Posted by yonzhang <gi...@git.apache.org>.
Github user yonzhang commented on the issue:
https://github.com/apache/incubator-eagle/pull/307
PR apply will fail if this PR includes some new files which are already there.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---