You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@metron.apache.org by ni...@apache.org on 2019/04/17 15:32:55 UTC
[metron] branch master updated: METRON-2082 Update the README
document steps to run Batch Profiler (MohanDV via nickwallen) closes
apache/metron#1387
This is an automated email from the ASF dual-hosted git repository.
nickallen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/metron.git
The following commit(s) were added to refs/heads/master by this push:
new c58062a METRON-2082 Update the README document steps to run Batch Profiler (MohanDV via nickwallen) closes apache/metron#1387
c58062a is described below
commit c58062a263927a4c41edd0315d58077e0a91446a
Author: MohanDV <mo...@gmail.com>
AuthorDate: Wed Apr 17 11:32:27 2019 -0400
METRON-2082 Update the README document steps to run Batch Profiler (MohanDV via nickwallen) closes apache/metron#1387
---
metron-analytics/metron-profiler-spark/README.md | 6 ++++++
1 file changed, 6 insertions(+)
diff --git a/metron-analytics/metron-profiler-spark/README.md b/metron-analytics/metron-profiler-spark/README.md
index 5ed5f4b..5ee8510 100644
--- a/metron-analytics/metron-profiler-spark/README.md
+++ b/metron-analytics/metron-profiler-spark/README.md
@@ -67,6 +67,12 @@ For an introduction to the Profiler, see the [Profiler README](../metron-profile
hdfs dfs -cat /apps/metron/indexing/indexed/*/* | wc -l
```
+1. Copy the `hbase-site.xml` file from `/etc/hbase/conf` to `/etc/spark2/conf`. It is advised to create a symlink to avoid the duplication of file, also to keep consistency between files while config updates.
+
+ ```
+ ln -s /etc/hbase/conf/hbase-site.xml /etc/spark2/conf/hbase-site.xml
+ ```
+
1. Review the Batch Profiler's properties located at `$METRON_HOME/config/batch-profiler.properties`. See [Configuring the Profiler](#configuring-the-profiler) for more information on these properties.
1. You may want to edit the log4j properties that sits in your config directory in `${SPARK_HOME}` or create one. It may be helpful to turn on `DEBUG` logging for the Profiler by adding the following line.