You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2019/05/24 00:34:25 UTC

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #691: Allow users to set hoodie configs figs for Compactor, Cleaner and HDFSParquetImporter utility scripts

n3nash commented on a change in pull request #691: Allow users to set hoodie configs figs for Compactor, Cleaner and HDFSParquetImporter utility scripts
URL: https://github.com/apache/incubator-hudi/pull/691#discussion_r287180315
 
 

 ##########
 File path: hoodie-utilities/src/main/java/com/uber/hoodie/utilities/HDFSParquetImporter.java
 ##########
 @@ -57,14 +59,22 @@
  * Loads data from Parquet Sources
  */
 public class HDFSParquetImporter implements Serializable {
+  private static volatile Logger log = LogManager.getLogger(HDFSParquetImporter.class);
 
   public static final SimpleDateFormat PARTITION_FORMATTER = new SimpleDateFormat("yyyy/MM/dd");
   private static volatile Logger logger = LogManager.getLogger(HDFSParquetImporter.class);
   private final Config cfg;
   private transient FileSystem fs;
+  /**
+   * Bag of properties with source, hoodie client, key generator etc.
+   */
+  private TypedProperties props;
 
   public HDFSParquetImporter(Config cfg) throws IOException {
     this.cfg = cfg;
+    this.props = cfg.propsFilePath == null ? UtilHelpers.buildProperties(cfg.configs) :
 
 Review comment:
   what is cfg.configs ?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services