You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/08/05 19:02:38 UTC
[GitHub] [hudi] zhedoubushishi opened a new pull request #3416: Add external config files support
zhedoubushishi opened a new pull request #3416:
URL: https://github.com/apache/hudi/pull/3416
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a pull request.*
## What is the purpose of the pull request
*(For example: This pull request adds quick-start document.)*
## Brief change log
*(for example:)*
- *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
## Verify this pull request
*(Please pick either of the following options)*
This pull request is a trivial rework / code cleanup without any test coverage.
*(or)*
This pull request is already covered by existing tests, such as *(please describe tests)*.
(or)
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [x] Has a corresponding JIRA in PR title & commit
- [x] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b1c19180582fa6f0139b1a897aba36834a5b408f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515)
* ca2568692241b16928162899d91241a43de870a9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
xushiyan commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r724653630
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -43,70 +45,88 @@
private static final Logger LOG = LogManager.getLogger(DFSPropertiesConfiguration.class);
+ private static final String DEFAULT_PROPERTIES_FILE = "hudi-defaults.conf";
+
+ public static final String CONF_FILE_DIR_ENV_NAME = "HUDI_CONF_DIR";
+
+ // props read from hudi-defaults.conf
+ private static final TypedProperties HUDI_CONF_PROPS = loadGlobalProps();
+
private final FileSystem fs;
- private final Path rootFile;
+ private Path currentFilePath;
+ // props read from user defined configuration file or input stream
private final TypedProperties props;
// Keep track of files visited, to detect loops
- private final Set<String> visitedFiles;
+ private final Set<String> visitedFilePaths;
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile, TypedProperties defaults) {
+ public DFSPropertiesConfiguration(FileSystem fs, Path filePath) {
this.fs = fs;
- this.rootFile = rootFile;
- this.props = defaults;
- this.visitedFiles = new HashSet<>();
- visitFile(rootFile);
- }
-
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile) {
- this(fs, rootFile, new TypedProperties());
+ this.currentFilePath = filePath;
+ this.props = new TypedProperties();
+ this.visitedFilePaths = new HashSet<>();
+ addPropsFromFile(filePath);
}
public DFSPropertiesConfiguration() {
this.fs = null;
- this.rootFile = null;
+ this.currentFilePath = null;
this.props = new TypedProperties();
- this.visitedFiles = new HashSet<>();
+ this.visitedFilePaths = new HashSet<>();
}
- private String[] splitProperty(String line) {
- int ind = line.indexOf('=');
- String k = line.substring(0, ind).trim();
- String v = line.substring(ind + 1).trim();
- return new String[] {k, v};
+ /**
+ * Load global props from hudi-defaults.conf which is under CONF_FILE_DIR_ENV_NAME.
+ * @return Typed Properties
+ */
+ public static TypedProperties loadGlobalProps() {
+ DFSPropertiesConfiguration conf = new DFSPropertiesConfiguration();
+ Path defaultConfPath = getDefaultConfPath();
+ if (defaultConfPath != null) {
+ conf.addPropsFromFile(defaultConfPath);
+ }
+ return conf.getConfig();
}
- private void visitFile(Path file) {
+ /**
+ * Add properties from external configuration files.
+ *
+ * @param filePath File path for configuration file
+ */
+ public void addPropsFromFile(Path filePath) {
try {
- if (visitedFiles.contains(file.getName())) {
- throw new IllegalStateException("Loop detected; file " + file + " already referenced");
+ if (visitedFilePaths.contains(filePath.toString())) {
+ throw new IllegalStateException("Loop detected; file " + filePath + " already referenced");
}
- visitedFiles.add(file.getName());
- BufferedReader reader = new BufferedReader(new InputStreamReader(fs.open(file)));
- addProperties(reader);
+ visitedFilePaths.add(filePath.toString());
+ currentFilePath = filePath;
+ FileSystem fileSystem = fs != null ? fs : filePath.getFileSystem(new Configuration());
+ BufferedReader reader = new BufferedReader(new InputStreamReader(fileSystem.open(filePath)));
Review comment:
use try with resources to close?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +137,49 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
+ public static TypedProperties getGlobalConfig() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(HUDI_CONF_PROPS);
+ return globalProps;
+ }
+
public TypedProperties getConfig() {
- return props;
+ return getConfig(false);
+ }
+
+ public TypedProperties getConfig(Boolean includeHudiConf) {
+ if (includeHudiConf) {
+ TypedProperties mergedProps = new TypedProperties();
+ mergedProps.putAll(HUDI_CONF_PROPS);
+ mergedProps.putAll(props);
+ return mergedProps;
+ } else {
+ return props;
+ }
+ }
+
+ private static Path getDefaultConfPath() {
+ String confDir = System.getenv(CONF_FILE_DIR_ENV_NAME);
+ if (confDir == null) {
+ LOG.warn("Cannot find " + CONF_FILE_DIR_ENV_NAME + ", please set it as the dir of " + DEFAULT_PROPERTIES_FILE);
+ return null;
+ }
+ return new Path("file://" + confDir + File.separator + DEFAULT_PROPERTIES_FILE);
+ }
+
+ private String[] splitProperty(String line) {
+ line = line.replaceAll("\\s+"," ");
+ String delimiter = line.contains("=") ? "=" : " ";
+ int ind = line.indexOf(delimiter);
+ String k = line.substring(0, ind).trim();
+ String v = line.substring(ind + 1).trim();
+ return new String[] {k, v};
+ }
+
+ private boolean isValidLine(String line) {
+ if (line.startsWith("#") || line.equals("")) {
Review comment:
use ValidationUtils.checkArugment to check `line` to be non-null?
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/CreateHoodieTableCommand.scala
##########
@@ -94,7 +94,7 @@ case class CreateHoodieTableCommand(table: CatalogTable, ignoreIfExists: Boolean
// Get options from the external table and append with the options in ddl.
val originTableConfig = HoodieOptionConfig.mappingTableConfigToSqlOption(
- metaClient.getTableConfig.getProps.asScala.toMap)
+ metaClient.getTableConfig.getProps().asScala.toMap)
Review comment:
did you meant to pass `true`?
##########
File path: hudi-flink/src/main/java/org/apache/hudi/util/StreamerUtil.java
##########
@@ -123,18 +123,11 @@ public static Schema getSourceSchema(org.apache.flink.configuration.Configuratio
* Read config from properties file (`--props` option) and cmd line (`--hoodie-conf` option).
*/
public static DFSPropertiesConfiguration readConfig(FileSystem fs, Path cfgPath, List<String> overriddenProps) {
- DFSPropertiesConfiguration conf;
- try {
- conf = new DFSPropertiesConfiguration(cfgPath.getFileSystem(fs.getConf()), cfgPath);
- } catch (Exception e) {
- conf = new DFSPropertiesConfiguration();
- LOG.warn("Unexpected error read props file at :" + cfgPath, e);
- }
-
+ DFSPropertiesConfiguration conf = new DFSPropertiesConfiguration(fs, cfgPath);
try {
if (!overriddenProps.isEmpty()) {
LOG.info("Adding overridden properties to file properties.");
- conf.addProperties(new BufferedReader(new StringReader(String.join("\n", overriddenProps))));
+ conf.addPropsFromInputStream(new BufferedReader(new StringReader(String.join("\n", overriddenProps))));
Review comment:
same here better pass an InputStream to align with the method name.
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/HoodieConfig.java
##########
@@ -163,7 +167,17 @@ public String getString(String key) {
}
public Properties getProps() {
- return props;
+ return getProps(false);
+ }
+
+ public Properties getProps(Boolean includeHudiConf) {
Review comment:
also unboxed boolean?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -43,70 +45,88 @@
private static final Logger LOG = LogManager.getLogger(DFSPropertiesConfiguration.class);
+ private static final String DEFAULT_PROPERTIES_FILE = "hudi-defaults.conf";
+
+ public static final String CONF_FILE_DIR_ENV_NAME = "HUDI_CONF_DIR";
+
+ // props read from hudi-defaults.conf
+ private static final TypedProperties HUDI_CONF_PROPS = loadGlobalProps();
+
private final FileSystem fs;
- private final Path rootFile;
+ private Path currentFilePath;
+ // props read from user defined configuration file or input stream
private final TypedProperties props;
// Keep track of files visited, to detect loops
- private final Set<String> visitedFiles;
+ private final Set<String> visitedFilePaths;
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile, TypedProperties defaults) {
+ public DFSPropertiesConfiguration(FileSystem fs, Path filePath) {
this.fs = fs;
- this.rootFile = rootFile;
- this.props = defaults;
- this.visitedFiles = new HashSet<>();
- visitFile(rootFile);
- }
-
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile) {
- this(fs, rootFile, new TypedProperties());
+ this.currentFilePath = filePath;
+ this.props = new TypedProperties();
+ this.visitedFilePaths = new HashSet<>();
+ addPropsFromFile(filePath);
}
public DFSPropertiesConfiguration() {
this.fs = null;
- this.rootFile = null;
+ this.currentFilePath = null;
this.props = new TypedProperties();
- this.visitedFiles = new HashSet<>();
+ this.visitedFilePaths = new HashSet<>();
}
- private String[] splitProperty(String line) {
- int ind = line.indexOf('=');
- String k = line.substring(0, ind).trim();
- String v = line.substring(ind + 1).trim();
- return new String[] {k, v};
+ /**
+ * Load global props from hudi-defaults.conf which is under CONF_FILE_DIR_ENV_NAME.
+ * @return Typed Properties
+ */
+ public static TypedProperties loadGlobalProps() {
+ DFSPropertiesConfiguration conf = new DFSPropertiesConfiguration();
+ Path defaultConfPath = getDefaultConfPath();
+ if (defaultConfPath != null) {
+ conf.addPropsFromFile(defaultConfPath);
+ }
+ return conf.getConfig();
}
- private void visitFile(Path file) {
+ /**
+ * Add properties from external configuration files.
+ *
+ * @param filePath File path for configuration file
+ */
+ public void addPropsFromFile(Path filePath) {
try {
- if (visitedFiles.contains(file.getName())) {
- throw new IllegalStateException("Loop detected; file " + file + " already referenced");
+ if (visitedFilePaths.contains(filePath.toString())) {
+ throw new IllegalStateException("Loop detected; file " + filePath + " already referenced");
}
- visitedFiles.add(file.getName());
- BufferedReader reader = new BufferedReader(new InputStreamReader(fs.open(file)));
- addProperties(reader);
+ visitedFilePaths.add(filePath.toString());
+ currentFilePath = filePath;
+ FileSystem fileSystem = fs != null ? fs : filePath.getFileSystem(new Configuration());
+ BufferedReader reader = new BufferedReader(new InputStreamReader(fileSystem.open(filePath)));
+ addPropsFromInputStream(reader);
} catch (IOException ioe) {
- LOG.error("Error reading in properies from dfs", ioe);
+ LOG.error("Error reading in properties from dfs", ioe);
throw new IllegalArgumentException("Cannot read properties from dfs", ioe);
}
}
/**
* Add properties from input stream.
- *
+ *
* @param reader Buffered Reader
* @throws IOException
*/
- public void addProperties(BufferedReader reader) throws IOException {
+ public void addPropsFromInputStream(BufferedReader reader) throws IOException {
Review comment:
"FromInputStream" can be confusing as the argument is a `BufferedReader`. To use that name, you may pass a InputStream here and create and close the reader inside.
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +137,49 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
+ public static TypedProperties getGlobalConfig() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(HUDI_CONF_PROPS);
+ return globalProps;
+ }
+
public TypedProperties getConfig() {
- return props;
+ return getConfig(false);
+ }
+
+ public TypedProperties getConfig(Boolean includeHudiConf) {
Review comment:
use primitive boolean instead of boxed?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r747865933
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +142,50 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
- public TypedProperties getConfig() {
- return props;
+ public static TypedProperties getGlobalProps() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(HUDI_CONF_PROPS);
+ return globalProps;
+ }
+
+ public TypedProperties getProps() {
+ return getProps(false);
+ }
+
+ public TypedProperties getProps(boolean includeHudiConf) {
+ if (includeHudiConf) {
+ TypedProperties mergedProps = new TypedProperties();
+ mergedProps.putAll(HUDI_CONF_PROPS);
+ mergedProps.putAll(props);
+ return mergedProps;
+ } else {
+ return props;
+ }
+ }
+
+ private static Path getDefaultConfPath() {
Review comment:
Changed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969014563
I will fix the first case: w/o setting HUDI_CONF_DIR, having issues as reported above. Needs fixing.
For the second case, I think it's an expected behavior. If customer sets a path for an external configuration file, and Hudi fails to load that file, then Hudi should throw the exception so that customers know that their configuration is not be loaded. Otherwise, customers may not even know their configurations are not loaded and get a Hudi table with wrong configs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 577c3ab184befb6173cf3bd3212ef2407cabb94f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-958627856
@xushiyan : since you have already reviewed this, I will let you drive this home.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-934016721
Can you please update the description of the patch as well.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4949d3827d33e725b2bbba13b9ce15df160d56ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521)
* 5f1b6ee1f819a5fa8398417877003ac7c477ca37 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-935558416
Updated the description and resolved the conflicts. @xushiyan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6f020aaf3fb97698240fd5bc82a869f678dc37c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: Add external config files support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f0d24f8b17a793c0fc925b75336d17b653102d61 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969118756
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ac0b1acace22b81fa2655f851adeacc4de5733f3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r751643606
##########
File path: hudi-common/src/test/java/org/apache/hudi/common/util/TestDFSPropertiesConfiguration.java
##########
@@ -70,10 +77,14 @@ public static void initClass() throws Exception {
filePath = new Path(dfsBasePath + "/t4.props");
writePropertiesFile(filePath, new String[] {"double.prop=838.3", "include = t4.props"});
+
+ // set HUDI_CONF_DIR
+ String testPropsFilePath = new File("src/test/resources").getAbsolutePath();
Review comment:
Good point. Added
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-972586010
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
}, {
"hash" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445",
"triggerID" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"triggerType" : "PUSH"
}, {
"hash" : "eb3383de0645ad08dcd959924b9f3fc6588823b1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "eb3383de0645ad08dcd959924b9f3fc6588823b1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445)
* eb3383de0645ad08dcd959924b9f3fc6588823b1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-972305777
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
}, {
"hash" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445",
"triggerID" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-958627856
@xushiyan : since you have already reviewed this, I will let you drive this home.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-963356328
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 570cbac2ed38f2974d1787abc52078a919c6019a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193)
* 9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-963671813
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221)
* 8bc1401bc9ac749b96e900d1763e0a782366f587 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-962692503
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 577c3ab184befb6173cf3bd3212ef2407cabb94f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123)
* 570cbac2ed38f2974d1787abc52078a919c6019a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-962692879
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 577c3ab184befb6173cf3bd3212ef2407cabb94f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123)
* 570cbac2ed38f2974d1787abc52078a919c6019a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
danny0405 commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-962953749
I guess a more general solution for common options from the SQL world is a `Catalog` abstraction, and Hudi should have that as a catalog is basic for data integration. Of course, for non-sql cases, we can use such a config file.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5f1b6ee1f819a5fa8398417877003ac7c477ca37 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524)
* 577c3ab184befb6173cf3bd3212ef2407cabb94f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r742508801
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/CreateHoodieTableCommand.scala
##########
@@ -94,7 +94,7 @@ case class CreateHoodieTableCommand(table: CatalogTable, ignoreIfExists: Boolean
// Get options from the external table and append with the options in ddl.
val originTableConfig = HoodieOptionConfig.mappingTableConfigToSqlOption(
- metaClient.getTableConfig.getProps.asScala.toMap)
+ metaClient.getTableConfig.getProps().asScala.toMap)
Review comment:
After rethinking about this part, I feel like we should honor the configurations load from the external table, so I didn't import the Hudi external configuration here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-966854556
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8bc1401bc9ac749b96e900d1763e0a782366f587 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230)
* 132a035986b5f38b903890f13b98f291fef6a38d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5f1b6ee1f819a5fa8398417877003ac7c477ca37 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 522c1e5aedb862f936756a10509f2f0ff91ad8a8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197)
* 2dd5fe4788faf920e276c5ecd755bf5950d55a20 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969031063
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7096b7d991681a65f4597e5ca77ca26bc2be4a48 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338)
* ac0b1acace22b81fa2655f851adeacc4de5733f3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969444267
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f6e072b53f37544aef6194bfde7868162da1ac39 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396)
* c3c27d6062111b539575c342b4ea1d5e3057bd7c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-972197041
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
}, {
"hash" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4e63344aa217d0800a7545a5d71db9c2565b182e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413)
* 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
xushiyan commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r742544034
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +137,50 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
+ public static TypedProperties getGlobalConfig() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(HUDI_CONF_PROPS);
+ return globalProps;
+ }
+
public TypedProperties getConfig() {
- return props;
+ return getConfig(false);
+ }
+
+ public TypedProperties getConfig(boolean includeHudiConf) {
Review comment:
ditto
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +137,50 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
+ public static TypedProperties getGlobalConfig() {
Review comment:
```suggestion
public static TypedProperties getGlobalProps() {
```
minor: "config" a bit vague. "Props" strongly hints it's a Properties
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r742507740
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -43,70 +45,88 @@
private static final Logger LOG = LogManager.getLogger(DFSPropertiesConfiguration.class);
+ private static final String DEFAULT_PROPERTIES_FILE = "hudi-defaults.conf";
+
+ public static final String CONF_FILE_DIR_ENV_NAME = "HUDI_CONF_DIR";
+
+ // props read from hudi-defaults.conf
+ private static final TypedProperties HUDI_CONF_PROPS = loadGlobalProps();
+
private final FileSystem fs;
- private final Path rootFile;
+ private Path currentFilePath;
+ // props read from user defined configuration file or input stream
private final TypedProperties props;
// Keep track of files visited, to detect loops
- private final Set<String> visitedFiles;
+ private final Set<String> visitedFilePaths;
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile, TypedProperties defaults) {
+ public DFSPropertiesConfiguration(FileSystem fs, Path filePath) {
this.fs = fs;
- this.rootFile = rootFile;
- this.props = defaults;
- this.visitedFiles = new HashSet<>();
- visitFile(rootFile);
- }
-
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile) {
- this(fs, rootFile, new TypedProperties());
+ this.currentFilePath = filePath;
+ this.props = new TypedProperties();
+ this.visitedFilePaths = new HashSet<>();
+ addPropsFromFile(filePath);
}
public DFSPropertiesConfiguration() {
this.fs = null;
- this.rootFile = null;
+ this.currentFilePath = null;
this.props = new TypedProperties();
- this.visitedFiles = new HashSet<>();
+ this.visitedFilePaths = new HashSet<>();
}
- private String[] splitProperty(String line) {
- int ind = line.indexOf('=');
- String k = line.substring(0, ind).trim();
- String v = line.substring(ind + 1).trim();
- return new String[] {k, v};
+ /**
+ * Load global props from hudi-defaults.conf which is under CONF_FILE_DIR_ENV_NAME.
+ * @return Typed Properties
+ */
+ public static TypedProperties loadGlobalProps() {
+ DFSPropertiesConfiguration conf = new DFSPropertiesConfiguration();
+ Path defaultConfPath = getDefaultConfPath();
+ if (defaultConfPath != null) {
+ conf.addPropsFromFile(defaultConfPath);
+ }
+ return conf.getConfig();
}
- private void visitFile(Path file) {
+ /**
+ * Add properties from external configuration files.
+ *
+ * @param filePath File path for configuration file
+ */
+ public void addPropsFromFile(Path filePath) {
try {
- if (visitedFiles.contains(file.getName())) {
- throw new IllegalStateException("Loop detected; file " + file + " already referenced");
+ if (visitedFilePaths.contains(filePath.toString())) {
+ throw new IllegalStateException("Loop detected; file " + filePath + " already referenced");
}
- visitedFiles.add(file.getName());
- BufferedReader reader = new BufferedReader(new InputStreamReader(fs.open(file)));
- addProperties(reader);
+ visitedFilePaths.add(filePath.toString());
+ currentFilePath = filePath;
+ FileSystem fileSystem = fs != null ? fs : filePath.getFileSystem(new Configuration());
+ BufferedReader reader = new BufferedReader(new InputStreamReader(fileSystem.open(filePath)));
+ addPropsFromInputStream(reader);
} catch (IOException ioe) {
- LOG.error("Error reading in properies from dfs", ioe);
+ LOG.error("Error reading in properties from dfs", ioe);
throw new IllegalArgumentException("Cannot read properties from dfs", ioe);
}
}
/**
* Add properties from input stream.
- *
+ *
* @param reader Buffered Reader
* @throws IOException
*/
- public void addProperties(BufferedReader reader) throws IOException {
+ public void addPropsFromInputStream(BufferedReader reader) throws IOException {
Review comment:
Good catch. For some places, there's only reader been passed: https://github.com/apache/hudi/blob/master/hudi-utilities/src/main/java/org/apache/hudi/utilities/UtilHelpers.java#L189. So to make it clear, I changed the method name to addPropsFromBufferedReader
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-961588087
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 577c3ab184befb6173cf3bd3212ef2407cabb94f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
xushiyan commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-962812139
@zhedoubushishi the failed tests are from "UT other modules" `mvn -Punit-tests -pl !hudi-common,!hudi-flink,!hudi-client/hudi-spark-client,!hudi-cli,!hudi-utilities,!hudi-sync/hudi-hive-sync test` Can you check the CI report pls?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-963670169
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221)
* 8bc1401bc9ac749b96e900d1763e0a782366f587 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r747979603
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -43,70 +46,92 @@
private static final Logger LOG = LogManager.getLogger(DFSPropertiesConfiguration.class);
+ private static final String DEFAULT_PROPERTIES_FILE = "hudi-defaults.conf";
+
+ public static final String CONF_FILE_DIR_ENV_NAME = "HUDI_CONF_DIR";
+
+ // props read from hudi-defaults.conf
+ private static final TypedProperties HUDI_CONF_PROPS = loadGlobalProps();
+
private final FileSystem fs;
- private final Path rootFile;
+ private Path currentFilePath;
+ // props read from user defined configuration file or input stream
private final TypedProperties props;
// Keep track of files visited, to detect loops
- private final Set<String> visitedFiles;
+ private final Set<String> visitedFilePaths;
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile, TypedProperties defaults) {
+ public DFSPropertiesConfiguration(FileSystem fs, Path filePath) {
this.fs = fs;
- this.rootFile = rootFile;
- this.props = defaults;
- this.visitedFiles = new HashSet<>();
- visitFile(rootFile);
- }
-
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile) {
- this(fs, rootFile, new TypedProperties());
+ this.currentFilePath = filePath;
+ this.props = new TypedProperties();
+ this.visitedFilePaths = new HashSet<>();
+ addPropsFromFile(filePath);
}
public DFSPropertiesConfiguration() {
this.fs = null;
- this.rootFile = null;
+ this.currentFilePath = null;
this.props = new TypedProperties();
- this.visitedFiles = new HashSet<>();
+ this.visitedFilePaths = new HashSet<>();
}
- private String[] splitProperty(String line) {
- int ind = line.indexOf('=');
- String k = line.substring(0, ind).trim();
- String v = line.substring(ind + 1).trim();
- return new String[] {k, v};
+ /**
+ * Load global props from hudi-defaults.conf which is under CONF_FILE_DIR_ENV_NAME.
+ * @return Typed Properties
+ */
+ public static TypedProperties loadGlobalProps() {
+ DFSPropertiesConfiguration conf = new DFSPropertiesConfiguration();
+ Path defaultConfPath = getDefaultConfPath();
+ if (defaultConfPath != null) {
+ conf.addPropsFromFile(defaultConfPath);
+ }
+ return conf.getProps();
}
- private void visitFile(Path file) {
+ /**
+ * Add properties from external configuration files.
+ *
+ * @param filePath File path for configuration file
+ */
+ public void addPropsFromFile(Path filePath) {
+ FileSystem fileSystem;
try {
- if (visitedFiles.contains(file.getName())) {
- throw new IllegalStateException("Loop detected; file " + file + " already referenced");
+ fileSystem = fs != null ? fs : filePath.getFileSystem(new Configuration());
Review comment:
You can still pass a fileSystem with hadoopConfiguration: ```public DFSPropertiesConfiguration(FileSystem fs, Path filePath)```
Using ```new Configuration()``` only happens when there's no fileSystem be passed to the class.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
xushiyan commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-950183027
@zhedoubushishi would you take this forward? it's close to land from what i see now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f0d24f8b17a793c0fc925b75336d17b653102d61 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412)
* 6f020aaf3fb97698240fd5bc82a869f678dc37c9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f0d24f8b17a793c0fc925b75336d17b653102d61 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412)
* 6f020aaf3fb97698240fd5bc82a869f678dc37c9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6f020aaf3fb97698240fd5bc82a869f678dc37c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892)
* 522c1e5aedb862f936756a10509f2f0ff91ad8a8 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2dd5fe4788faf920e276c5ecd755bf5950d55a20 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199)
* b1c19180582fa6f0139b1a897aba36834a5b408f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-963358649
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 570cbac2ed38f2974d1787abc52078a919c6019a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193)
* 9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-962702583
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 570cbac2ed38f2974d1787abc52078a919c6019a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-963402261
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r745743697
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +142,50 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
- public TypedProperties getConfig() {
- return props;
+ public static TypedProperties getGlobalProps() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(HUDI_CONF_PROPS);
+ return globalProps;
+ }
+
+ public TypedProperties getProps() {
+ return getProps(false);
+ }
+
+ public TypedProperties getProps(boolean includeHudiConf) {
+ if (includeHudiConf) {
+ TypedProperties mergedProps = new TypedProperties();
+ mergedProps.putAll(HUDI_CONF_PROPS);
+ mergedProps.putAll(props);
+ return mergedProps;
+ } else {
+ return props;
+ }
+ }
+
+ private static Path getDefaultConfPath() {
+ String confDir = System.getenv(CONF_FILE_DIR_ENV_NAME);
+ if (confDir == null) {
+ LOG.warn("Cannot find " + CONF_FILE_DIR_ENV_NAME + ", please set it as the dir of " + DEFAULT_PROPERTIES_FILE);
+ return null;
+ }
+ return new Path("file://" + confDir + File.separator + DEFAULT_PROPERTIES_FILE);
+ }
+
+ private String[] splitProperty(String line) {
+ line = line.replaceAll("\\s+"," ");
+ String delimiter = line.contains("=") ? "=" : " ";
+ int ind = line.indexOf(delimiter);
+ String k = line.substring(0, ind).trim();
+ String v = line.substring(ind + 1).trim();
+ return new String[] {k, v};
+ }
+
+ private boolean isValidLine(String line) {
Review comment:
add a UT for the regex check?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -43,70 +46,92 @@
private static final Logger LOG = LogManager.getLogger(DFSPropertiesConfiguration.class);
+ private static final String DEFAULT_PROPERTIES_FILE = "hudi-defaults.conf";
+
+ public static final String CONF_FILE_DIR_ENV_NAME = "HUDI_CONF_DIR";
+
+ // props read from hudi-defaults.conf
+ private static final TypedProperties HUDI_CONF_PROPS = loadGlobalProps();
+
private final FileSystem fs;
- private final Path rootFile;
+ private Path currentFilePath;
+ // props read from user defined configuration file or input stream
private final TypedProperties props;
// Keep track of files visited, to detect loops
- private final Set<String> visitedFiles;
+ private final Set<String> visitedFilePaths;
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile, TypedProperties defaults) {
+ public DFSPropertiesConfiguration(FileSystem fs, Path filePath) {
this.fs = fs;
- this.rootFile = rootFile;
- this.props = defaults;
- this.visitedFiles = new HashSet<>();
- visitFile(rootFile);
- }
-
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile) {
- this(fs, rootFile, new TypedProperties());
+ this.currentFilePath = filePath;
+ this.props = new TypedProperties();
+ this.visitedFilePaths = new HashSet<>();
+ addPropsFromFile(filePath);
}
public DFSPropertiesConfiguration() {
this.fs = null;
- this.rootFile = null;
+ this.currentFilePath = null;
this.props = new TypedProperties();
- this.visitedFiles = new HashSet<>();
+ this.visitedFilePaths = new HashSet<>();
}
- private String[] splitProperty(String line) {
- int ind = line.indexOf('=');
- String k = line.substring(0, ind).trim();
- String v = line.substring(ind + 1).trim();
- return new String[] {k, v};
+ /**
+ * Load global props from hudi-defaults.conf which is under CONF_FILE_DIR_ENV_NAME.
+ * @return Typed Properties
+ */
+ public static TypedProperties loadGlobalProps() {
+ DFSPropertiesConfiguration conf = new DFSPropertiesConfiguration();
+ Path defaultConfPath = getDefaultConfPath();
+ if (defaultConfPath != null) {
+ conf.addPropsFromFile(defaultConfPath);
+ }
+ return conf.getProps();
}
- private void visitFile(Path file) {
+ /**
+ * Add properties from external configuration files.
+ *
+ * @param filePath File path for configuration file
+ */
+ public void addPropsFromFile(Path filePath) {
+ FileSystem fileSystem;
try {
- if (visitedFiles.contains(file.getName())) {
- throw new IllegalStateException("Loop detected; file " + file + " already referenced");
+ fileSystem = fs != null ? fs : filePath.getFileSystem(new Configuration());
+ } catch (IOException e) {
+ throw new IllegalArgumentException("Cannot get the file system from file path", e);
+ }
+ try (BufferedReader reader = new BufferedReader(new InputStreamReader(fileSystem.open(filePath)))) {
+ if (visitedFilePaths.contains(filePath.toString())) {
+ throw new IllegalStateException("Loop detected; file " + filePath + " already referenced");
}
- visitedFiles.add(file.getName());
- BufferedReader reader = new BufferedReader(new InputStreamReader(fs.open(file)));
- addProperties(reader);
+ visitedFilePaths.add(filePath.toString());
+ currentFilePath = filePath;
+ addPropsFromBufferedReader(reader);
} catch (IOException ioe) {
- LOG.error("Error reading in properies from dfs", ioe);
+ LOG.error("Error reading in properties from dfs", ioe);
throw new IllegalArgumentException("Cannot read properties from dfs", ioe);
}
}
/**
- * Add properties from input stream.
- *
+ * Add properties from buffered reader.
+ *
* @param reader Buffered Reader
* @throws IOException
*/
- public void addProperties(BufferedReader reader) throws IOException {
+ public void addPropsFromBufferedReader(BufferedReader reader) throws IOException {
Review comment:
i feel name is bit too verbose now. esp the `BufferedReader` part?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +142,50 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
- public TypedProperties getConfig() {
- return props;
+ public static TypedProperties getGlobalProps() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(HUDI_CONF_PROPS);
+ return globalProps;
+ }
+
+ public TypedProperties getProps() {
+ return getProps(false);
+ }
+
+ public TypedProperties getProps(boolean includeHudiConf) {
+ if (includeHudiConf) {
+ TypedProperties mergedProps = new TypedProperties();
+ mergedProps.putAll(HUDI_CONF_PROPS);
+ mergedProps.putAll(props);
+ return mergedProps;
+ } else {
+ return props;
+ }
+ }
+
+ private static Path getDefaultConfPath() {
Review comment:
can we make this return an Option or not a null
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieWriterUtils.scala
##########
@@ -102,4 +104,22 @@ object HoodieWriterUtils {
properties.putAll(mapAsJavaMap(parameters))
new HoodieConfig(properties)
}
+
+ val sparkDatasourceConfigsToTableConfigsMap = Map(
Review comment:
this is nice. thanks for doing this
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +142,50 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
- public TypedProperties getConfig() {
- return props;
+ public static TypedProperties getGlobalProps() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(HUDI_CONF_PROPS);
+ return globalProps;
+ }
+
+ public TypedProperties getProps() {
+ return getProps(false);
+ }
+
+ public TypedProperties getProps(boolean includeHudiConf) {
+ if (includeHudiConf) {
+ TypedProperties mergedProps = new TypedProperties();
+ mergedProps.putAll(HUDI_CONF_PROPS);
+ mergedProps.putAll(props);
+ return mergedProps;
+ } else {
+ return props;
+ }
+ }
+
+ private static Path getDefaultConfPath() {
+ String confDir = System.getenv(CONF_FILE_DIR_ENV_NAME);
+ if (confDir == null) {
Review comment:
can we have a default for the CONF_FILE_DIR as well? /etc/hudi or something? and fail gracefully if there is no conf there there
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -43,70 +46,92 @@
private static final Logger LOG = LogManager.getLogger(DFSPropertiesConfiguration.class);
+ private static final String DEFAULT_PROPERTIES_FILE = "hudi-defaults.conf";
+
+ public static final String CONF_FILE_DIR_ENV_NAME = "HUDI_CONF_DIR";
+
+ // props read from hudi-defaults.conf
+ private static final TypedProperties HUDI_CONF_PROPS = loadGlobalProps();
+
private final FileSystem fs;
- private final Path rootFile;
+ private Path currentFilePath;
+ // props read from user defined configuration file or input stream
private final TypedProperties props;
// Keep track of files visited, to detect loops
- private final Set<String> visitedFiles;
+ private final Set<String> visitedFilePaths;
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile, TypedProperties defaults) {
+ public DFSPropertiesConfiguration(FileSystem fs, Path filePath) {
this.fs = fs;
- this.rootFile = rootFile;
- this.props = defaults;
- this.visitedFiles = new HashSet<>();
- visitFile(rootFile);
- }
-
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile) {
- this(fs, rootFile, new TypedProperties());
+ this.currentFilePath = filePath;
+ this.props = new TypedProperties();
+ this.visitedFilePaths = new HashSet<>();
+ addPropsFromFile(filePath);
}
public DFSPropertiesConfiguration() {
this.fs = null;
- this.rootFile = null;
+ this.currentFilePath = null;
this.props = new TypedProperties();
- this.visitedFiles = new HashSet<>();
+ this.visitedFilePaths = new HashSet<>();
}
- private String[] splitProperty(String line) {
- int ind = line.indexOf('=');
- String k = line.substring(0, ind).trim();
- String v = line.substring(ind + 1).trim();
- return new String[] {k, v};
+ /**
+ * Load global props from hudi-defaults.conf which is under CONF_FILE_DIR_ENV_NAME.
+ * @return Typed Properties
+ */
+ public static TypedProperties loadGlobalProps() {
+ DFSPropertiesConfiguration conf = new DFSPropertiesConfiguration();
+ Path defaultConfPath = getDefaultConfPath();
+ if (defaultConfPath != null) {
+ conf.addPropsFromFile(defaultConfPath);
+ }
+ return conf.getProps();
}
- private void visitFile(Path file) {
+ /**
+ * Add properties from external configuration files.
+ *
+ * @param filePath File path for configuration file
+ */
+ public void addPropsFromFile(Path filePath) {
+ FileSystem fileSystem;
try {
- if (visitedFiles.contains(file.getName())) {
- throw new IllegalStateException("Loop detected; file " + file + " already referenced");
+ fileSystem = fs != null ? fs : filePath.getFileSystem(new Configuration());
Review comment:
this would ignore any configurations passed via the query engine's context? e.g sparkContext.hadoopConfiguration?
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +142,50 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
- public TypedProperties getConfig() {
- return props;
+ public static TypedProperties getGlobalProps() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(HUDI_CONF_PROPS);
+ return globalProps;
+ }
+
+ public TypedProperties getProps() {
+ return getProps(false);
+ }
+
+ public TypedProperties getProps(boolean includeHudiConf) {
+ if (includeHudiConf) {
Review comment:
lets avoid `Hudi` in variable names? its kind of redundant?
##########
File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestHudiConf.scala
##########
@@ -0,0 +1,96 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import org.apache.hadoop.conf.Configuration
+import org.apache.hadoop.fs.Path
+import org.apache.hudi.common.config.DFSPropertiesConfiguration
+import org.apache.hudi.common.model.HoodieTableType
+import org.apache.hudi.common.table.{HoodieTableConfig, HoodieTableMetaClient}
+
+import java.io.File
+import java.nio.file.{Files, Paths}
+
+class TestHudiConf extends TestHoodieSqlBase {
Review comment:
rename: TestSqlConf
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -43,70 +46,92 @@
private static final Logger LOG = LogManager.getLogger(DFSPropertiesConfiguration.class);
+ private static final String DEFAULT_PROPERTIES_FILE = "hudi-defaults.conf";
+
+ public static final String CONF_FILE_DIR_ENV_NAME = "HUDI_CONF_DIR";
+
+ // props read from hudi-defaults.conf
+ private static final TypedProperties HUDI_CONF_PROPS = loadGlobalProps();
Review comment:
rename: `GLOBAL_CONFS`
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/HoodieConfig.java
##########
@@ -167,7 +171,17 @@ public String getString(String key) {
}
public Properties getProps() {
- return props;
+ return getProps(false);
+ }
+
+ public Properties getProps(boolean includeHudiConf) {
Review comment:
any way to avoid this duplication with class above?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969054490
yeah, makes sense.
Also, lets create a follow up ticket either to add documentation on the usages or write a separate blog/section on this. For instance, I do not know if we can set prop file location via options. I just tested it by setting env variable.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-972587261
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
}, {
"hash" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445",
"triggerID" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"triggerType" : "PUSH"
}, {
"hash" : "eb3383de0645ad08dcd959924b9f3fc6588823b1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3462",
"triggerID" : "eb3383de0645ad08dcd959924b9f3fc6588823b1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445)
* eb3383de0645ad08dcd959924b9f3fc6588823b1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3462)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-972586010
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
}, {
"hash" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445",
"triggerID" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"triggerType" : "PUSH"
}, {
"hash" : "eb3383de0645ad08dcd959924b9f3fc6588823b1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "eb3383de0645ad08dcd959924b9f3fc6588823b1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445)
* eb3383de0645ad08dcd959924b9f3fc6588823b1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
nsivabalan edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-968060623
Tested scenarios:
1. w/o setting HUDI_CONF_DIR, having issues as reported above. Needs fixing.
2. set proper HUDI_CONF_DIR env, but the dir does not contain the file (hudi-defaults.conf). Again a similar issue. attaching the stack trace below. Needs fixing.
3. Set proper HUDI_CONF_DIR which has hudi-defaults.conf. I see writes picks up the config from this file.
4. same as (3). tried overwriting the config with df.write.hudi for a property thats already in hudi-defaults.conf. The one given in spark-shel with df.write.hudi takes precedence.
5. tried two spark-shells w/ proper env set in both. Both able to pick up the configs from hudi-defaults.conf.
<details>
<summary>Stacktrace for (2)</summary>
```
scala> df.write.format("hudi").
| options(getQuickstartWriteConfigs).
| option(PRECOMBINE_FIELD.key(), "ts").
| option(RECORDKEY_FIELD.key(), "uuid").
| option(PARTITIONPATH_FIELD.key(), "partitionpath").
| option(TBL_NAME.key(), tableName).
| mode(Overwrite).
| save(basePath)
21/11/13 07:18:53 ERROR DFSPropertiesConfiguration: Error reading in properties from dfs
java.io.FileNotFoundException: File file:/tmp/hudi_conf/hudi-defaults.conf does not exist
at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:142)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.addPropsFromFile(DFSPropertiesConfiguration.java:123)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.loadGlobalProps(DFSPropertiesConfiguration.java:92)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.<clinit>(DFSPropertiesConfiguration.java:57)
at org.apache.hudi.HoodieWriterUtils$.parametersWithWriteDefaults(HoodieWriterUtils.scala:47)
at org.apache.hudi.HoodieSparkSqlWriter$.mergeParamsAndGetHoodieConfig(HoodieSparkSqlWriter.scala:733)
at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:88)
at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:162)
at org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:45)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:86)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:127)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:127)
at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:83)
at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:81)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:696)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:696)
at org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:80)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:127)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:75)
at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:696)
at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:305)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:291)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:249)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:55)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:60)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:62)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:64)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:66)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:68)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:70)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:72)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:74)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:76)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:78)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:80)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:82)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:84)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:86)
at $line25.$read$$iw$$iw$$iw$$iw$$iw.<init>(<console>:88)
at $line25.$read$$iw$$iw$$iw$$iw.<init>(<console>:90)
at $line25.$read$$iw$$iw$$iw.<init>(<console>:92)
at $line25.$read$$iw$$iw.<init>(<console>:94)
at $line25.$read$$iw.<init>(<console>:96)
at $line25.$read.<init>(<console>:98)
at $line25.$read$.<init>(<console>:102)
at $line25.$read$.<clinit>(<console>)
at $line25.$eval$.$print$lzycompute(<console>:7)
at $line25.$eval$.$print(<console>:6)
at $line25.$eval.$print(<console>)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call(IMain.scala:793)
at scala.tools.nsc.interpreter.IMain$Request.loadAndRun(IMain.scala:1054)
at scala.tools.nsc.interpreter.IMain$WrappedRequest$$anonfun$loadAndRunReq$1.apply(IMain.scala:645)
at scala.tools.nsc.interpreter.IMain$WrappedRequest$$anonfun$loadAndRunReq$1.apply(IMain.scala:644)
at scala.reflect.internal.util.ScalaClassLoader$class.asContext(ScalaClassLoader.scala:31)
at scala.reflect.internal.util.AbstractFileClassLoader.asContext(AbstractFileClassLoader.scala:19)
at scala.tools.nsc.interpreter.IMain$WrappedRequest.loadAndRunReq(IMain.scala:644)
at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:576)
at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:572)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:819)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.command(ILoop.scala:691)
at scala.tools.nsc.interpreter.ILoop.processLine(ILoop.scala:404)
at scala.tools.nsc.interpreter.ILoop.loop(ILoop.scala:425)
at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply$mcZ$sp(SparkILoop.scala:285)
at org.apache.spark.repl.SparkILoop.runClosure(SparkILoop.scala:159)
at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:182)
at org.apache.spark.repl.Main$.doMain(Main.scala:78)
at org.apache.spark.repl.Main$.main(Main.scala:58)
at org.apache.spark.repl.Main.main(Main.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
java.lang.IllegalArgumentException: Cannot read properties from dfs
at org.apache.hudi.common.config.DFSPropertiesConfiguration.addPropsFromFile(DFSPropertiesConfiguration.java:132)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.loadGlobalProps(DFSPropertiesConfiguration.java:92)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.<clinit>(DFSPropertiesConfiguration.java:57)
at org.apache.hudi.HoodieWriterUtils$.parametersWithWriteDefaults(HoodieWriterUtils.scala:47)
at org.apache.hudi.HoodieSparkSqlWriter$.mergeParamsAndGetHoodieConfig(HoodieSparkSqlWriter.scala:733)
at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:88)
at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:162)
at org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:45)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:86)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:127)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:127)
at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:83)
at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:81)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:696)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:696)
at org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:80)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:127)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:75)
at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:696)
at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:305)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:291)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:249)
... 68 elided
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-972619707
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
}, {
"hash" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445",
"triggerID" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"triggerType" : "PUSH"
}, {
"hash" : "eb3383de0645ad08dcd959924b9f3fc6588823b1",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3462",
"triggerID" : "eb3383de0645ad08dcd959924b9f3fc6588823b1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* eb3383de0645ad08dcd959924b9f3fc6588823b1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3462)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-958627856
@xushiyan : since you have already reviewed this, I will let you drive this home.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: Add external config files support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f0d24f8b17a793c0fc925b75336d17b653102d61 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5f1b6ee1f819a5fa8398417877003ac7c477ca37 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-960399716
> @zhedoubushishi would you take this forward? it's close to land from what i see now.
Sorry for the late reply. I resolved the comments. Thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-963356328
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 570cbac2ed38f2974d1787abc52078a919c6019a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193)
* 9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-962692503
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 577c3ab184befb6173cf3bd3212ef2407cabb94f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123)
* 570cbac2ed38f2974d1787abc52078a919c6019a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-962693095
I am not sure why the Azure test failed, it passed on my local environment:
```
mvn test -Punit-tests -pl hudi-common
[WARNING] Tests run: 474, Failures: 0, Errors: 0, Skipped: 1
[INFO]
[INFO]
[INFO] --- jacoco-maven-plugin:0.8.5:report (post-unit-tests) @ hudi-common ---
[INFO] Loading execution data file /Users/wenningd/workspace/Aws157Hudi/src/Aws157Hudi/hudi-common/target/jacoco.exec
[INFO] Analyzed bundle 'hudi-common' with 416 classes
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 06:53 min
[INFO] Finished at: 2021-11-07T14:09:48-08:00
[INFO] ------------------------------------------------------------------------
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-962702583
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 570cbac2ed38f2974d1787abc52078a919c6019a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969014563
I will fix the first case: w/o setting HUDI_CONF_DIR, having issues as reported above. Needs fixing.
For the second case, I think it's an expected behavior. If customer sets a path for an external configuration file, and Hudi fails to load that file, then Hudi should throw the exception so that customers know that their configuration is not be loaded. Otherwise, customers may not even know their configurations are not loaded and get a Hudi table with wrong configs. What do you think @nsivabalan?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969617935
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c3c27d6062111b539575c342b4ea1d5e3057bd7c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969028283
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7096b7d991681a65f4597e5ca77ca26bc2be4a48 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338)
* ac0b1acace22b81fa2655f851adeacc4de5733f3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969437363
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ac0b1acace22b81fa2655f851adeacc4de5733f3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382)
* f6e072b53f37544aef6194bfde7868162da1ac39 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-970545771
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4e63344aa217d0800a7545a5d71db9c2565b182e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: Add external config files support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f0d24f8b17a793c0fc925b75336d17b653102d61 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run travis` re-run the last Travis build
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5f1b6ee1f819a5fa8398417877003ac7c477ca37 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: Add external config files support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f0d24f8b17a793c0fc925b75336d17b653102d61 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: Add external config files support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f0d24f8b17a793c0fc925b75336d17b653102d61 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969028283
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7096b7d991681a65f4597e5ca77ca26bc2be4a48 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338)
* ac0b1acace22b81fa2655f851adeacc4de5733f3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-967235785
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7096b7d991681a65f4597e5ca77ca26bc2be4a48 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969118756
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ac0b1acace22b81fa2655f851adeacc4de5733f3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r747988575
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +142,50 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
- public TypedProperties getConfig() {
- return props;
+ public static TypedProperties getGlobalProps() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(HUDI_CONF_PROPS);
+ return globalProps;
+ }
+
+ public TypedProperties getProps() {
+ return getProps(false);
+ }
+
+ public TypedProperties getProps(boolean includeHudiConf) {
+ if (includeHudiConf) {
+ TypedProperties mergedProps = new TypedProperties();
+ mergedProps.putAll(HUDI_CONF_PROPS);
+ mergedProps.putAll(props);
+ return mergedProps;
+ } else {
+ return props;
+ }
+ }
+
+ private static Path getDefaultConfPath() {
+ String confDir = System.getenv(CONF_FILE_DIR_ENV_NAME);
+ if (confDir == null) {
Review comment:
Good point. I added this logic
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969444267
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f6e072b53f37544aef6194bfde7868162da1ac39 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396)
* c3c27d6062111b539575c342b4ea1d5e3057bd7c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969435854
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ac0b1acace22b81fa2655f851adeacc4de5733f3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382)
* f6e072b53f37544aef6194bfde7868162da1ac39 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-963695961
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8bc1401bc9ac749b96e900d1763e0a782366f587 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
nsivabalan edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-968058611
I tried to test this patch locally. I am seeing a stacktrace if hudi-defaults.conf file is not present. We should definitely fix this. For users who don't have this file, may be one line warning is good.
<details>
<summary>Excerpts from running our spark quick start guide with this patch. </summary>
```
scala> df.write.format("hudi").
| options(getQuickstartWriteConfigs).
| option(PRECOMBINE_FIELD.key(), "ts").
| option(RECORDKEY_FIELD.key(), "uuid").
| option(PARTITIONPATH_FIELD.key(), "partitionpath").
| option(TBL_NAME.key(), tableName).
| mode(Overwrite).
| save(basePath)
21/11/13 07:07:57 WARN DFSPropertiesConfiguration: Cannot find HUDI_CONF_DIR, please set it as the dir of hudi-defaults.conf
21/11/13 07:07:57 ERROR DFSPropertiesConfiguration: Error reading in properties from dfs
java.io.FileNotFoundException: File file:/etc/hudi/conf does not exist
at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:142)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.addPropsFromFile(DFSPropertiesConfiguration.java:123)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.loadGlobalProps(DFSPropertiesConfiguration.java:95)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.<clinit>(DFSPropertiesConfiguration.java:57)
at org.apache.hudi.HoodieWriterUtils$.parametersWithWriteDefaults(HoodieWriterUtils.scala:47)
at org.apache.hudi.HoodieSparkSqlWriter$.mergeParamsAndGetHoodieConfig(HoodieSparkSqlWriter.scala:733)
at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:88)
at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:162)
at org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:45)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:86)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:127)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:127)
at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:83)
at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:81)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:696)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:696)
at org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:80)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:127)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:75)
at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:696)
at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:305)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:291)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:249)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:55)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:60)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:62)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:64)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:66)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:68)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:70)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:72)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:74)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:76)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:78)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:80)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:82)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:84)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:86)
at $line25.$read$$iw$$iw$$iw$$iw$$iw.<init>(<console>:88)
at $line25.$read$$iw$$iw$$iw$$iw.<init>(<console>:90)
at $line25.$read$$iw$$iw$$iw.<init>(<console>:92)
at $line25.$read$$iw$$iw.<init>(<console>:94)
at $line25.$read$$iw.<init>(<console>:96)
at $line25.$read.<init>(<console>:98)
at $line25.$read$.<init>(<console>:102)
at $line25.$read$.<clinit>(<console>)
at $line25.$eval$.$print$lzycompute(<console>:7)
at $line25.$eval$.$print(<console>:6)
at $line25.$eval.$print(<console>)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call(IMain.scala:793)
at scala.tools.nsc.interpreter.IMain$Request.loadAndRun(IMain.scala:1054)
at scala.tools.nsc.interpreter.IMain$WrappedRequest$$anonfun$loadAndRunReq$1.apply(IMain.scala:645)
at scala.tools.nsc.interpreter.IMain$WrappedRequest$$anonfun$loadAndRunReq$1.apply(IMain.scala:644)
at scala.reflect.internal.util.ScalaClassLoader$class.asContext(ScalaClassLoader.scala:31)
at scala.reflect.internal.util.AbstractFileClassLoader.asContext(AbstractFileClassLoader.scala:19)
at scala.tools.nsc.interpreter.IMain$WrappedRequest.loadAndRunReq(IMain.scala:644)
at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:576)
at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:572)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:819)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.command(ILoop.scala:691)
at scala.tools.nsc.interpreter.ILoop.processLine(ILoop.scala:404)
at scala.tools.nsc.interpreter.ILoop.loop(ILoop.scala:425)
at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply$mcZ$sp(SparkILoop.scala:285)
at org.apache.spark.repl.SparkILoop.runClosure(SparkILoop.scala:159)
at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:182)
at org.apache.spark.repl.Main$.doMain(Main.scala:78)
at org.apache.spark.repl.Main$.main(Main.scala:58)
at org.apache.spark.repl.Main.main(Main.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
21/11/13 07:07:57 WARN HoodieSparkSqlWriter$: hoodie table at file:/tmp/hudi_trips_cow already exists. Deleting existing data & overwriting with new data.
[Stage 31:>
````
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan merged pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
xushiyan merged pull request #3416:
URL: https://github.com/apache/hudi/pull/3416
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5f1b6ee1f819a5fa8398417877003ac7c477ca37 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524)
* 577c3ab184befb6173cf3bd3212ef2407cabb94f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-963358649
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 570cbac2ed38f2974d1787abc52078a919c6019a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193)
* 9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-935558416
Updated the description and resolved the conflicts.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2dd5fe4788faf920e276c5ecd755bf5950d55a20 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 522c1e5aedb862f936756a10509f2f0ff91ad8a8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197)
* 2dd5fe4788faf920e276c5ecd755bf5950d55a20 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-966853585
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8bc1401bc9ac749b96e900d1763e0a782366f587 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230)
* 132a035986b5f38b903890f13b98f291fef6a38d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-967196487
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 132a035986b5f38b903890f13b98f291fef6a38d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328)
* 7096b7d991681a65f4597e5ca77ca26bc2be4a48 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-972587261
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
}, {
"hash" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445",
"triggerID" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"triggerType" : "PUSH"
}, {
"hash" : "eb3383de0645ad08dcd959924b9f3fc6588823b1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3462",
"triggerID" : "eb3383de0645ad08dcd959924b9f3fc6588823b1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445)
* eb3383de0645ad08dcd959924b9f3fc6588823b1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3462)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r751692944
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -43,72 +47,110 @@
private static final Logger LOG = LogManager.getLogger(DFSPropertiesConfiguration.class);
+ private static final String DEFAULT_PROPERTIES_FILE = "hudi-defaults.conf";
+
+ public static final String CONF_FILE_DIR_ENV_NAME = "HUDI_CONF_DIR";
+
+ public static final String DEFAULT_CONF_FILE_DIR = "file:/etc/hudi/conf";
+
+ // props read from hudi-defaults.conf
+ private static TypedProperties GLOBAL_PROPS = loadGlobalProps();
+
private final FileSystem fs;
- private final Path rootFile;
+ private Path currentFilePath;
- private final TypedProperties props;
+ // props read from user defined configuration file or input stream
+ private final HoodieConfig hoodieConfig;
// Keep track of files visited, to detect loops
- private final Set<String> visitedFiles;
+ private final Set<String> visitedFilePaths;
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile, TypedProperties defaults) {
+ public DFSPropertiesConfiguration(FileSystem fs, Path filePath) {
this.fs = fs;
- this.rootFile = rootFile;
- this.props = defaults;
- this.visitedFiles = new HashSet<>();
- visitFile(rootFile);
- }
-
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile) {
- this(fs, rootFile, new TypedProperties());
+ this.currentFilePath = filePath;
+ this.hoodieConfig = new HoodieConfig();
+ this.visitedFilePaths = new HashSet<>();
+ addPropsFromFile(filePath);
}
public DFSPropertiesConfiguration() {
this.fs = null;
- this.rootFile = null;
- this.props = new TypedProperties();
- this.visitedFiles = new HashSet<>();
+ this.currentFilePath = null;
+ this.hoodieConfig = new HoodieConfig();
+ this.visitedFilePaths = new HashSet<>();
}
- private String[] splitProperty(String line) {
- int ind = line.indexOf('=');
- String k = line.substring(0, ind).trim();
- String v = line.substring(ind + 1).trim();
- return new String[] {k, v};
+ /**
+ * Load global props from hudi-defaults.conf which is under CONF_FILE_DIR_ENV_NAME.
+ * @return Typed Properties
+ */
+ public static TypedProperties loadGlobalProps() {
+ DFSPropertiesConfiguration conf = new DFSPropertiesConfiguration();
+ Option<Path> defaultConfPath = getConfPathFromEnv();
+ if (defaultConfPath.isPresent()) {
+ conf.addPropsFromFile(defaultConfPath.get());
+ } else {
+ try {
+ conf.addPropsFromFile(new Path(DEFAULT_CONF_FILE_DIR));
+ } catch (Exception ignored) {
+ LOG.debug("Didn't find config file under default conf file dir: " + DEFAULT_CONF_FILE_DIR);
+ }
+ }
+ return conf.getProps();
+ }
+
+ public static void refreshGlobalProps() {
+ GLOBAL_PROPS = loadGlobalProps();
+ }
+
+ public static void clearGlobalProps() {
+ GLOBAL_PROPS = new TypedProperties();
}
- private void visitFile(Path file) {
+ /**
+ * Add properties from external configuration files.
+ *
+ * @param filePath File path for configuration file
+ */
+ public void addPropsFromFile(Path filePath) {
+ if (visitedFilePaths.contains(filePath.toString())) {
+ throw new IllegalStateException("Loop detected; file " + filePath + " already referenced");
+ }
+ FileSystem fileSystem;
try {
- if (visitedFiles.contains(file.getName())) {
- throw new IllegalStateException("Loop detected; file " + file + " already referenced");
- }
- visitedFiles.add(file.getName());
- BufferedReader reader = new BufferedReader(new InputStreamReader(fs.open(file)));
- addProperties(reader);
+ fileSystem = fs != null ? fs : filePath.getFileSystem(new Configuration());
+ } catch (IOException e) {
+ throw new IllegalArgumentException("Cannot get the file system from file path", e);
+ }
+ try (BufferedReader reader = new BufferedReader(new InputStreamReader(fileSystem.open(filePath)))) {
Review comment:
When ```fs``` exists, if I put ```FileSystem fs = ...``` into the try-with-resources clause, it would close the class variable ```fs```, but ```fs``` is also used in other places which causes fileSystem is closed exception in the runtime
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r747985677
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +142,50 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
- public TypedProperties getConfig() {
- return props;
+ public static TypedProperties getGlobalProps() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(HUDI_CONF_PROPS);
+ return globalProps;
+ }
+
+ public TypedProperties getProps() {
+ return getProps(false);
+ }
+
+ public TypedProperties getProps(boolean includeHudiConf) {
+ if (includeHudiConf) {
+ TypedProperties mergedProps = new TypedProperties();
+ mergedProps.putAll(HUDI_CONF_PROPS);
+ mergedProps.putAll(props);
+ return mergedProps;
+ } else {
+ return props;
+ }
+ }
+
+ private static Path getDefaultConfPath() {
+ String confDir = System.getenv(CONF_FILE_DIR_ENV_NAME);
+ if (confDir == null) {
+ LOG.warn("Cannot find " + CONF_FILE_DIR_ENV_NAME + ", please set it as the dir of " + DEFAULT_PROPERTIES_FILE);
+ return null;
+ }
+ return new Path("file://" + confDir + File.separator + DEFAULT_PROPERTIES_FILE);
+ }
+
+ private String[] splitProperty(String line) {
+ line = line.replaceAll("\\s+"," ");
+ String delimiter = line.contains("=") ? "=" : " ";
+ int ind = line.indexOf(delimiter);
+ String k = line.substring(0, ind).trim();
+ String v = line.substring(ind + 1).trim();
+ return new String[] {k, v};
+ }
+
+ private boolean isValidLine(String line) {
Review comment:
We have some test cases here: https://github.com/apache/hudi/blob/master/hudi-common/src/test/java/org/apache/hudi/common/util/TestDFSPropertiesConfiguration.java#L59-L72. Is it enough or I can add more?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-967235785
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7096b7d991681a65f4597e5ca77ca26bc2be4a48 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969438707
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f6e072b53f37544aef6194bfde7868162da1ac39 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-966854556
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8bc1401bc9ac749b96e900d1763e0a782366f587 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230)
* 132a035986b5f38b903890f13b98f291fef6a38d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-966875810
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 132a035986b5f38b903890f13b98f291fef6a38d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-970505481
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c3c27d6062111b539575c342b4ea1d5e3057bd7c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398)
* 4e63344aa217d0800a7545a5d71db9c2565b182e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r751692944
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -43,72 +47,110 @@
private static final Logger LOG = LogManager.getLogger(DFSPropertiesConfiguration.class);
+ private static final String DEFAULT_PROPERTIES_FILE = "hudi-defaults.conf";
+
+ public static final String CONF_FILE_DIR_ENV_NAME = "HUDI_CONF_DIR";
+
+ public static final String DEFAULT_CONF_FILE_DIR = "file:/etc/hudi/conf";
+
+ // props read from hudi-defaults.conf
+ private static TypedProperties GLOBAL_PROPS = loadGlobalProps();
+
private final FileSystem fs;
- private final Path rootFile;
+ private Path currentFilePath;
- private final TypedProperties props;
+ // props read from user defined configuration file or input stream
+ private final HoodieConfig hoodieConfig;
// Keep track of files visited, to detect loops
- private final Set<String> visitedFiles;
+ private final Set<String> visitedFilePaths;
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile, TypedProperties defaults) {
+ public DFSPropertiesConfiguration(FileSystem fs, Path filePath) {
this.fs = fs;
- this.rootFile = rootFile;
- this.props = defaults;
- this.visitedFiles = new HashSet<>();
- visitFile(rootFile);
- }
-
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile) {
- this(fs, rootFile, new TypedProperties());
+ this.currentFilePath = filePath;
+ this.hoodieConfig = new HoodieConfig();
+ this.visitedFilePaths = new HashSet<>();
+ addPropsFromFile(filePath);
}
public DFSPropertiesConfiguration() {
this.fs = null;
- this.rootFile = null;
- this.props = new TypedProperties();
- this.visitedFiles = new HashSet<>();
+ this.currentFilePath = null;
+ this.hoodieConfig = new HoodieConfig();
+ this.visitedFilePaths = new HashSet<>();
}
- private String[] splitProperty(String line) {
- int ind = line.indexOf('=');
- String k = line.substring(0, ind).trim();
- String v = line.substring(ind + 1).trim();
- return new String[] {k, v};
+ /**
+ * Load global props from hudi-defaults.conf which is under CONF_FILE_DIR_ENV_NAME.
+ * @return Typed Properties
+ */
+ public static TypedProperties loadGlobalProps() {
+ DFSPropertiesConfiguration conf = new DFSPropertiesConfiguration();
+ Option<Path> defaultConfPath = getConfPathFromEnv();
+ if (defaultConfPath.isPresent()) {
+ conf.addPropsFromFile(defaultConfPath.get());
+ } else {
+ try {
+ conf.addPropsFromFile(new Path(DEFAULT_CONF_FILE_DIR));
+ } catch (Exception ignored) {
+ LOG.debug("Didn't find config file under default conf file dir: " + DEFAULT_CONF_FILE_DIR);
+ }
+ }
+ return conf.getProps();
+ }
+
+ public static void refreshGlobalProps() {
+ GLOBAL_PROPS = loadGlobalProps();
+ }
+
+ public static void clearGlobalProps() {
+ GLOBAL_PROPS = new TypedProperties();
}
- private void visitFile(Path file) {
+ /**
+ * Add properties from external configuration files.
+ *
+ * @param filePath File path for configuration file
+ */
+ public void addPropsFromFile(Path filePath) {
+ if (visitedFilePaths.contains(filePath.toString())) {
+ throw new IllegalStateException("Loop detected; file " + filePath + " already referenced");
+ }
+ FileSystem fileSystem;
try {
- if (visitedFiles.contains(file.getName())) {
- throw new IllegalStateException("Loop detected; file " + file + " already referenced");
- }
- visitedFiles.add(file.getName());
- BufferedReader reader = new BufferedReader(new InputStreamReader(fs.open(file)));
- addProperties(reader);
+ fileSystem = fs != null ? fs : filePath.getFileSystem(new Configuration());
+ } catch (IOException e) {
+ throw new IllegalArgumentException("Cannot get the file system from file path", e);
+ }
+ try (BufferedReader reader = new BufferedReader(new InputStreamReader(fileSystem.open(filePath)))) {
Review comment:
When ```fs``` exists, if I put ```FileSystem fs = ...``` into the try-with-resources clause, it would close the class variable ```fs```, which causes fileSystem is closed exception in the runtime
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-966853585
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8bc1401bc9ac749b96e900d1763e0a782366f587 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230)
* 132a035986b5f38b903890f13b98f291fef6a38d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-960476080
> @zhedoubushishi Only some minor suggestions. can you check CI please? looks like some UTs not passing
Hi, I wonder how can I check the CI for UTs? I only saw 2 successful checks for code build from this page...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r742511501
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -43,70 +45,88 @@
private static final Logger LOG = LogManager.getLogger(DFSPropertiesConfiguration.class);
+ private static final String DEFAULT_PROPERTIES_FILE = "hudi-defaults.conf";
+
+ public static final String CONF_FILE_DIR_ENV_NAME = "HUDI_CONF_DIR";
+
+ // props read from hudi-defaults.conf
+ private static final TypedProperties HUDI_CONF_PROPS = loadGlobalProps();
+
private final FileSystem fs;
- private final Path rootFile;
+ private Path currentFilePath;
+ // props read from user defined configuration file or input stream
private final TypedProperties props;
// Keep track of files visited, to detect loops
- private final Set<String> visitedFiles;
+ private final Set<String> visitedFilePaths;
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile, TypedProperties defaults) {
+ public DFSPropertiesConfiguration(FileSystem fs, Path filePath) {
this.fs = fs;
- this.rootFile = rootFile;
- this.props = defaults;
- this.visitedFiles = new HashSet<>();
- visitFile(rootFile);
- }
-
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile) {
- this(fs, rootFile, new TypedProperties());
+ this.currentFilePath = filePath;
+ this.props = new TypedProperties();
+ this.visitedFilePaths = new HashSet<>();
+ addPropsFromFile(filePath);
}
public DFSPropertiesConfiguration() {
this.fs = null;
- this.rootFile = null;
+ this.currentFilePath = null;
this.props = new TypedProperties();
- this.visitedFiles = new HashSet<>();
+ this.visitedFilePaths = new HashSet<>();
}
- private String[] splitProperty(String line) {
- int ind = line.indexOf('=');
- String k = line.substring(0, ind).trim();
- String v = line.substring(ind + 1).trim();
- return new String[] {k, v};
+ /**
+ * Load global props from hudi-defaults.conf which is under CONF_FILE_DIR_ENV_NAME.
+ * @return Typed Properties
+ */
+ public static TypedProperties loadGlobalProps() {
+ DFSPropertiesConfiguration conf = new DFSPropertiesConfiguration();
+ Path defaultConfPath = getDefaultConfPath();
+ if (defaultConfPath != null) {
+ conf.addPropsFromFile(defaultConfPath);
+ }
+ return conf.getConfig();
}
- private void visitFile(Path file) {
+ /**
+ * Add properties from external configuration files.
+ *
+ * @param filePath File path for configuration file
+ */
+ public void addPropsFromFile(Path filePath) {
try {
- if (visitedFiles.contains(file.getName())) {
- throw new IllegalStateException("Loop detected; file " + file + " already referenced");
+ if (visitedFilePaths.contains(filePath.toString())) {
+ throw new IllegalStateException("Loop detected; file " + filePath + " already referenced");
}
- visitedFiles.add(file.getName());
- BufferedReader reader = new BufferedReader(new InputStreamReader(fs.open(file)));
- addProperties(reader);
+ visitedFilePaths.add(filePath.toString());
+ currentFilePath = filePath;
+ FileSystem fileSystem = fs != null ? fs : filePath.getFileSystem(new Configuration());
+ BufferedReader reader = new BufferedReader(new InputStreamReader(fileSystem.open(filePath)));
Review comment:
Good point. Changed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-962692879
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 577c3ab184befb6173cf3bd3212ef2407cabb94f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123)
* 570cbac2ed38f2974d1787abc52078a919c6019a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-963670169
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221)
* 8bc1401bc9ac749b96e900d1763e0a782366f587 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-963695961
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8bc1401bc9ac749b96e900d1763e0a782366f587 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-907594142
@zhedoubushishi we already have a hudi.properties file. Can you please elaborate the use case for this PR once?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-916315111
> @zhedoubushishi we already have a hudi.properties file. Can you please elaborate the use case for this PR once?
Sorry for the late reply. This is not the same as ```hudi.properties```. ```hudi.properties``` is created when customers write a Hudi table and it's a table level configuration.
However, the external configuration file in this PR is not specific to any Hudi table. It's more like a cluster level configuration just like ```spark-defaults.conf``` in Spark and ```flink-conf. yaml``` in Flink. The benefit of having this external configuration file, is there are some configurations can be shared between different Hudi tables, e.g. Hive JDBC URL, Zookeeper connect URL, HBase URL...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-934016862
@xushiyan : I will let you review this PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4949d3827d33e725b2bbba13b9ce15df160d56ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521)
* 5f1b6ee1f819a5fa8398417877003ac7c477ca37 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5f1b6ee1f819a5fa8398417877003ac7c477ca37 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4949d3827d33e725b2bbba13b9ce15df160d56ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521)
* 5f1b6ee1f819a5fa8398417877003ac7c477ca37 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ca2568692241b16928162899d91241a43de870a9 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520)
* 4949d3827d33e725b2bbba13b9ce15df160d56ee Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
xushiyan commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-961072245
> ## CI report:
> * [577c3ab](https://github.com/apache/hudi/commit/577c3ab184befb6173cf3bd3212ef2407cabb94f) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123)
>
> Bot commands
@zhedoubushishi this is the report comment
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-967196487
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 132a035986b5f38b903890f13b98f291fef6a38d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328)
* 7096b7d991681a65f4597e5ca77ca26bc2be4a48 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-961588087
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-963671813
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221)
* 8bc1401bc9ac749b96e900d1763e0a782366f587 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-970505481
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c3c27d6062111b539575c342b4ea1d5e3057bd7c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398)
* 4e63344aa217d0800a7545a5d71db9c2565b182e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969014563
I will fix the first case: w/o setting HUDI_CONF_DIR, having issues as reported above. Needs fixing.
For the second case, I think it's an expected behaviour. If customer sets a path for an external configuration file, and Hudi fails to load that file, then Hudi should throw the exception so that customers know that their configuration is not be loaded. Otherwise, customers may not even know their configurations are not loaded and get a Hudi table with wrong configs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-970502811
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c3c27d6062111b539575c342b4ea1d5e3057bd7c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398)
* 4e63344aa217d0800a7545a5d71db9c2565b182e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969617935
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c3c27d6062111b539575c342b4ea1d5e3057bd7c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969435854
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ac0b1acace22b81fa2655f851adeacc4de5733f3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382)
* f6e072b53f37544aef6194bfde7868162da1ac39 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-963402261
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
xushiyan commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-972711756
> Tested scenarios:
>
> 1. w/o setting HUDI_CONF_DIR, having issues as reported above. Needs fixing.
> 2. set proper HUDI_CONF_DIR env, but the dir does not contain the file (hudi-defaults.conf). Again a similar issue. attaching the stack trace below. Needs fixing.
> 3. Set proper HUDI_CONF_DIR which has hudi-defaults.conf. I see writes picks up the config from this file.
> 4. same as (3). tried overwriting the config with df.write.hudi for a property thats already in hudi-defaults.conf. The one given in spark-shel with df.write.hudi takes precedence.
> 5. tried two spark-shells w/ proper env set in both. Both able to pick up the configs from hudi-defaults.conf.
>
> Stacktrace for (2)
tested scenario 1 fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
xushiyan commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r751071263
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +159,43 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
- public TypedProperties getConfig() {
- return props;
+ public static TypedProperties getGlobalProps() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(GLOBAL_PROPS);
+ return globalProps;
+ }
+
+ public TypedProperties getProps() {
+ return new TypedProperties(hoodieConfig.getProps());
+ }
+
+ public TypedProperties getProps(boolean includeGlobalProps) {
+ return new TypedProperties(hoodieConfig.getProps(includeGlobalProps));
+ }
+
+ private static Option<Path> getConfPathFromEnv() {
+ String confDir = System.getenv(CONF_FILE_DIR_ENV_NAME);
+ if (confDir == null) {
+ LOG.warn("Cannot find " + CONF_FILE_DIR_ENV_NAME + ", please set it as the dir of " + DEFAULT_PROPERTIES_FILE);
+ return Option.empty();
+ }
+ return Option.of(new Path("file://" + confDir + File.separator + DEFAULT_PROPERTIES_FILE));
Review comment:
why file scheme is hardcoded here? even `DEFAULT_CONF_FILE_DIR` already starts with `file:/`
```suggestion
return Option.of(new Path(confDir + File.separator + DEFAULT_PROPERTIES_FILE));
```
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -43,72 +47,110 @@
private static final Logger LOG = LogManager.getLogger(DFSPropertiesConfiguration.class);
+ private static final String DEFAULT_PROPERTIES_FILE = "hudi-defaults.conf";
+
+ public static final String CONF_FILE_DIR_ENV_NAME = "HUDI_CONF_DIR";
+
+ public static final String DEFAULT_CONF_FILE_DIR = "file:/etc/hudi/conf";
+
+ // props read from hudi-defaults.conf
+ private static TypedProperties GLOBAL_PROPS = loadGlobalProps();
+
private final FileSystem fs;
- private final Path rootFile;
+ private Path currentFilePath;
- private final TypedProperties props;
+ // props read from user defined configuration file or input stream
+ private final HoodieConfig hoodieConfig;
// Keep track of files visited, to detect loops
- private final Set<String> visitedFiles;
+ private final Set<String> visitedFilePaths;
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile, TypedProperties defaults) {
+ public DFSPropertiesConfiguration(FileSystem fs, Path filePath) {
this.fs = fs;
- this.rootFile = rootFile;
- this.props = defaults;
- this.visitedFiles = new HashSet<>();
- visitFile(rootFile);
- }
-
- public DFSPropertiesConfiguration(FileSystem fs, Path rootFile) {
- this(fs, rootFile, new TypedProperties());
+ this.currentFilePath = filePath;
+ this.hoodieConfig = new HoodieConfig();
+ this.visitedFilePaths = new HashSet<>();
+ addPropsFromFile(filePath);
}
public DFSPropertiesConfiguration() {
this.fs = null;
- this.rootFile = null;
- this.props = new TypedProperties();
- this.visitedFiles = new HashSet<>();
+ this.currentFilePath = null;
+ this.hoodieConfig = new HoodieConfig();
+ this.visitedFilePaths = new HashSet<>();
}
- private String[] splitProperty(String line) {
- int ind = line.indexOf('=');
- String k = line.substring(0, ind).trim();
- String v = line.substring(ind + 1).trim();
- return new String[] {k, v};
+ /**
+ * Load global props from hudi-defaults.conf which is under CONF_FILE_DIR_ENV_NAME.
+ * @return Typed Properties
+ */
+ public static TypedProperties loadGlobalProps() {
+ DFSPropertiesConfiguration conf = new DFSPropertiesConfiguration();
+ Option<Path> defaultConfPath = getConfPathFromEnv();
+ if (defaultConfPath.isPresent()) {
+ conf.addPropsFromFile(defaultConfPath.get());
+ } else {
+ try {
+ conf.addPropsFromFile(new Path(DEFAULT_CONF_FILE_DIR));
+ } catch (Exception ignored) {
+ LOG.debug("Didn't find config file under default conf file dir: " + DEFAULT_CONF_FILE_DIR);
+ }
+ }
+ return conf.getProps();
+ }
+
+ public static void refreshGlobalProps() {
+ GLOBAL_PROPS = loadGlobalProps();
+ }
+
+ public static void clearGlobalProps() {
+ GLOBAL_PROPS = new TypedProperties();
}
- private void visitFile(Path file) {
+ /**
+ * Add properties from external configuration files.
+ *
+ * @param filePath File path for configuration file
+ */
+ public void addPropsFromFile(Path filePath) {
+ if (visitedFilePaths.contains(filePath.toString())) {
+ throw new IllegalStateException("Loop detected; file " + filePath + " already referenced");
+ }
+ FileSystem fileSystem;
try {
- if (visitedFiles.contains(file.getName())) {
- throw new IllegalStateException("Loop detected; file " + file + " already referenced");
- }
- visitedFiles.add(file.getName());
- BufferedReader reader = new BufferedReader(new InputStreamReader(fs.open(file)));
- addProperties(reader);
+ fileSystem = fs != null ? fs : filePath.getFileSystem(new Configuration());
+ } catch (IOException e) {
+ throw new IllegalArgumentException("Cannot get the file system from file path", e);
+ }
+ try (BufferedReader reader = new BufferedReader(new InputStreamReader(fileSystem.open(filePath)))) {
Review comment:
can you also put `FileSystem fs = ...` into the try-with-resources clause? so fileSystem can be closed as well. it will reduce 1 catch block too.
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -43,72 +47,110 @@
private static final Logger LOG = LogManager.getLogger(DFSPropertiesConfiguration.class);
+ private static final String DEFAULT_PROPERTIES_FILE = "hudi-defaults.conf";
Review comment:
can this be public? since it's always the same file name to be read? this info should be made public then
##########
File path: hudi-common/src/test/java/org/apache/hudi/common/util/TestDFSPropertiesConfiguration.java
##########
@@ -119,15 +130,25 @@ public void testParsing() {
@Test
public void testIncludes() {
DFSPropertiesConfiguration cfg = new DFSPropertiesConfiguration(dfs, new Path(dfsBasePath + "/t3.props"));
- TypedProperties props = cfg.getConfig();
+ TypedProperties props = cfg.getProps();
assertEquals(123, props.getInteger("int.prop"));
assertEquals(243.4, props.getDouble("double.prop"), 0.001);
assertTrue(props.getBoolean("boolean.prop"));
assertEquals("t3.value", props.getString("string.prop"));
assertEquals(1354354354, props.getLong("long.prop"));
assertThrows(IllegalStateException.class, () -> {
- new DFSPropertiesConfiguration(dfs, new Path(dfsBasePath + "/t4.props"));
+ cfg.addPropsFromFile(new Path(dfsBasePath + "/t4.props"));
}, "Should error out on a self-included file.");
}
+
+ @Test
+ public void testLoadGlobalConfFile() {
+ assertEquals(5, DFSPropertiesConfiguration.loadGlobalProps().size());
+ assertEquals("jdbc:hive2://localhost:10000", DFSPropertiesConfiguration.loadGlobalProps().get("hoodie.datasource.hive_sync.jdbcurl"));
+ assertEquals("true", DFSPropertiesConfiguration.loadGlobalProps().get("hoodie.datasource.hive_sync.use_jdbc"));
+ assertEquals("false", DFSPropertiesConfiguration.loadGlobalProps().get("hoodie.datasource.hive_sync.support_timestamp"));
+ assertEquals("BLOOM", DFSPropertiesConfiguration.loadGlobalProps().get("hoodie.index.type"));
+ assertEquals("true", DFSPropertiesConfiguration.loadGlobalProps().get("hoodie.metadata.enable"));
Review comment:
can you just load it once ? `DFSPropertiesConfiguration.loadGlobalProps()`
##########
File path: hudi-common/src/test/java/org/apache/hudi/common/util/TestDFSPropertiesConfiguration.java
##########
@@ -70,10 +77,14 @@ public static void initClass() throws Exception {
filePath = new Path(dfsBasePath + "/t4.props");
writePropertiesFile(filePath, new String[] {"double.prop=838.3", "include = t4.props"});
+
+ // set HUDI_CONF_DIR
+ String testPropsFilePath = new File("src/test/resources").getAbsolutePath();
Review comment:
can you add a dedicated folder for putting test files for this test class? a top-level `hoodie-default.conf` can easily be misused by other test cases.
##########
File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestSqlConf.scala
##########
@@ -0,0 +1,104 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.hudi
+
+import org.apache.hadoop.conf.Configuration
+import org.apache.hadoop.fs.Path
+import org.apache.hudi.common.config.DFSPropertiesConfiguration
+import org.apache.hudi.common.model.HoodieTableType
+import org.apache.hudi.common.table.{HoodieTableConfig, HoodieTableMetaClient}
+
+import java.io.File
+import java.nio.file.{Files, Paths}
+
+import org.scalatest.BeforeAndAfter
+
+class TestSqlConf extends TestHoodieSqlBase with BeforeAndAfter {
+
+ def setEnv(key: String, value: String): String = {
+ val field = System.getenv().getClass.getDeclaredField("m")
+ field.setAccessible(true)
+ val map = field.get(System.getenv()).asInstanceOf[java.util.Map[java.lang.String, java.lang.String]]
+ map.put(key, value)
+ }
+
+ test("Test Hudi Conf") {
+ withTempDir { tmp =>
+ val tableName = generateTableName
+ val tablePath = tmp.getCanonicalPath
+ val partitionVal = "2021"
+ // Create table
+ spark.sql(
+ s"""
+ |create table $tableName (
+ | id int,
+ | name string,
+ | price double,
+ | ts long,
+ | year string
+ |) using hudi
+ | partitioned by (year)
+ | location '$tablePath'
+ | options (
+ | primaryKey ='id',
+ | preCombineField = 'ts'
+ | )
+ """.stripMargin)
+
+ // First merge with a extra input field 'flag' (insert a new record)
+ spark.sql(
+ s"""
+ | merge into $tableName
+ | using (
+ | select 1 as id, 'a1' as name, 10 as price, 1000 as ts, '1' as flag, $partitionVal as year
+ | ) s0
+ | on s0.id = $tableName.id
+ | when matched and flag = '1' then update set
+ | id = s0.id, name = s0.name, price = s0.price, ts = s0.ts, year = s0.year
+ | when not matched and flag = '1' then insert *
+ """.stripMargin)
+ checkAnswer(s"select id, name, price, ts, year from $tableName")(
+ Seq(1, "a1", 10.0, 1000, partitionVal)
+ )
+
+ // By default, Spark DML would set table type to COW and use Hive style partitioning, here we
+ // set table type to MOR and disable Hive style partitioning in the hudi conf file, and check
+ // if Hudi DML can load these configs correctly
+ assertResult(true)(Files.exists(Paths.get(s"$tablePath/$partitionVal")))
+ assertResult(HoodieTableType.MERGE_ON_READ)(new HoodieTableConfig(
+ new Path(tablePath).getFileSystem(new Configuration),
+ s"$tablePath/" + HoodieTableMetaClient.METAFOLDER_NAME,
+ HoodieTableConfig.PAYLOAD_CLASS_NAME.defaultValue).getTableType)
+
+ // delete the record
+ spark.sql(s"delete from $tableName where year = $partitionVal")
+ val cnt = spark.sql(s"select * from $tableName where year = $partitionVal").count()
+ assertResult(0)(cnt)
+ }
+ }
+
+ before {
+ val testPropsFilePath = new File("src/test/resources").getAbsolutePath
+ setEnv(DFSPropertiesConfiguration.CONF_FILE_DIR_ENV_NAME, testPropsFilePath)
+ DFSPropertiesConfiguration.refreshGlobalProps()
Review comment:
always a practice to isolate test file in folder for each test class
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +159,43 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
- public TypedProperties getConfig() {
- return props;
+ public static TypedProperties getGlobalProps() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(GLOBAL_PROPS);
+ return globalProps;
+ }
+
+ public TypedProperties getProps() {
+ return new TypedProperties(hoodieConfig.getProps());
+ }
+
+ public TypedProperties getProps(boolean includeGlobalProps) {
+ return new TypedProperties(hoodieConfig.getProps(includeGlobalProps));
+ }
+
+ private static Option<Path> getConfPathFromEnv() {
+ String confDir = System.getenv(CONF_FILE_DIR_ENV_NAME);
+ if (confDir == null) {
+ LOG.warn("Cannot find " + CONF_FILE_DIR_ENV_NAME + ", please set it as the dir of " + DEFAULT_PROPERTIES_FILE);
+ return Option.empty();
Review comment:
can you make the UT cover this gracefully failover path?
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/CreateHoodieTableCommand.scala
##########
@@ -100,7 +100,8 @@ case class CreateHoodieTableCommand(table: CatalogTable, ignoreIfExists: Boolean
// if CTAS, we treat the table we just created as nonexistent
val isTableExists = if (ctas) false else tableExistsInPath(path, conf)
var existingTableConfig = Map.empty[String, String]
- val sqlOptions = HoodieOptionConfig.withDefaultSqlOptions(tblProperties)
+ val globalProps = HoodieOptionConfig.mappingTableConfigToSqlOption(HoodieWriterUtils.mappingSparkDatasourceConfigsToTableConfigs(DFSPropertiesConfiguration.getGlobalProps.asScala.toMap))
Review comment:
this line too long, taking time to read. can you shorten it somehow?
##########
File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/CreateHoodieTableCommand.scala
##########
@@ -340,18 +342,22 @@ case class CreateHoodieTableCommand(table: CatalogTable, ignoreIfExists: Boolean
String.valueOf(isUrlEncodeEnabled(allPartitionPaths, table))
}
} else {
- extraConfig(HoodieTableConfig.HIVE_STYLE_PARTITIONING_ENABLE.key) = "true"
- extraConfig(HoodieTableConfig.URL_ENCODE_PARTITIONING.key) = HoodieTableConfig.URL_ENCODE_PARTITIONING.defaultValue()
+ extraConfig(HoodieTableConfig.HIVE_STYLE_PARTITIONING_ENABLE.key) = globalProps.getOrDefault(HoodieTableConfig.HIVE_STYLE_PARTITIONING_ENABLE.key, "true")
+ extraConfig(HoodieTableConfig.URL_ENCODE_PARTITIONING.key) = globalProps.getOrDefault(HoodieTableConfig.URL_ENCODE_PARTITIONING.key, HoodieTableConfig.URL_ENCODE_PARTITIONING.defaultValue)
Review comment:
ditto
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-917378727
Got it, please resolve the conflicts and we can start review then. :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b1c19180582fa6f0139b1a897aba36834a5b408f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6f020aaf3fb97698240fd5bc82a869f678dc37c9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892)
* 522c1e5aedb862f936756a10509f2f0ff91ad8a8 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ca2568692241b16928162899d91241a43de870a9 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520)
* 4949d3827d33e725b2bbba13b9ce15df160d56ee UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-961588087
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 577c3ab184befb6173cf3bd3212ef2407cabb94f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969511369
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f6e072b53f37544aef6194bfde7868162da1ac39 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396)
* c3c27d6062111b539575c342b4ea1d5e3057bd7c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-968058611
I tried to test this patch locally. I am seeing a stacktrace if hudi-defaults.conf file is not present. We should definitely fix this. For users who don't have this file, may be one line warning is good.
Excerpts from running our spark quick start guide with this patch.
```
scala> df.write.format("hudi").
| options(getQuickstartWriteConfigs).
| option(PRECOMBINE_FIELD.key(), "ts").
| option(RECORDKEY_FIELD.key(), "uuid").
| option(PARTITIONPATH_FIELD.key(), "partitionpath").
| option(TBL_NAME.key(), tableName).
| mode(Overwrite).
| save(basePath)
21/11/13 07:07:57 WARN DFSPropertiesConfiguration: Cannot find HUDI_CONF_DIR, please set it as the dir of hudi-defaults.conf
21/11/13 07:07:57 ERROR DFSPropertiesConfiguration: Error reading in properties from dfs
java.io.FileNotFoundException: File file:/etc/hudi/conf does not exist
at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:142)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.addPropsFromFile(DFSPropertiesConfiguration.java:123)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.loadGlobalProps(DFSPropertiesConfiguration.java:95)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.<clinit>(DFSPropertiesConfiguration.java:57)
at org.apache.hudi.HoodieWriterUtils$.parametersWithWriteDefaults(HoodieWriterUtils.scala:47)
at org.apache.hudi.HoodieSparkSqlWriter$.mergeParamsAndGetHoodieConfig(HoodieSparkSqlWriter.scala:733)
at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:88)
at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:162)
at org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:45)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:86)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:127)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:127)
at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:83)
at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:81)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:696)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:696)
at org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:80)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:127)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:75)
at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:696)
at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:305)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:291)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:249)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:55)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:60)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:62)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:64)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:66)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:68)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:70)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:72)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:74)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:76)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:78)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:80)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:82)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:84)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:86)
at $line25.$read$$iw$$iw$$iw$$iw$$iw.<init>(<console>:88)
at $line25.$read$$iw$$iw$$iw$$iw.<init>(<console>:90)
at $line25.$read$$iw$$iw$$iw.<init>(<console>:92)
at $line25.$read$$iw$$iw.<init>(<console>:94)
at $line25.$read$$iw.<init>(<console>:96)
at $line25.$read.<init>(<console>:98)
at $line25.$read$.<init>(<console>:102)
at $line25.$read$.<clinit>(<console>)
at $line25.$eval$.$print$lzycompute(<console>:7)
at $line25.$eval$.$print(<console>:6)
at $line25.$eval.$print(<console>)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call(IMain.scala:793)
at scala.tools.nsc.interpreter.IMain$Request.loadAndRun(IMain.scala:1054)
at scala.tools.nsc.interpreter.IMain$WrappedRequest$$anonfun$loadAndRunReq$1.apply(IMain.scala:645)
at scala.tools.nsc.interpreter.IMain$WrappedRequest$$anonfun$loadAndRunReq$1.apply(IMain.scala:644)
at scala.reflect.internal.util.ScalaClassLoader$class.asContext(ScalaClassLoader.scala:31)
at scala.reflect.internal.util.AbstractFileClassLoader.asContext(AbstractFileClassLoader.scala:19)
at scala.tools.nsc.interpreter.IMain$WrappedRequest.loadAndRunReq(IMain.scala:644)
at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:576)
at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:572)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:819)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.command(ILoop.scala:691)
at scala.tools.nsc.interpreter.ILoop.processLine(ILoop.scala:404)
at scala.tools.nsc.interpreter.ILoop.loop(ILoop.scala:425)
at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply$mcZ$sp(SparkILoop.scala:285)
at org.apache.spark.repl.SparkILoop.runClosure(SparkILoop.scala:159)
at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:182)
at org.apache.spark.repl.Main$.doMain(Main.scala:78)
at org.apache.spark.repl.Main$.main(Main.scala:58)
at org.apache.spark.repl.Main.main(Main.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
21/11/13 07:07:57 WARN HoodieSparkSqlWriter$: hoodie table at file:/tmp/hudi_trips_cow already exists. Deleting existing data & overwriting with new data.
[Stage 31:>
````
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-970502811
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c3c27d6062111b539575c342b4ea1d5e3057bd7c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398)
* 4e63344aa217d0800a7545a5d71db9c2565b182e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-966875810
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 132a035986b5f38b903890f13b98f291fef6a38d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-967198351
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 132a035986b5f38b903890f13b98f291fef6a38d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328)
* 7096b7d991681a65f4597e5ca77ca26bc2be4a48 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-967198351
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 132a035986b5f38b903890f13b98f291fef6a38d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328)
* 7096b7d991681a65f4597e5ca77ca26bc2be4a48 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969437363
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ac0b1acace22b81fa2655f851adeacc4de5733f3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382)
* f6e072b53f37544aef6194bfde7868162da1ac39 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969438707
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f6e072b53f37544aef6194bfde7868162da1ac39 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-970669274
> yeah, makes sense. Also, lets create a follow up ticket either to add documentation on the usages or write a separate blog/section on this. For instance, I do not know if we can set prop file location via options. I just tested it by setting env variable.
Sure I created an JIRA to track the documentation: https://issues.apache.org/jira/browse/HUDI-2775. And I fix the first issue, it won't print error message now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-970545771
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4e63344aa217d0800a7545a5d71db9c2565b182e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-972204156
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
}, {
"hash" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445",
"triggerID" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4e63344aa217d0800a7545a5d71db9c2565b182e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413)
* 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r742502013
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +137,49 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
+ public static TypedProperties getGlobalConfig() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(HUDI_CONF_PROPS);
+ return globalProps;
+ }
+
public TypedProperties getConfig() {
- return props;
+ return getConfig(false);
+ }
+
+ public TypedProperties getConfig(Boolean includeHudiConf) {
+ if (includeHudiConf) {
+ TypedProperties mergedProps = new TypedProperties();
+ mergedProps.putAll(HUDI_CONF_PROPS);
+ mergedProps.putAll(props);
+ return mergedProps;
+ } else {
+ return props;
+ }
+ }
+
+ private static Path getDefaultConfPath() {
+ String confDir = System.getenv(CONF_FILE_DIR_ENV_NAME);
+ if (confDir == null) {
+ LOG.warn("Cannot find " + CONF_FILE_DIR_ENV_NAME + ", please set it as the dir of " + DEFAULT_PROPERTIES_FILE);
+ return null;
+ }
+ return new Path("file://" + confDir + File.separator + DEFAULT_PROPERTIES_FILE);
+ }
+
+ private String[] splitProperty(String line) {
+ line = line.replaceAll("\\s+"," ");
+ String delimiter = line.contains("=") ? "=" : " ";
+ int ind = line.indexOf(delimiter);
+ String k = line.substring(0, ind).trim();
+ String v = line.substring(ind + 1).trim();
+ return new String[] {k, v};
+ }
+
+ private boolean isValidLine(String line) {
+ if (line.startsWith("#") || line.equals("")) {
Review comment:
Done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-960399716
> @zhedoubushishi would you take this forward? it's close to land from what i see now.
Sorry for the late reply. Will resolve the comments. Thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 577c3ab184befb6173cf3bd3212ef2407cabb94f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 522c1e5aedb862f936756a10509f2f0ff91ad8a8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
zhedoubushishi commented on a change in pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#discussion_r751691310
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java
##########
@@ -117,7 +159,43 @@ public void addProperties(BufferedReader reader) throws IOException {
}
}
- public TypedProperties getConfig() {
- return props;
+ public static TypedProperties getGlobalProps() {
+ final TypedProperties globalProps = new TypedProperties();
+ globalProps.putAll(GLOBAL_PROPS);
+ return globalProps;
+ }
+
+ public TypedProperties getProps() {
+ return new TypedProperties(hoodieConfig.getProps());
+ }
+
+ public TypedProperties getProps(boolean includeGlobalProps) {
+ return new TypedProperties(hoodieConfig.getProps(includeGlobalProps));
+ }
+
+ private static Option<Path> getConfPathFromEnv() {
+ String confDir = System.getenv(CONF_FILE_DIR_ENV_NAME);
+ if (confDir == null) {
+ LOG.warn("Cannot find " + CONF_FILE_DIR_ENV_NAME + ", please set it as the dir of " + DEFAULT_PROPERTIES_FILE);
+ return Option.empty();
Review comment:
Added a test called ```testNoGlobalConfFileConfigured``` to catch when no external config file is configured.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-972305777
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
}, {
"hash" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445",
"triggerID" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-972197041
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
}, {
"hash" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4e63344aa217d0800a7545a5d71db9c2565b182e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413)
* 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-972204156
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
}, {
"hash" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413",
"triggerID" : "4e63344aa217d0800a7545a5d71db9c2565b182e",
"triggerType" : "PUSH"
}, {
"hash" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445",
"triggerID" : "44f4575ea51c6dfdbe6424d0d236b242f8bc81ba",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4e63344aa217d0800a7545a5d71db9c2565b182e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3413)
* 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3445)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 577c3ab184befb6173cf3bd3212ef2407cabb94f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-958627856
@xushiyan : since you have already reviewed this, I will let you drive this home.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 577c3ab184befb6173cf3bd3212ef2407cabb94f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-968060623
Tested scenarios:
1. w/o setting HUDI_CONF_DIR, having issues as reported above. Needs fixing.
2. set proper HUDI_CONF_DIR env, but the dir does not contain the file (hudi-defaults.conf). Again a similar issue. attaching the stack trace below. Needs fixing.
3. Set proper HUDI_CONF_DIR which has hudi-defaults.conf. I see writes picks up the config from this file.
4. same as (3). tried overwriting the config with df.write.hudi for a property thats already in hudi-defaults.conf. The one given in spark-shel with df.write.hudi takes precedence.
5. tried two spark-shells w/ proper env set in both. Both able to pick up the configs from hudi-defaults.conf.
Stacktrace for (2)
```
scala> df.write.format("hudi").
| options(getQuickstartWriteConfigs).
| option(PRECOMBINE_FIELD.key(), "ts").
| option(RECORDKEY_FIELD.key(), "uuid").
| option(PARTITIONPATH_FIELD.key(), "partitionpath").
| option(TBL_NAME.key(), tableName).
| mode(Overwrite).
| save(basePath)
21/11/13 07:18:53 ERROR DFSPropertiesConfiguration: Error reading in properties from dfs
java.io.FileNotFoundException: File file:/tmp/hudi_conf/hudi-defaults.conf does not exist
at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:142)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.addPropsFromFile(DFSPropertiesConfiguration.java:123)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.loadGlobalProps(DFSPropertiesConfiguration.java:92)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.<clinit>(DFSPropertiesConfiguration.java:57)
at org.apache.hudi.HoodieWriterUtils$.parametersWithWriteDefaults(HoodieWriterUtils.scala:47)
at org.apache.hudi.HoodieSparkSqlWriter$.mergeParamsAndGetHoodieConfig(HoodieSparkSqlWriter.scala:733)
at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:88)
at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:162)
at org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:45)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:86)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:127)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:127)
at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:83)
at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:81)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:696)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:696)
at org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:80)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:127)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:75)
at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:696)
at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:305)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:291)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:249)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:55)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:60)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:62)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:64)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:66)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:68)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:70)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:72)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:74)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:76)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:78)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:80)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:82)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:84)
at $line25.$read$$iw$$iw$$iw$$iw$$iw$$iw.<init>(<console>:86)
at $line25.$read$$iw$$iw$$iw$$iw$$iw.<init>(<console>:88)
at $line25.$read$$iw$$iw$$iw$$iw.<init>(<console>:90)
at $line25.$read$$iw$$iw$$iw.<init>(<console>:92)
at $line25.$read$$iw$$iw.<init>(<console>:94)
at $line25.$read$$iw.<init>(<console>:96)
at $line25.$read.<init>(<console>:98)
at $line25.$read$.<init>(<console>:102)
at $line25.$read$.<clinit>(<console>)
at $line25.$eval$.$print$lzycompute(<console>:7)
at $line25.$eval$.$print(<console>:6)
at $line25.$eval.$print(<console>)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call(IMain.scala:793)
at scala.tools.nsc.interpreter.IMain$Request.loadAndRun(IMain.scala:1054)
at scala.tools.nsc.interpreter.IMain$WrappedRequest$$anonfun$loadAndRunReq$1.apply(IMain.scala:645)
at scala.tools.nsc.interpreter.IMain$WrappedRequest$$anonfun$loadAndRunReq$1.apply(IMain.scala:644)
at scala.reflect.internal.util.ScalaClassLoader$class.asContext(ScalaClassLoader.scala:31)
at scala.reflect.internal.util.AbstractFileClassLoader.asContext(AbstractFileClassLoader.scala:19)
at scala.tools.nsc.interpreter.IMain$WrappedRequest.loadAndRunReq(IMain.scala:644)
at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:576)
at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:572)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:819)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:837)
at scala.tools.nsc.interpreter.ILoop.command(ILoop.scala:691)
at scala.tools.nsc.interpreter.ILoop.processLine(ILoop.scala:404)
at scala.tools.nsc.interpreter.ILoop.loop(ILoop.scala:425)
at org.apache.spark.repl.SparkILoop$$anonfun$process$1.apply$mcZ$sp(SparkILoop.scala:285)
at org.apache.spark.repl.SparkILoop.runClosure(SparkILoop.scala:159)
at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:182)
at org.apache.spark.repl.Main$.doMain(Main.scala:78)
at org.apache.spark.repl.Main$.main(Main.scala:58)
at org.apache.spark.repl.Main.main(Main.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
java.lang.IllegalArgumentException: Cannot read properties from dfs
at org.apache.hudi.common.config.DFSPropertiesConfiguration.addPropsFromFile(DFSPropertiesConfiguration.java:132)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.loadGlobalProps(DFSPropertiesConfiguration.java:92)
at org.apache.hudi.common.config.DFSPropertiesConfiguration.<clinit>(DFSPropertiesConfiguration.java:57)
at org.apache.hudi.HoodieWriterUtils$.parametersWithWriteDefaults(HoodieWriterUtils.scala:47)
at org.apache.hudi.HoodieSparkSqlWriter$.mergeParamsAndGetHoodieConfig(HoodieSparkSqlWriter.scala:733)
at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:88)
at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:162)
at org.apache.spark.sql.execution.datasources.SaveIntoDataSourceCommand.run(SaveIntoDataSourceCommand.scala:45)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68)
at org.apache.spark.sql.execution.command.ExecutedCommandExec.doExecute(commands.scala:86)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:127)
at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:127)
at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:83)
at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:81)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:696)
at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:696)
at org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:80)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:127)
at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:75)
at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:696)
at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:305)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:291)
at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:249)
... 68 elided
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2dd5fe4788faf920e276c5ecd755bf5950d55a20 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199)
* b1c19180582fa6f0139b1a897aba36834a5b408f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4949d3827d33e725b2bbba13b9ce15df160d56ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b1c19180582fa6f0139b1a897aba36834a5b408f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515)
* ca2568692241b16928162899d91241a43de870a9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520)
* 4949d3827d33e725b2bbba13b9ce15df160d56ee UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b1c19180582fa6f0139b1a897aba36834a5b408f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515)
* ca2568692241b16928162899d91241a43de870a9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4949d3827d33e725b2bbba13b9ce15df160d56ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521)
* 5f1b6ee1f819a5fa8398417877003ac7c477ca37 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot edited a comment on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-893712830
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4949d3827d33e725b2bbba13b9ce15df160d56ee Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521)
* 5f1b6ee1f819a5fa8398417877003ac7c477ca37 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run travis` re-run the last Travis build
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969031063
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7096b7d991681a65f4597e5ca77ca26bc2be4a48 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338)
* ac0b1acace22b81fa2655f851adeacc4de5733f3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3416:
URL: https://github.com/apache/hudi/pull/3416#issuecomment-969511369
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1412",
"triggerID" : "f0d24f8b17a793c0fc925b75336d17b653102d61",
"triggerType" : "PUSH"
}, {
"hash" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1892",
"triggerID" : "6f020aaf3fb97698240fd5bc82a869f678dc37c9",
"triggerType" : "PUSH"
}, {
"hash" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2197",
"triggerID" : "522c1e5aedb862f936756a10509f2f0ff91ad8a8",
"triggerType" : "PUSH"
}, {
"hash" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2199",
"triggerID" : "2dd5fe4788faf920e276c5ecd755bf5950d55a20",
"triggerType" : "PUSH"
}, {
"hash" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2515",
"triggerID" : "b1c19180582fa6f0139b1a897aba36834a5b408f",
"triggerType" : "PUSH"
}, {
"hash" : "ca2568692241b16928162899d91241a43de870a9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2520",
"triggerID" : "ca2568692241b16928162899d91241a43de870a9",
"triggerType" : "PUSH"
}, {
"hash" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2521",
"triggerID" : "4949d3827d33e725b2bbba13b9ce15df160d56ee",
"triggerType" : "PUSH"
}, {
"hash" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=2524",
"triggerID" : "5f1b6ee1f819a5fa8398417877003ac7c477ca37",
"triggerType" : "PUSH"
}, {
"hash" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3123",
"triggerID" : "577c3ab184befb6173cf3bd3212ef2407cabb94f",
"triggerType" : "PUSH"
}, {
"hash" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3193",
"triggerID" : "570cbac2ed38f2974d1787abc52078a919c6019a",
"triggerType" : "PUSH"
}, {
"hash" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3221",
"triggerID" : "9a2ae3fa48c92e0efb7860ec1b6f83cc4fd726d1",
"triggerType" : "PUSH"
}, {
"hash" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3230",
"triggerID" : "8bc1401bc9ac749b96e900d1763e0a782366f587",
"triggerType" : "PUSH"
}, {
"hash" : "132a035986b5f38b903890f13b98f291fef6a38d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3328",
"triggerID" : "132a035986b5f38b903890f13b98f291fef6a38d",
"triggerType" : "PUSH"
}, {
"hash" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3338",
"triggerID" : "7096b7d991681a65f4597e5ca77ca26bc2be4a48",
"triggerType" : "PUSH"
}, {
"hash" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3382",
"triggerID" : "ac0b1acace22b81fa2655f851adeacc4de5733f3",
"triggerType" : "PUSH"
}, {
"hash" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396",
"triggerID" : "f6e072b53f37544aef6194bfde7868162da1ac39",
"triggerType" : "PUSH"
}, {
"hash" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398",
"triggerID" : "c3c27d6062111b539575c342b4ea1d5e3057bd7c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f6e072b53f37544aef6194bfde7868162da1ac39 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3396)
* c3c27d6062111b539575c342b4ea1d5e3057bd7c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3398)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org