You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2022/03/01 12:06:13 UTC
[GitHub] [flink] slinkydeveloper opened a new pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
slinkydeveloper opened a new pull request #18940:
URL: https://github.com/apache/flink/pull/18940
This PR includes two commits to port `BuiltInFunctionsTestBase` and `BuiltInAggregateFunctionsTestBase` to JUnit 5 and run those tests in parallel
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] slinkydeveloper commented on a change in pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
slinkydeveloper commented on a change in pull request #18940:
URL: https://github.com/apache/flink/pull/18940#discussion_r829779528
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/FieldAccessFromTableITCase.java
##########
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.table.planner.functions;
+
+import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
+import org.apache.flink.types.Row;
+
+import java.util.stream.Stream;
+
+import static java.util.Collections.singletonMap;
+import static org.apache.flink.table.api.DataTypes.ARRAY;
+import static org.apache.flink.table.api.DataTypes.BIGINT;
+import static org.apache.flink.table.api.DataTypes.FIELD;
+import static org.apache.flink.table.api.DataTypes.MAP;
+import static org.apache.flink.table.api.DataTypes.ROW;
+import static org.apache.flink.table.api.DataTypes.STRING;
+import static org.apache.flink.table.api.Expressions.$;
+
+/**
+ * Regular tests. See also {@link ConstructedAccessFunctionsITCase} for tests that access a nested
+ * field of an expression or for {@link BuiltInFunctionDefinitions#FLATTEN} which produces multiple
+ * columns from a single one.
+ */
+class FieldAccessFromTableITCase extends BuiltInFunctionTestBase {
+
+ @Override
+ public Stream<TestSetSpec> getTestCaseSpecs() {
+ return Stream.of(
+
+ // Actually in case of SQL it does not use the GET method, but
+ // a custom logic for accessing nested fields of a Table.
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.GET)
+ .onFieldsWithData(null, Row.of(1))
+ .andDataTypes(
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ .testResult(
+ resultSpec(
+ $("f0").get("nested"),
+ "f0.nested",
+ null,
+ BIGINT().nullable()),
+ resultSpec(
+ $("f1").get("nested"),
+ "f1.nested",
+ 1L,
+ BIGINT().notNull())),
+
+ // In Calcite it maps to FlinkSqlOperatorTable.ITEM
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.AT)
+ .onFieldsWithData(
+ null,
+ new int[] {1},
+ null,
+ singletonMap("nested", 1),
+ null,
+ Row.of(1))
+ .andDataTypes(
+ ARRAY(BIGINT().notNull()).nullable(),
+ ARRAY(BIGINT().notNull()).notNull(),
+ MAP(STRING(), BIGINT().notNull()).nullable(),
+ MAP(STRING(), BIGINT().notNull()).notNull(),
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ // accessing elements of MAP or ARRAY is a runtime operations,
+ // we do not know about the size or contents during the inference
+ // therefore the results are always nullable
+ .testResult(
+ resultSpec($("f0").at(1), "f0[1]", null, BIGINT().nullable()),
Review comment:
in this case i'm not sure it does. `testResult` is either a vararg of result spec or a function taking 5 args. I rather prefer to keep it as it is.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] twalthr closed pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
twalthr closed pull request #18940:
URL: https://github.com/apache/flink/pull/18940
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] slinkydeveloper commented on a change in pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
slinkydeveloper commented on a change in pull request #18940:
URL: https://github.com/apache/flink/pull/18940#discussion_r829779528
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/FieldAccessFromTableITCase.java
##########
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.table.planner.functions;
+
+import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
+import org.apache.flink.types.Row;
+
+import java.util.stream.Stream;
+
+import static java.util.Collections.singletonMap;
+import static org.apache.flink.table.api.DataTypes.ARRAY;
+import static org.apache.flink.table.api.DataTypes.BIGINT;
+import static org.apache.flink.table.api.DataTypes.FIELD;
+import static org.apache.flink.table.api.DataTypes.MAP;
+import static org.apache.flink.table.api.DataTypes.ROW;
+import static org.apache.flink.table.api.DataTypes.STRING;
+import static org.apache.flink.table.api.Expressions.$;
+
+/**
+ * Regular tests. See also {@link ConstructedAccessFunctionsITCase} for tests that access a nested
+ * field of an expression or for {@link BuiltInFunctionDefinitions#FLATTEN} which produces multiple
+ * columns from a single one.
+ */
+class FieldAccessFromTableITCase extends BuiltInFunctionTestBase {
+
+ @Override
+ public Stream<TestSetSpec> getTestCaseSpecs() {
+ return Stream.of(
+
+ // Actually in case of SQL it does not use the GET method, but
+ // a custom logic for accessing nested fields of a Table.
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.GET)
+ .onFieldsWithData(null, Row.of(1))
+ .andDataTypes(
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ .testResult(
+ resultSpec(
+ $("f0").get("nested"),
+ "f0.nested",
+ null,
+ BIGINT().nullable()),
+ resultSpec(
+ $("f1").get("nested"),
+ "f1.nested",
+ 1L,
+ BIGINT().notNull())),
+
+ // In Calcite it maps to FlinkSqlOperatorTable.ITEM
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.AT)
+ .onFieldsWithData(
+ null,
+ new int[] {1},
+ null,
+ singletonMap("nested", 1),
+ null,
+ Row.of(1))
+ .andDataTypes(
+ ARRAY(BIGINT().notNull()).nullable(),
+ ARRAY(BIGINT().notNull()).notNull(),
+ MAP(STRING(), BIGINT().notNull()).nullable(),
+ MAP(STRING(), BIGINT().notNull()).notNull(),
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ // accessing elements of MAP or ARRAY is a runtime operations,
+ // we do not know about the size or contents during the inference
+ // therefore the results are always nullable
+ .testResult(
+ resultSpec($("f0").at(1), "f0[1]", null, BIGINT().nullable()),
Review comment:
in this case i'm not sure it does. `testResult` is either a vararg of result spec or a function taking 5 args, but here the args are 4. I rather prefer to keep it as it is.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1062782029",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] slinkydeveloper commented on a change in pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
slinkydeveloper commented on a change in pull request #18940:
URL: https://github.com/apache/flink/pull/18940#discussion_r830146603
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/FieldAccessFromTableITCase.java
##########
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.table.planner.functions;
+
+import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
+import org.apache.flink.types.Row;
+
+import java.util.stream.Stream;
+
+import static java.util.Collections.singletonMap;
+import static org.apache.flink.table.api.DataTypes.ARRAY;
+import static org.apache.flink.table.api.DataTypes.BIGINT;
+import static org.apache.flink.table.api.DataTypes.FIELD;
+import static org.apache.flink.table.api.DataTypes.MAP;
+import static org.apache.flink.table.api.DataTypes.ROW;
+import static org.apache.flink.table.api.DataTypes.STRING;
+import static org.apache.flink.table.api.Expressions.$;
+
+/**
+ * Regular tests. See also {@link ConstructedAccessFunctionsITCase} for tests that access a nested
+ * field of an expression or for {@link BuiltInFunctionDefinitions#FLATTEN} which produces multiple
+ * columns from a single one.
+ */
+class FieldAccessFromTableITCase extends BuiltInFunctionTestBase {
+
+ @Override
+ public Stream<TestSetSpec> getTestCaseSpecs() {
+ return Stream.of(
+
+ // Actually in case of SQL it does not use the GET method, but
+ // a custom logic for accessing nested fields of a Table.
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.GET)
+ .onFieldsWithData(null, Row.of(1))
+ .andDataTypes(
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ .testResult(
+ resultSpec(
+ $("f0").get("nested"),
+ "f0.nested",
+ null,
+ BIGINT().nullable()),
+ resultSpec(
+ $("f1").get("nested"),
+ "f1.nested",
+ 1L,
+ BIGINT().notNull())),
+
+ // In Calcite it maps to FlinkSqlOperatorTable.ITEM
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.AT)
+ .onFieldsWithData(
+ null,
+ new int[] {1},
+ null,
+ singletonMap("nested", 1),
+ null,
+ Row.of(1))
+ .andDataTypes(
+ ARRAY(BIGINT().notNull()).nullable(),
+ ARRAY(BIGINT().notNull()).notNull(),
+ MAP(STRING(), BIGINT().notNull()).nullable(),
+ MAP(STRING(), BIGINT().notNull()).notNull(),
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ // accessing elements of MAP or ARRAY is a runtime operations,
+ // we do not know about the size or contents during the inference
+ // therefore the results are always nullable
+ .testResult(
+ resultSpec($("f0").at(1), "f0[1]", null, BIGINT().nullable()),
Review comment:
ops sorry I haven't seen it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1062782029",
"triggerType" : "MANUAL"
}, {
"hash" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33186",
"triggerID" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"triggerType" : "PUSH"
}, {
"hash" : "404cfea3428975626f8c5647653d0c92e0484222",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33310",
"triggerID" : "404cfea3428975626f8c5647653d0c92e0484222",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 404cfea3428975626f8c5647653d0c92e0484222 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33310)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1062782029",
"triggerType" : "MANUAL"
}, {
"hash" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33186",
"triggerID" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"triggerType" : "PUSH"
}, {
"hash" : "404cfea3428975626f8c5647653d0c92e0484222",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33310",
"triggerID" : "404cfea3428975626f8c5647653d0c92e0484222",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7d1c4e4dfd01c73a1efca7c7cbed0dee61824770 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33186)
* 404cfea3428975626f8c5647653d0c92e0484222 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33310)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] twalthr commented on a change in pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
twalthr commented on a change in pull request #18940:
URL: https://github.com/apache/flink/pull/18940#discussion_r829748153
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/BuiltInFunctionTestBase.java
##########
@@ -60,127 +62,68 @@
import static org.assertj.core.api.Assertions.catchThrowable;
/**
- * Test base for testing {@link BuiltInFunctionDefinition}.
+ * Test interface implementing the logic to execute tests for {@link BuiltInFunctionDefinition}.
+ *
+ * <p>To create a new set of test cases, just create a subclass and implement the method {@link
+ * #getTestCaseSpecs()}.
*
* <p>Note: This test base is not the most efficient one. It currently checks the full pipeline
* end-to-end. If the testing time is too long, we can change the underlying implementation easily
- * without touching the defined {@link TestSpec}s.
+ * without touching the defined {@link TestSetSpec}s.
*/
-@RunWith(Parameterized.class)
-public abstract class BuiltInFunctionTestBase {
+@Execution(ExecutionMode.CONCURRENT)
+@TestInstance(TestInstance.Lifecycle.PER_CLASS)
+@ExtendWith(MiniClusterExtension.class)
+abstract class BuiltInFunctionTestBase {
- @ClassRule
- public static MiniClusterWithClientResource miniClusterResource =
- new MiniClusterWithClientResource(
- new MiniClusterResourceConfiguration.Builder()
- .setNumberTaskManagers(1)
- .setNumberSlotsPerTaskManager(1)
- .build());
+ Configuration getConfiguration() {
+ return new Configuration();
+ }
- @Parameter public TestSpec testSpec;
+ abstract Stream<TestSetSpec> getTestCaseSpecs();
Review comment:
`getTestSetSpecs `
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/BuiltInFunctionTestBase.java
##########
@@ -342,18 +286,53 @@ TestSpec testResult(
return this;
}
+ Stream<TestCase> getTestCases(Configuration configuration) {
+ return testItems.stream().map(testItem -> getTestCase(configuration, testItem));
+ }
+
+ private TestCase getTestCase(Configuration configuration, TestItem testItem) {
+ return new TestCase(
+ testItem.toString(),
+ () -> {
+ final TableEnvironmentInternal env =
Review comment:
I don't remember but is there an actual reason for `TableEnvironmentInternal` otherwise let's expose only `TableEnvironment`.
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/BuiltInFunctionTestBase.java
##########
@@ -342,18 +286,53 @@ TestSpec testResult(
return this;
}
+ Stream<TestCase> getTestCases(Configuration configuration) {
Review comment:
private?
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/BuiltInFunctionTestBase.java
##########
@@ -342,18 +286,53 @@ TestSpec testResult(
return this;
}
+ Stream<TestCase> getTestCases(Configuration configuration) {
+ return testItems.stream().map(testItem -> getTestCase(configuration, testItem));
+ }
+
+ private TestCase getTestCase(Configuration configuration, TestItem testItem) {
+ return new TestCase(
+ testItem.toString(),
+ () -> {
+ final TableEnvironmentInternal env =
+ (TableEnvironmentInternal)
+ TableEnvironment.create(
+ EnvironmentSettings.newInstance().build());
+ env.getConfig().addConfiguration(configuration);
+
+ functions.forEach(
+ f -> env.createTemporarySystemFunction(f.getSimpleName(), f));
+
+ final Table inputTable;
+ if (fieldDataTypes == null) {
+ inputTable = env.fromValues(Row.of(fieldData));
+ } else {
+ final DataTypes.UnresolvedField[] fields =
+ IntStream.range(0, fieldDataTypes.length)
+ .mapToObj(
+ i ->
+ DataTypes.FIELD(
+ "f" + i, fieldDataTypes[i]))
+ .toArray(DataTypes.UnresolvedField[]::new);
+ inputTable = env.fromValues(DataTypes.ROW(fields), Row.of(fieldData));
+ }
+
+ testItem.test(env, inputTable);
+ });
+ }
+
@Override
public String toString() {
return (definition != null ? definition.getName() : "Expression")
+ (description != null ? " : " + description : "");
}
}
- private interface TestItem {
- // marker interface
+ interface TestItem {
Review comment:
why not private? also below
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/runtime/stream/sql/FunctionITCase.java
##########
@@ -72,7 +71,8 @@
* Tests for catalog and system functions in a table environment.
*
* <p>Note: This class is meant for testing the core function support. Use {@link
- * BuiltInFunctionTestBase} for testing individual function implementations.
+ * org.apache.flink.table.planner.functions.BuiltInFunctionTestBase} for testing individual function
Review comment:
Undo this change
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/FieldAccessFromTableITCase.java
##########
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.table.planner.functions;
+
+import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
+import org.apache.flink.types.Row;
+
+import java.util.stream.Stream;
+
+import static java.util.Collections.singletonMap;
+import static org.apache.flink.table.api.DataTypes.ARRAY;
+import static org.apache.flink.table.api.DataTypes.BIGINT;
+import static org.apache.flink.table.api.DataTypes.FIELD;
+import static org.apache.flink.table.api.DataTypes.MAP;
+import static org.apache.flink.table.api.DataTypes.ROW;
+import static org.apache.flink.table.api.DataTypes.STRING;
+import static org.apache.flink.table.api.Expressions.$;
+
+/**
+ * Regular tests. See also {@link ConstructedAccessFunctionsITCase} for tests that access a nested
+ * field of an expression or for {@link BuiltInFunctionDefinitions#FLATTEN} which produces multiple
+ * columns from a single one.
+ */
+class FieldAccessFromTableITCase extends BuiltInFunctionTestBase {
Review comment:
What is the current status of the MiniCluster? Will it be reused across tests nowadays? Because in the past the guideline was to not create too many classes as the cluster init is expensive. This is why summarized functions into one class in the past.
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/CoalesceFunctionITCase.java
##########
@@ -20,23 +20,20 @@
import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
-import org.junit.runners.Parameterized;
-
-import java.util.Collections;
-import java.util.List;
+import java.util.stream.Stream;
import static org.apache.flink.table.api.DataTypes.BIGINT;
import static org.apache.flink.table.api.DataTypes.INT;
import static org.apache.flink.table.api.Expressions.$;
import static org.apache.flink.table.api.Expressions.coalesce;
/** Test {@link BuiltInFunctionDefinitions#COALESCE} and its return type. */
-public class CoalesceFunctionITCase extends BuiltInFunctionTestBase {
+class CoalesceFunctionITCase extends BuiltInFunctionTestBase {
- @Parameterized.Parameters(name = "{index}: {0}")
- public static List<TestSpec> testData() {
- return Collections.singletonList(
- TestSpec.forFunction(BuiltInFunctionDefinitions.COALESCE)
+ @Override
+ public Stream<TestSetSpec> getTestCaseSpecs() {
Review comment:
could also be default scoped?
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/FieldAccessFromTableITCase.java
##########
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.table.planner.functions;
+
+import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
+import org.apache.flink.types.Row;
+
+import java.util.stream.Stream;
+
+import static java.util.Collections.singletonMap;
+import static org.apache.flink.table.api.DataTypes.ARRAY;
+import static org.apache.flink.table.api.DataTypes.BIGINT;
+import static org.apache.flink.table.api.DataTypes.FIELD;
+import static org.apache.flink.table.api.DataTypes.MAP;
+import static org.apache.flink.table.api.DataTypes.ROW;
+import static org.apache.flink.table.api.DataTypes.STRING;
+import static org.apache.flink.table.api.Expressions.$;
+
+/**
+ * Regular tests. See also {@link ConstructedAccessFunctionsITCase} for tests that access a nested
+ * field of an expression or for {@link BuiltInFunctionDefinitions#FLATTEN} which produces multiple
+ * columns from a single one.
+ */
+class FieldAccessFromTableITCase extends BuiltInFunctionTestBase {
+
+ @Override
+ public Stream<TestSetSpec> getTestCaseSpecs() {
+ return Stream.of(
+
+ // Actually in case of SQL it does not use the GET method, but
+ // a custom logic for accessing nested fields of a Table.
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.GET)
+ .onFieldsWithData(null, Row.of(1))
+ .andDataTypes(
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ .testResult(
+ resultSpec(
+ $("f0").get("nested"),
+ "f0.nested",
+ null,
+ BIGINT().nullable()),
+ resultSpec(
+ $("f1").get("nested"),
+ "f1.nested",
+ 1L,
+ BIGINT().notNull())),
+
+ // In Calcite it maps to FlinkSqlOperatorTable.ITEM
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.AT)
+ .onFieldsWithData(
+ null,
+ new int[] {1},
+ null,
+ singletonMap("nested", 1),
+ null,
+ Row.of(1))
+ .andDataTypes(
+ ARRAY(BIGINT().notNull()).nullable(),
+ ARRAY(BIGINT().notNull()).notNull(),
+ MAP(STRING(), BIGINT().notNull()).nullable(),
+ MAP(STRING(), BIGINT().notNull()).notNull(),
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ // accessing elements of MAP or ARRAY is a runtime operations,
+ // we do not know about the size or contents during the inference
+ // therefore the results are always nullable
+ .testResult(
+ resultSpec($("f0").at(1), "f0[1]", null, BIGINT().nullable()),
Review comment:
remove the outer `resultSpec(...)`, `testResult` can take it directly. also in other tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1062782029",
"triggerType" : "MANUAL"
}, {
"hash" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33186",
"triggerID" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"triggerType" : "PUSH"
}, {
"hash" : "404cfea3428975626f8c5647653d0c92e0484222",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "404cfea3428975626f8c5647653d0c92e0484222",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7d1c4e4dfd01c73a1efca7c7cbed0dee61824770 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33186)
* 404cfea3428975626f8c5647653d0c92e0484222 UNKNOWN
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 663b6b624d14af7765d1ab09bf4a64fb684f6d65 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358)
* b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d UNKNOWN
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] slinkydeveloper commented on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
slinkydeveloper commented on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1062782029
@flinkbot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] twalthr commented on a change in pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
twalthr commented on a change in pull request #18940:
URL: https://github.com/apache/flink/pull/18940#discussion_r829748153
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/BuiltInFunctionTestBase.java
##########
@@ -60,127 +62,68 @@
import static org.assertj.core.api.Assertions.catchThrowable;
/**
- * Test base for testing {@link BuiltInFunctionDefinition}.
+ * Test interface implementing the logic to execute tests for {@link BuiltInFunctionDefinition}.
+ *
+ * <p>To create a new set of test cases, just create a subclass and implement the method {@link
+ * #getTestCaseSpecs()}.
*
* <p>Note: This test base is not the most efficient one. It currently checks the full pipeline
* end-to-end. If the testing time is too long, we can change the underlying implementation easily
- * without touching the defined {@link TestSpec}s.
+ * without touching the defined {@link TestSetSpec}s.
*/
-@RunWith(Parameterized.class)
-public abstract class BuiltInFunctionTestBase {
+@Execution(ExecutionMode.CONCURRENT)
+@TestInstance(TestInstance.Lifecycle.PER_CLASS)
+@ExtendWith(MiniClusterExtension.class)
+abstract class BuiltInFunctionTestBase {
- @ClassRule
- public static MiniClusterWithClientResource miniClusterResource =
- new MiniClusterWithClientResource(
- new MiniClusterResourceConfiguration.Builder()
- .setNumberTaskManagers(1)
- .setNumberSlotsPerTaskManager(1)
- .build());
+ Configuration getConfiguration() {
+ return new Configuration();
+ }
- @Parameter public TestSpec testSpec;
+ abstract Stream<TestSetSpec> getTestCaseSpecs();
Review comment:
`getTestSetSpecs `
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/BuiltInFunctionTestBase.java
##########
@@ -342,18 +286,53 @@ TestSpec testResult(
return this;
}
+ Stream<TestCase> getTestCases(Configuration configuration) {
+ return testItems.stream().map(testItem -> getTestCase(configuration, testItem));
+ }
+
+ private TestCase getTestCase(Configuration configuration, TestItem testItem) {
+ return new TestCase(
+ testItem.toString(),
+ () -> {
+ final TableEnvironmentInternal env =
Review comment:
I don't remember but is there an actual reason for `TableEnvironmentInternal` otherwise let's expose only `TableEnvironment`.
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/BuiltInFunctionTestBase.java
##########
@@ -342,18 +286,53 @@ TestSpec testResult(
return this;
}
+ Stream<TestCase> getTestCases(Configuration configuration) {
Review comment:
private?
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/BuiltInFunctionTestBase.java
##########
@@ -342,18 +286,53 @@ TestSpec testResult(
return this;
}
+ Stream<TestCase> getTestCases(Configuration configuration) {
+ return testItems.stream().map(testItem -> getTestCase(configuration, testItem));
+ }
+
+ private TestCase getTestCase(Configuration configuration, TestItem testItem) {
+ return new TestCase(
+ testItem.toString(),
+ () -> {
+ final TableEnvironmentInternal env =
+ (TableEnvironmentInternal)
+ TableEnvironment.create(
+ EnvironmentSettings.newInstance().build());
+ env.getConfig().addConfiguration(configuration);
+
+ functions.forEach(
+ f -> env.createTemporarySystemFunction(f.getSimpleName(), f));
+
+ final Table inputTable;
+ if (fieldDataTypes == null) {
+ inputTable = env.fromValues(Row.of(fieldData));
+ } else {
+ final DataTypes.UnresolvedField[] fields =
+ IntStream.range(0, fieldDataTypes.length)
+ .mapToObj(
+ i ->
+ DataTypes.FIELD(
+ "f" + i, fieldDataTypes[i]))
+ .toArray(DataTypes.UnresolvedField[]::new);
+ inputTable = env.fromValues(DataTypes.ROW(fields), Row.of(fieldData));
+ }
+
+ testItem.test(env, inputTable);
+ });
+ }
+
@Override
public String toString() {
return (definition != null ? definition.getName() : "Expression")
+ (description != null ? " : " + description : "");
}
}
- private interface TestItem {
- // marker interface
+ interface TestItem {
Review comment:
why not private? also below
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/runtime/stream/sql/FunctionITCase.java
##########
@@ -72,7 +71,8 @@
* Tests for catalog and system functions in a table environment.
*
* <p>Note: This class is meant for testing the core function support. Use {@link
- * BuiltInFunctionTestBase} for testing individual function implementations.
+ * org.apache.flink.table.planner.functions.BuiltInFunctionTestBase} for testing individual function
Review comment:
Undo this change
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/FieldAccessFromTableITCase.java
##########
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.table.planner.functions;
+
+import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
+import org.apache.flink.types.Row;
+
+import java.util.stream.Stream;
+
+import static java.util.Collections.singletonMap;
+import static org.apache.flink.table.api.DataTypes.ARRAY;
+import static org.apache.flink.table.api.DataTypes.BIGINT;
+import static org.apache.flink.table.api.DataTypes.FIELD;
+import static org.apache.flink.table.api.DataTypes.MAP;
+import static org.apache.flink.table.api.DataTypes.ROW;
+import static org.apache.flink.table.api.DataTypes.STRING;
+import static org.apache.flink.table.api.Expressions.$;
+
+/**
+ * Regular tests. See also {@link ConstructedAccessFunctionsITCase} for tests that access a nested
+ * field of an expression or for {@link BuiltInFunctionDefinitions#FLATTEN} which produces multiple
+ * columns from a single one.
+ */
+class FieldAccessFromTableITCase extends BuiltInFunctionTestBase {
Review comment:
What is the current status of the MiniCluster? Will it be reused across tests nowadays? Because in the past the guideline was to not create too many classes as the cluster init is expensive. This is why summarized functions into one class in the past.
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/CoalesceFunctionITCase.java
##########
@@ -20,23 +20,20 @@
import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
-import org.junit.runners.Parameterized;
-
-import java.util.Collections;
-import java.util.List;
+import java.util.stream.Stream;
import static org.apache.flink.table.api.DataTypes.BIGINT;
import static org.apache.flink.table.api.DataTypes.INT;
import static org.apache.flink.table.api.Expressions.$;
import static org.apache.flink.table.api.Expressions.coalesce;
/** Test {@link BuiltInFunctionDefinitions#COALESCE} and its return type. */
-public class CoalesceFunctionITCase extends BuiltInFunctionTestBase {
+class CoalesceFunctionITCase extends BuiltInFunctionTestBase {
- @Parameterized.Parameters(name = "{index}: {0}")
- public static List<TestSpec> testData() {
- return Collections.singletonList(
- TestSpec.forFunction(BuiltInFunctionDefinitions.COALESCE)
+ @Override
+ public Stream<TestSetSpec> getTestCaseSpecs() {
Review comment:
could also be default scoped?
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/FieldAccessFromTableITCase.java
##########
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.table.planner.functions;
+
+import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
+import org.apache.flink.types.Row;
+
+import java.util.stream.Stream;
+
+import static java.util.Collections.singletonMap;
+import static org.apache.flink.table.api.DataTypes.ARRAY;
+import static org.apache.flink.table.api.DataTypes.BIGINT;
+import static org.apache.flink.table.api.DataTypes.FIELD;
+import static org.apache.flink.table.api.DataTypes.MAP;
+import static org.apache.flink.table.api.DataTypes.ROW;
+import static org.apache.flink.table.api.DataTypes.STRING;
+import static org.apache.flink.table.api.Expressions.$;
+
+/**
+ * Regular tests. See also {@link ConstructedAccessFunctionsITCase} for tests that access a nested
+ * field of an expression or for {@link BuiltInFunctionDefinitions#FLATTEN} which produces multiple
+ * columns from a single one.
+ */
+class FieldAccessFromTableITCase extends BuiltInFunctionTestBase {
+
+ @Override
+ public Stream<TestSetSpec> getTestCaseSpecs() {
+ return Stream.of(
+
+ // Actually in case of SQL it does not use the GET method, but
+ // a custom logic for accessing nested fields of a Table.
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.GET)
+ .onFieldsWithData(null, Row.of(1))
+ .andDataTypes(
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ .testResult(
+ resultSpec(
+ $("f0").get("nested"),
+ "f0.nested",
+ null,
+ BIGINT().nullable()),
+ resultSpec(
+ $("f1").get("nested"),
+ "f1.nested",
+ 1L,
+ BIGINT().notNull())),
+
+ // In Calcite it maps to FlinkSqlOperatorTable.ITEM
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.AT)
+ .onFieldsWithData(
+ null,
+ new int[] {1},
+ null,
+ singletonMap("nested", 1),
+ null,
+ Row.of(1))
+ .andDataTypes(
+ ARRAY(BIGINT().notNull()).nullable(),
+ ARRAY(BIGINT().notNull()).notNull(),
+ MAP(STRING(), BIGINT().notNull()).nullable(),
+ MAP(STRING(), BIGINT().notNull()).notNull(),
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ // accessing elements of MAP or ARRAY is a runtime operations,
+ // we do not know about the size or contents during the inference
+ // therefore the results are always nullable
+ .testResult(
+ resultSpec($("f0").at(1), "f0[1]", null, BIGINT().nullable()),
Review comment:
remove the outer `resultSpec(...)`, `testResult` can take it directly. also in other tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 663b6b624d14af7765d1ab09bf4a64fb684f6d65 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 663b6b624d14af7765d1ab09bf4a64fb684f6d65 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358)
* b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1062782029",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1062782029",
"triggerType" : "MANUAL"
}, {
"hash" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380)
* 7d1c4e4dfd01c73a1efca7c7cbed0dee61824770 UNKNOWN
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] slinkydeveloper commented on a change in pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
slinkydeveloper commented on a change in pull request #18940:
URL: https://github.com/apache/flink/pull/18940#discussion_r829774256
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/BuiltInFunctionTestBase.java
##########
@@ -342,18 +286,53 @@ TestSpec testResult(
return this;
}
+ Stream<TestCase> getTestCases(Configuration configuration) {
+ return testItems.stream().map(testItem -> getTestCase(configuration, testItem));
+ }
+
+ private TestCase getTestCase(Configuration configuration, TestItem testItem) {
+ return new TestCase(
+ testItem.toString(),
+ () -> {
+ final TableEnvironmentInternal env =
Review comment:
It's needed to access the catalog manager to manually run the type inference, check line 353 of this class
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] slinkydeveloper commented on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
slinkydeveloper commented on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1056792476
@flinkbot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] slinkydeveloper commented on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
slinkydeveloper commented on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1057193688
Run 3 times in my local CI, all green:
* https://dev.azure.com/francescoguard/Flink/_build/results?buildId=764&view=results
* https://dev.azure.com/francescoguard/Flink/_build/results?buildId=773&view=results
* https://dev.azure.com/francescoguard/Flink/_build/results?buildId=774&view=results
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] slinkydeveloper commented on a change in pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
slinkydeveloper commented on a change in pull request #18940:
URL: https://github.com/apache/flink/pull/18940#discussion_r829780969
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/runtime/stream/sql/FunctionITCase.java
##########
@@ -72,7 +71,8 @@
* Tests for catalog and system functions in a table environment.
*
* <p>Note: This class is meant for testing the core function support. Use {@link
- * BuiltInFunctionTestBase} for testing individual function implementations.
+ * org.apache.flink.table.planner.functions.BuiltInFunctionTestBase} for testing individual function
Review comment:
I can't, because of the changed visibility of BuiltInFunctionTestBase
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1062782029",
"triggerType" : "MANUAL"
}, {
"hash" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33186",
"triggerID" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7d1c4e4dfd01c73a1efca7c7cbed0dee61824770 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33186)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] twalthr commented on a change in pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
twalthr commented on a change in pull request #18940:
URL: https://github.com/apache/flink/pull/18940#discussion_r830092130
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/FieldAccessFromTableITCase.java
##########
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.table.planner.functions;
+
+import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
+import org.apache.flink.types.Row;
+
+import java.util.stream.Stream;
+
+import static java.util.Collections.singletonMap;
+import static org.apache.flink.table.api.DataTypes.ARRAY;
+import static org.apache.flink.table.api.DataTypes.BIGINT;
+import static org.apache.flink.table.api.DataTypes.FIELD;
+import static org.apache.flink.table.api.DataTypes.MAP;
+import static org.apache.flink.table.api.DataTypes.ROW;
+import static org.apache.flink.table.api.DataTypes.STRING;
+import static org.apache.flink.table.api.Expressions.$;
+
+/**
+ * Regular tests. See also {@link ConstructedAccessFunctionsITCase} for tests that access a nested
+ * field of an expression or for {@link BuiltInFunctionDefinitions#FLATTEN} which produces multiple
+ * columns from a single one.
+ */
+class FieldAccessFromTableITCase extends BuiltInFunctionTestBase {
+
+ @Override
+ public Stream<TestSetSpec> getTestCaseSpecs() {
+ return Stream.of(
+
+ // Actually in case of SQL it does not use the GET method, but
+ // a custom logic for accessing nested fields of a Table.
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.GET)
+ .onFieldsWithData(null, Row.of(1))
+ .andDataTypes(
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ .testResult(
+ resultSpec(
+ $("f0").get("nested"),
+ "f0.nested",
+ null,
+ BIGINT().nullable()),
+ resultSpec(
+ $("f1").get("nested"),
+ "f1.nested",
+ 1L,
+ BIGINT().notNull())),
+
+ // In Calcite it maps to FlinkSqlOperatorTable.ITEM
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.AT)
+ .onFieldsWithData(
+ null,
+ new int[] {1},
+ null,
+ singletonMap("nested", 1),
+ null,
+ Row.of(1))
+ .andDataTypes(
+ ARRAY(BIGINT().notNull()).nullable(),
+ ARRAY(BIGINT().notNull()).notNull(),
+ MAP(STRING(), BIGINT().notNull()).nullable(),
+ MAP(STRING(), BIGINT().notNull()).notNull(),
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ // accessing elements of MAP or ARRAY is a runtime operations,
+ // we do not know about the size or contents during the inference
+ // therefore the results are always nullable
+ .testResult(
+ resultSpec($("f0").at(1), "f0[1]", null, BIGINT().nullable()),
Review comment:
`BuiltInFunctionTestBase.TestSpec#testResult(org.apache.flink.table.expressions.Expression, java.lang.String, java.lang.Object, org.apache.flink.table.types.AbstractDataType<?>)` has 4 args as well.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1062782029",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1062782029",
"triggerType" : "MANUAL"
}, {
"hash" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33186",
"triggerID" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380)
* 7d1c4e4dfd01c73a1efca7c7cbed0dee61824770 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33186)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] slinkydeveloper commented on a change in pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
slinkydeveloper commented on a change in pull request #18940:
URL: https://github.com/apache/flink/pull/18940#discussion_r829778152
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/FieldAccessFromTableITCase.java
##########
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.table.planner.functions;
+
+import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
+import org.apache.flink.types.Row;
+
+import java.util.stream.Stream;
+
+import static java.util.Collections.singletonMap;
+import static org.apache.flink.table.api.DataTypes.ARRAY;
+import static org.apache.flink.table.api.DataTypes.BIGINT;
+import static org.apache.flink.table.api.DataTypes.FIELD;
+import static org.apache.flink.table.api.DataTypes.MAP;
+import static org.apache.flink.table.api.DataTypes.ROW;
+import static org.apache.flink.table.api.DataTypes.STRING;
+import static org.apache.flink.table.api.Expressions.$;
+
+/**
+ * Regular tests. See also {@link ConstructedAccessFunctionsITCase} for tests that access a nested
+ * field of an expression or for {@link BuiltInFunctionDefinitions#FLATTEN} which produces multiple
+ * columns from a single one.
+ */
+class FieldAccessFromTableITCase extends BuiltInFunctionTestBase {
Review comment:
With this re-org each class extending from `BuiltInFunctionTestBase` will have its own `MiniCluster`, and the same `MiniCluster` is reused across all test cases
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] slinkydeveloper commented on a change in pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
slinkydeveloper commented on a change in pull request #18940:
URL: https://github.com/apache/flink/pull/18940#discussion_r829774256
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/BuiltInFunctionTestBase.java
##########
@@ -342,18 +286,53 @@ TestSpec testResult(
return this;
}
+ Stream<TestCase> getTestCases(Configuration configuration) {
+ return testItems.stream().map(testItem -> getTestCase(configuration, testItem));
+ }
+
+ private TestCase getTestCase(Configuration configuration, TestItem testItem) {
+ return new TestCase(
+ testItem.toString(),
+ () -> {
+ final TableEnvironmentInternal env =
Review comment:
It's needed to access the catalog manager to manually run the type inference, check line 353 of this class
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/FieldAccessFromTableITCase.java
##########
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.table.planner.functions;
+
+import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
+import org.apache.flink.types.Row;
+
+import java.util.stream.Stream;
+
+import static java.util.Collections.singletonMap;
+import static org.apache.flink.table.api.DataTypes.ARRAY;
+import static org.apache.flink.table.api.DataTypes.BIGINT;
+import static org.apache.flink.table.api.DataTypes.FIELD;
+import static org.apache.flink.table.api.DataTypes.MAP;
+import static org.apache.flink.table.api.DataTypes.ROW;
+import static org.apache.flink.table.api.DataTypes.STRING;
+import static org.apache.flink.table.api.Expressions.$;
+
+/**
+ * Regular tests. See also {@link ConstructedAccessFunctionsITCase} for tests that access a nested
+ * field of an expression or for {@link BuiltInFunctionDefinitions#FLATTEN} which produces multiple
+ * columns from a single one.
+ */
+class FieldAccessFromTableITCase extends BuiltInFunctionTestBase {
Review comment:
With this re-org each class extending from `BuiltInFunctionTestBase` will have its own `MiniCluster`, and the same `MiniCluster` is reused across all test cases
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/FieldAccessFromTableITCase.java
##########
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.table.planner.functions;
+
+import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
+import org.apache.flink.types.Row;
+
+import java.util.stream.Stream;
+
+import static java.util.Collections.singletonMap;
+import static org.apache.flink.table.api.DataTypes.ARRAY;
+import static org.apache.flink.table.api.DataTypes.BIGINT;
+import static org.apache.flink.table.api.DataTypes.FIELD;
+import static org.apache.flink.table.api.DataTypes.MAP;
+import static org.apache.flink.table.api.DataTypes.ROW;
+import static org.apache.flink.table.api.DataTypes.STRING;
+import static org.apache.flink.table.api.Expressions.$;
+
+/**
+ * Regular tests. See also {@link ConstructedAccessFunctionsITCase} for tests that access a nested
+ * field of an expression or for {@link BuiltInFunctionDefinitions#FLATTEN} which produces multiple
+ * columns from a single one.
+ */
+class FieldAccessFromTableITCase extends BuiltInFunctionTestBase {
+
+ @Override
+ public Stream<TestSetSpec> getTestCaseSpecs() {
+ return Stream.of(
+
+ // Actually in case of SQL it does not use the GET method, but
+ // a custom logic for accessing nested fields of a Table.
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.GET)
+ .onFieldsWithData(null, Row.of(1))
+ .andDataTypes(
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ .testResult(
+ resultSpec(
+ $("f0").get("nested"),
+ "f0.nested",
+ null,
+ BIGINT().nullable()),
+ resultSpec(
+ $("f1").get("nested"),
+ "f1.nested",
+ 1L,
+ BIGINT().notNull())),
+
+ // In Calcite it maps to FlinkSqlOperatorTable.ITEM
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.AT)
+ .onFieldsWithData(
+ null,
+ new int[] {1},
+ null,
+ singletonMap("nested", 1),
+ null,
+ Row.of(1))
+ .andDataTypes(
+ ARRAY(BIGINT().notNull()).nullable(),
+ ARRAY(BIGINT().notNull()).notNull(),
+ MAP(STRING(), BIGINT().notNull()).nullable(),
+ MAP(STRING(), BIGINT().notNull()).notNull(),
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ // accessing elements of MAP or ARRAY is a runtime operations,
+ // we do not know about the size or contents during the inference
+ // therefore the results are always nullable
+ .testResult(
+ resultSpec($("f0").at(1), "f0[1]", null, BIGINT().nullable()),
Review comment:
in this case i'm not sure it does. `testResult` is either a vararg of result spec or a function taking 5 args. I rather prefer to keep it as it is.
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/FieldAccessFromTableITCase.java
##########
@@ -0,0 +1,111 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.table.planner.functions;
+
+import org.apache.flink.table.functions.BuiltInFunctionDefinitions;
+import org.apache.flink.types.Row;
+
+import java.util.stream.Stream;
+
+import static java.util.Collections.singletonMap;
+import static org.apache.flink.table.api.DataTypes.ARRAY;
+import static org.apache.flink.table.api.DataTypes.BIGINT;
+import static org.apache.flink.table.api.DataTypes.FIELD;
+import static org.apache.flink.table.api.DataTypes.MAP;
+import static org.apache.flink.table.api.DataTypes.ROW;
+import static org.apache.flink.table.api.DataTypes.STRING;
+import static org.apache.flink.table.api.Expressions.$;
+
+/**
+ * Regular tests. See also {@link ConstructedAccessFunctionsITCase} for tests that access a nested
+ * field of an expression or for {@link BuiltInFunctionDefinitions#FLATTEN} which produces multiple
+ * columns from a single one.
+ */
+class FieldAccessFromTableITCase extends BuiltInFunctionTestBase {
+
+ @Override
+ public Stream<TestSetSpec> getTestCaseSpecs() {
+ return Stream.of(
+
+ // Actually in case of SQL it does not use the GET method, but
+ // a custom logic for accessing nested fields of a Table.
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.GET)
+ .onFieldsWithData(null, Row.of(1))
+ .andDataTypes(
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ .testResult(
+ resultSpec(
+ $("f0").get("nested"),
+ "f0.nested",
+ null,
+ BIGINT().nullable()),
+ resultSpec(
+ $("f1").get("nested"),
+ "f1.nested",
+ 1L,
+ BIGINT().notNull())),
+
+ // In Calcite it maps to FlinkSqlOperatorTable.ITEM
+ TestSetSpec.forFunction(BuiltInFunctionDefinitions.AT)
+ .onFieldsWithData(
+ null,
+ new int[] {1},
+ null,
+ singletonMap("nested", 1),
+ null,
+ Row.of(1))
+ .andDataTypes(
+ ARRAY(BIGINT().notNull()).nullable(),
+ ARRAY(BIGINT().notNull()).notNull(),
+ MAP(STRING(), BIGINT().notNull()).nullable(),
+ MAP(STRING(), BIGINT().notNull()).notNull(),
+ ROW(FIELD("nested", BIGINT().notNull())).nullable(),
+ ROW(FIELD("nested", BIGINT().notNull())).notNull())
+ // accessing elements of MAP or ARRAY is a runtime operations,
+ // we do not know about the size or contents during the inference
+ // therefore the results are always nullable
+ .testResult(
+ resultSpec($("f0").at(1), "f0[1]", null, BIGINT().nullable()),
Review comment:
in this case i'm not sure it does. `testResult` is either a vararg of result spec or a function taking 5 args, but here the args are 4. I rather prefer to keep it as it is.
##########
File path: flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/runtime/stream/sql/FunctionITCase.java
##########
@@ -72,7 +71,8 @@
* Tests for catalog and system functions in a table environment.
*
* <p>Note: This class is meant for testing the core function support. Use {@link
- * BuiltInFunctionTestBase} for testing individual function implementations.
+ * org.apache.flink.table.planner.functions.BuiltInFunctionTestBase} for testing individual function
Review comment:
I can't, because of the changed visibility of BuiltInFunctionTestBase
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1062782029",
"triggerType" : "MANUAL"
}, {
"hash" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33186",
"triggerID" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"triggerType" : "PUSH"
}, {
"hash" : "404cfea3428975626f8c5647653d0c92e0484222",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33310",
"triggerID" : "404cfea3428975626f8c5647653d0c92e0484222",
"triggerType" : "PUSH"
}, {
"hash" : "4c39fe3579909a7942ea61ff44e692e7f9f914e3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33378",
"triggerID" : "4c39fe3579909a7942ea61ff44e692e7f9f914e3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4c39fe3579909a7942ea61ff44e692e7f9f914e3 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33378)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1062782029",
"triggerType" : "MANUAL"
}, {
"hash" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33186",
"triggerID" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"triggerType" : "PUSH"
}, {
"hash" : "404cfea3428975626f8c5647653d0c92e0484222",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33310",
"triggerID" : "404cfea3428975626f8c5647653d0c92e0484222",
"triggerType" : "PUSH"
}, {
"hash" : "4c39fe3579909a7942ea61ff44e692e7f9f914e3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4c39fe3579909a7942ea61ff44e692e7f9f914e3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 404cfea3428975626f8c5647653d0c92e0484222 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33310)
* 4c39fe3579909a7942ea61ff44e692e7f9f914e3 UNKNOWN
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"triggerType" : "PUSH"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1056792476",
"triggerType" : "MANUAL"
}, {
"hash" : "b963e2a9e1fc86e06f9149cbaa85e1b9d9d8614d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32380",
"triggerID" : "1062782029",
"triggerType" : "MANUAL"
}, {
"hash" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33186",
"triggerID" : "7d1c4e4dfd01c73a1efca7c7cbed0dee61824770",
"triggerType" : "PUSH"
}, {
"hash" : "404cfea3428975626f8c5647653d0c92e0484222",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33310",
"triggerID" : "404cfea3428975626f8c5647653d0c92e0484222",
"triggerType" : "PUSH"
}, {
"hash" : "4c39fe3579909a7942ea61ff44e692e7f9f914e3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33378",
"triggerID" : "4c39fe3579909a7942ea61ff44e692e7f9f914e3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 404cfea3428975626f8c5647653d0c92e0484222 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33310)
* 4c39fe3579909a7942ea61ff44e692e7f9f914e3 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=33378)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot edited a comment on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot edited a comment on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 663b6b624d14af7765d1ab09bf4a64fb684f6d65 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=32358)
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink] flinkbot commented on pull request #18940: [FLINK-26249][table-planner] Run BuiltInFunctionsTestBase and BuiltInAggregateFunctionsTestBase in parallel
Posted by GitBox <gi...@apache.org>.
flinkbot commented on pull request #18940:
URL: https://github.com/apache/flink/pull/18940#issuecomment-1055381485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "663b6b624d14af7765d1ab09bf4a64fb684f6d65",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 663b6b624d14af7765d1ab09bf4a64fb684f6d65 UNKNOWN
<details>
<summary>Bot commands</summary>
The @flinkbot bot supports the following commands:
- `@flinkbot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org