You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2020/11/23 14:46:24 UTC
[GitHub] [iceberg] lcspinter commented on a change in pull request #1607: Test out complex stuctures: MAP/LIST/STRUCT
lcspinter commented on a change in pull request #1607:
URL: https://github.com/apache/iceberg/pull/1607#discussion_r528754182
##########
File path: mr/src/test/java/org/apache/iceberg/mr/hive/HiveIcebergStorageHandlerBaseTest.java
##########
@@ -512,4 +770,14 @@ protected void createHiveTable(String tableName, String location) {
protected String locationForCreateTable(String tempDirName, String tableName) {
return null;
}
+
+ private List<Record> createTableWithGeneratedRecords(Schema schema, int numRecords, long seed, String tableName)
+ throws IOException {
+ List<Record> records = TestHelper.generateRandomRecords(schema, numRecords, seed);
+ createTable(tableName, schema, records);
+ // sanity check, fetch all rows
+ List<Object[]> allRows = shell.executeStatement("SELECT * from default." + tableName);
+ Assert.assertEquals("Number of rows doesn't match expected.", records.size(), allRows.size());
Review comment:
You are right, removed the unnecessary query/assert,
##########
File path: mr/src/test/java/org/apache/iceberg/mr/hive/HiveIcebergStorageHandlerBaseTest.java
##########
@@ -481,6 +482,263 @@ public void testCreateTableAboveExistingTable() throws TException, IOException,
}
}
+ @Test
+ public void testArrayOfPrimitivesInTable() throws IOException {
+ Schema schema =
+ new Schema(required(1, "arrayofprimitives", Types.ListType.ofRequired(2, Types.IntegerType.get())));
+ List<Record> records = createTableWithGeneratedRecords(schema, 1, 0L, "arraytable");
+ // access a single element from the array
+ for (int i = 0; i < records.size(); i++) {
+ List<?> expectedList = (List<?>) records.get(i).getField("arrayofprimitives");
+ for (int j = 0; j < expectedList.size(); j++) {
+ List<Object[]> queryResult = shell.executeStatement(
+ String.format("SELECT arrayofprimitives[%d] FROM default.arraytable " + "LIMIT 1 OFFSET %d", j, i));
+ Assert.assertEquals(expectedList.get(j), queryResult.get(0)[0]);
+ }
+ }
+ }
+
+ @Test
+ public void testArrayOfArraysInTable() throws IOException {
+ Schema schema =
+ new Schema(
+ required(1, "arrayofarrays",
+ Types.ListType.ofRequired(2, Types.ListType.ofRequired(3, Types.DateType.get()))));
+ List<Record> records = createTableWithGeneratedRecords(schema, 1, 0L, "arraytable");
+ // access an element from a matrix
+ for (int i = 0; i < records.size(); i++) {
+ List<?> expectedList = (List<?>) records.get(i).getField("arrayofarrays");
+ for (int j = 0; j < expectedList.size(); j++) {
+ List<?> expectedInnerList = (List<?>) expectedList.get(j);
+ for (int k = 0; k < expectedInnerList.size(); k++) {
+ List<Object[]> queryResult = shell.executeStatement(
+ String.format("SELECT arrayofarrays[%d][%d] FROM default.arraytable " + "LIMIT 1 OFFSET %d",
+ j, k, i));
+ Assert.assertEquals(expectedInnerList.get(k).toString(), queryResult.get(0)[0]);
+ }
+
Review comment:
Fixed it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org