You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by GitBox <gi...@apache.org> on 2020/10/13 12:48:32 UTC
[GitHub] [carbondata] nihal0107 opened a new pull request #3980: [CARBONDATA-3901]corrected the documentation
nihal0107 opened a new pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980
### Why is this PR needed?
Some links were not working and also removed unnecessary things.
### What changes were proposed in this PR?
Corrected the documentation.
### Does this PR introduce any user interface change?
- No
- Yes. (please explain the change and update document)
### Is any new testcase added?
- No
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3980: [CARBONDATA-3901] [CARBONDATA-3903] [CARBONDATA-3824] SI creation on unkbown table and doc changes.
Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#issuecomment-710047594
Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/4489/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3980: [CARBONDATA-3901] [CARBONDATA-3903] [CARBONDATA-3824] SI creation on unkbown table and doc changes.
Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#issuecomment-712579135
Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/2768/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3980: [CARBONDATA-3901]corrected the documentation
Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#issuecomment-707788807
Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/2651/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] nihal0107 commented on a change in pull request #3980: [CARBONDATA-3901] [CARBONDATA-3903] [CARBONDATA-3824] SI creation on unkbown table and doc changes.
Posted by GitBox <gi...@apache.org>.
nihal0107 commented on a change in pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#discussion_r507589219
##########
File path: integration/spark/src/main/scala/org/apache/spark/sql/execution/strategy/DDLStrategy.scala
##########
@@ -204,6 +204,10 @@ class DDLStrategy(sparkSession: SparkSession) extends SparkStrategy {
ExecutedCommandExec(CarbonCreateSecondaryIndexCommand(
indexModel, tableProperties, ifNotExists, isDeferredRefresh, isCreateSIndex)) :: Nil
} else {
+ if (!sparkSession.sessionState.catalog.
Review comment:
done
##########
File path: docs/spatial-index-guide.md
##########
@@ -62,13 +62,16 @@ create table source_index(id BIGINT, latitude long, longitude long) stored by 'c
'SPATIAL_INDEX.mygeohash.maxLatitude'='20.225281',
'SPATIAL_INDEX.mygeohash.conversionRatio'='1000000');
```
-Note: `mygeohash` in the above example represent the index name.
+Note:
+ * `mygeohash` in the above example represent the index name.
+ * Columns present in spatial_index table properties cannot be altered
+ i.e., sourcecolumns: `longitude, latitude` and index column: `mygeohash` in the above example.
#### List of spatial index table properties
|Name|Description|
|-----------------------------------|-----------------------------------------------------------------------------------------|
-| SPATIAL_INDEX | Used to configure Spatial Index name. This name is appended to `SPATIAL_INDEX` in the subsequent sub-property configurations. `xxx` in the below sub-properties refer to index name.|
+| SPATIAL_INDEX | Used to configure Spatial Index name. This name is appended to `SPATIAL_INDEX` in the subsequent sub-property configurations. `xxx` in the below sub-properties refer to index name. Newly created column name is same as that of spatial index name. This column is not allowed in any properties except in SORT_COLUMNS table property.|
Review comment:
done
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3980: [CARBONDATA-3901] [CARBONDATA-3903] [CARBONDATA-3824] SI creation on unkbown table and doc changes.
Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#issuecomment-712578745
Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/4522/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3980: [CARBONDATA-3901]corrected the documentation
Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#issuecomment-708992189
Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/4457/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] akashrn5 commented on a change in pull request #3980: [CARBONDATA-3901] [CARBONDATA-3903] [CARBONDATA-3824] SI creation on unkbown table and doc changes.
Posted by GitBox <gi...@apache.org>.
akashrn5 commented on a change in pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#discussion_r507519490
##########
File path: integration/spark/src/main/scala/org/apache/spark/sql/execution/strategy/DDLStrategy.scala
##########
@@ -204,6 +204,10 @@ class DDLStrategy(sparkSession: SparkSession) extends SparkStrategy {
ExecutedCommandExec(CarbonCreateSecondaryIndexCommand(
indexModel, tableProperties, ifNotExists, isDeferredRefresh, isCreateSIndex)) :: Nil
} else {
+ if (!sparkSession.sessionState.catalog.
Review comment:
already we are calling `tableExists `funtion to check whether carbon table or not, if the table not found, it throws `NoSuchTableException`. But we catch the exception in `org.apache.spark.sql.hive.CarbonFileMetastore#tableExists` and return false. So you can add an error log in CarbonFileMetaStore, saying the table not exists mentioning table name and avoid the calling to hive metastore here in your changes which is a costly operation.
Also, you can just change the error to more generalized way to satisfy the non-carbon table scenario and table not exists.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] asfgit closed pull request #3980: [CARBONDATA-3901] [CARBONDATA-3903] [CARBONDATA-3824] SI creation on unkbown table and doc changes.
Posted by GitBox <gi...@apache.org>.
asfgit closed pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] akashrn5 commented on pull request #3980: [CARBONDATA-3901] [CARBONDATA-3903] [CARBONDATA-3824] SI creation on unkbown table and doc changes.
Posted by GitBox <gi...@apache.org>.
akashrn5 commented on pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#issuecomment-712582284
LGTM
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] akashrn5 commented on a change in pull request #3980: [CARBONDATA-3901] [CARBONDATA-3903] [CARBONDATA-3824] SI creation on unkbown table and doc changes.
Posted by GitBox <gi...@apache.org>.
akashrn5 commented on a change in pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#discussion_r507902315
##########
File path: integration/spark/src/main/scala/org/apache/spark/sql/hive/CarbonFileMetastore.scala
##########
@@ -267,6 +267,7 @@ class CarbonFileMetastore extends CarbonMetaStore {
lookupRelation(tableIdentifier)(sparkSession)
} catch {
case _: NoSuchTableException =>
+ LOGGER.error(s"Table ${tableIdentifier.table} does not exist.")
Review comment:
i think this can be debug log, else user can get confused with the error
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3980: [CARBONDATA-3901] [CARBONDATA-3903] [CARBONDATA-3824] SI creation on unkbown table and doc changes.
Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#issuecomment-710056435
Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/2735/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3980: [CARBONDATA-3901]corrected the documentation
Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#issuecomment-708997435
Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/2703/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3980: [CARBONDATA-3901] [CARBONDATA-3903] [CARBONDATA-3824] SI creation on unkbown table and doc changes.
Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#issuecomment-712049673
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] nihal0107 commented on a change in pull request #3980: [CARBONDATA-3901] [CARBONDATA-3903] [CARBONDATA-3824] SI creation on unkbown table and doc changes.
Posted by GitBox <gi...@apache.org>.
nihal0107 commented on a change in pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#discussion_r508168162
##########
File path: integration/spark/src/main/scala/org/apache/spark/sql/hive/CarbonFileMetastore.scala
##########
@@ -267,6 +267,7 @@ class CarbonFileMetastore extends CarbonMetaStore {
lookupRelation(tableIdentifier)(sparkSession)
} catch {
case _: NoSuchTableException =>
+ LOGGER.error(s"Table ${tableIdentifier.table} does not exist.")
Review comment:
done
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3980: [CARBONDATA-3901]corrected the documentation
Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3980:
URL: https://github.com/apache/carbondata/pull/3980#issuecomment-707785976
Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/4404/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org