You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by liancheng <gi...@git.apache.org> on 2014/07/16 12:09:34 UTC

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

GitHub user liancheng opened a pull request:

    https://github.com/apache/spark/pull/1440

    [SPARK-2190][SQL] Specialized ColumnType for Timestamp

    JIRA issue: [SPARK-2190](https://issues.apache.org/jira/browse/SPARK-2190)
    
    Added specialized in-memory column type for `Timestamp`. Whitelisted all timestamp related Hive tests except `timestamp_udf`, which is timezone sensitive.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/liancheng/spark timestamp-column-type

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/1440.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1440
    
----
commit adc3746ea25f34c131c43f69f3a06b98e3f9190d
Author: Cheng Lian <li...@gmail.com>
Date:   2014-07-16T08:24:10Z

    Added Timestamp specific in-memory columnar representation

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by ueshin <gi...@git.apache.org>.
Github user ueshin commented on a diff in the pull request:

    https://github.com/apache/spark/pull/1440#discussion_r14993202
  
    --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala ---
    @@ -249,3 +263,7 @@ case class Cast(child: Expression, dataType: DataType) extends UnaryExpression {
         if (evaluated == null) null else cast(evaluated)
       }
     }
    +
    +object Cast {
    +  private[sql] val simpleDateFormat = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss")
    --- End diff --
    
    Hi, `SimpleDateFormat` is not thread-safe, so `def` should be used instead of `val`.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49245732
  
    QA results for PR 1440:<br>- This patch PASSES unit tests.<br>- This patch merges cleanly<br>- This patch adds no public classes<br><br>For more information see test ouptut:<br>https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16749/consoleFull


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by marmbrus <gi...@git.apache.org>.
Github user marmbrus commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49579030
  
    Thanks!  I've merged this into master.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by liancheng <gi...@git.apache.org>.
Github user liancheng commented on a diff in the pull request:

    https://github.com/apache/spark/pull/1440#discussion_r15035556
  
    --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala ---
    @@ -93,6 +93,10 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter {
         "partitions_json",
     
         // Timezone specific test answers.
    +    "timestamp_1",
    --- End diff --
    
    Opened [SPARK-2537](https://issues.apache.org/jira/browse/SPARK-2537) to track this.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49238579
  
    QA tests have started for PR 1440. This patch merges cleanly. <br>View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16749/consoleFull


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by marmbrus <gi...@git.apache.org>.
Github user marmbrus commented on a diff in the pull request:

    https://github.com/apache/spark/pull/1440#discussion_r15002400
  
    --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala ---
    @@ -93,6 +93,10 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter {
         "partitions_json",
     
         // Timezone specific test answers.
    +    "timestamp_1",
    --- End diff --
    
    Is there someway we could fix the timezone in the test harness instead of turning all of these off?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49572524
  
    QA tests have started for PR 1440. This patch DID NOT merge cleanly! <br>View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16894/consoleFull


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49171137
  
    QA results for PR 1440:<br>- This patch FAILED unit tests.<br>- This patch merges cleanly<br>- This patch adds no public classes<br><br>For more information see test ouptut:<br>https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16729/consoleFull


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49576854
  
    QA results for PR 1440:<br>- This patch PASSES unit tests.<br>- This patch merges cleanly<br>- This patch adds no public classes<br><br>For more information see test ouptut:<br>https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16895/consoleFull


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49572803
  
    QA tests have started for PR 1440. This patch merges cleanly. <br>View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16895/consoleFull


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by liancheng <gi...@git.apache.org>.
Github user liancheng commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49572762
  
    Rebased to the most recent master, generated all golden answer files after setting timezone of my local machine to `America/Los_Angeles` and hardcoded the timezone in `HiveCompatibilitySuite` to enable those timezone sensitive tests. Hope Jenkins is happy with this.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49168910
  
    QA results for PR 1440:<br>- This patch FAILED unit tests.<br>- This patch merges cleanly<br>- This patch adds no public classes<br><br>For more information see test ouptut:<br>https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16728/consoleFull


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by liancheng <gi...@git.apache.org>.
Github user liancheng commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49155576
  
    Hmm, just realized `Timestamp.toString` normalizes date and time according to current timezone and makes almost all timestamp related tests timezone sensitive. (Wouldn't notice this if I were in US...) Guess we have to blacklist them for now, and this will revert part of #1396.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by liancheng <gi...@git.apache.org>.
Github user liancheng commented on a diff in the pull request:

    https://github.com/apache/spark/pull/1440#discussion_r14993659
  
    --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala ---
    @@ -249,3 +263,7 @@ case class Cast(child: Expression, dataType: DataType) extends UnaryExpression {
         if (evaluated == null) null else cast(evaluated)
       }
     }
    +
    +object Cast {
    +  private[sql] val simpleDateFormat = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss")
    --- End diff --
    
    Just checked `Timestamp.java`, it's indeed handled with a thread local variable. Thanks for pointing this out!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49158865
  
    QA tests have started for PR 1440. This patch merges cleanly. <br>View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16729/consoleFull


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by yhuai <gi...@git.apache.org>.
Github user yhuai commented on a diff in the pull request:

    https://github.com/apache/spark/pull/1440#discussion_r15036800
  
    --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala ---
    @@ -93,6 +93,10 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter {
         "partitions_json",
     
         // Timezone specific test answers.
    +    "timestamp_1",
    --- End diff --
    
    How about we include the following settings in our unit tests?
    ```
    val gmtTimeZone = java.util.TimeZone.getTimeZone("GMT")
    java.util.TimeZone.setDefault(gmtTimeZone)
    ```
    `java.sql.Timestamp` is a subclass of `java.util.Date` and the `Timestamp.toString` will refer to the default timezone to generate the string. So, I guess if we explicitly set the Timezone, our test results will not be affected by the actual Timezone.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:

    https://github.com/apache/spark/pull/1440


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by liancheng <gi...@git.apache.org>.
Github user liancheng commented on a diff in the pull request:

    https://github.com/apache/spark/pull/1440#discussion_r15035454
  
    --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala ---
    @@ -93,6 +93,10 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter {
         "partitions_json",
     
         // Timezone specific test answers.
    +    "timestamp_1",
    --- End diff --
    
    A not so clever solution is to cache golden answers of all timezones for these tests, then select the right version for the current build according to system timezone. (And hope developers don't build Spark SQL when traveling across timezones...)
    
    @yhuai any thoughts?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by concretevitamin <gi...@git.apache.org>.
Github user concretevitamin commented on a diff in the pull request:

    https://github.com/apache/spark/pull/1440#discussion_r15018072
  
    --- Diff: sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnStats.scala ---
    @@ -344,21 +344,52 @@ private[sql] class StringColumnStats extends BasicColumnStats(STRING) {
       }
     
       override def contains(row: Row, ordinal: Int) = {
    -    !(upperBound eq null) && {
    +    (upperBound ne null) && {
    --- End diff --
    
    I think I read somewhere ne has better performance in certain cases...


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by marmbrus <gi...@git.apache.org>.
Github user marmbrus commented on a diff in the pull request:

    https://github.com/apache/spark/pull/1440#discussion_r15020827
  
    --- Diff: sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnStats.scala ---
    @@ -344,21 +344,52 @@ private[sql] class StringColumnStats extends BasicColumnStats(STRING) {
       }
     
       override def contains(row: Row, ordinal: Int) = {
    -    !(upperBound eq null) && {
    +    (upperBound ne null) && {
    --- End diff --
    
    Oh, I see... I forgot that `ne`/`eq` do reference equality... in the case of null I would imagine there is no difference, but this is probably fine then.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by marmbrus <gi...@git.apache.org>.
Github user marmbrus commented on a diff in the pull request:

    https://github.com/apache/spark/pull/1440#discussion_r15001961
  
    --- Diff: sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnStats.scala ---
    @@ -344,21 +344,52 @@ private[sql] class StringColumnStats extends BasicColumnStats(STRING) {
       }
     
       override def contains(row: Row, ordinal: Int) = {
    -    !(upperBound eq null) && {
    +    (upperBound ne null) && {
    --- End diff --
    
    Nit: Spark style would probably prefer != here.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by liancheng <gi...@git.apache.org>.
Github user liancheng commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49156553
  
    Confirmed that the following test cases are timezone sensitive and blacklisted them (by first remove all timestamp related golden answers, run them in my local timezone to generate new golden answers, then manually change my timezone settings and rerun these tests):
    
    - `timestamp_1`
    - `timestamp_2`
    - `timestamp_3` *
    - `timestamp_udf` *
    
    [*] Reverted from #1396.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49576209
  
    QA results for PR 1440:<br>- This patch PASSES unit tests.<br><br>For more information see test ouptut:<br>https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16894/consoleFull


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by liancheng <gi...@git.apache.org>.
Github user liancheng commented on a diff in the pull request:

    https://github.com/apache/spark/pull/1440#discussion_r15038187
  
    --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala ---
    @@ -93,6 +93,10 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter {
         "partitions_json",
     
         // Timezone specific test answers.
    +    "timestamp_1",
    --- End diff --
    
    I also came to this solution at first, but I'm not sure whether changing application wide timezone settings causes any trouble somewhere else, an example is log timestamp. I'll have a try later.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49154451
  
    QA results for PR 1440:<br>- This patch FAILED unit tests.<br>- This patch merges cleanly<br>- This patch adds no public classes<br><br>For more information see test ouptut:<br>https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16725/consoleFull


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49157381
  
    QA tests have started for PR 1440. This patch merges cleanly. <br>View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16728/consoleFull


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the pull request:

    https://github.com/apache/spark/pull/1440#issuecomment-49145850
  
    QA tests have started for PR 1440. This patch merges cleanly. <br>View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16725/consoleFull


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] spark pull request: [SPARK-2190][SQL] Specialized ColumnType for T...

Posted by marmbrus <gi...@git.apache.org>.
Github user marmbrus commented on a diff in the pull request:

    https://github.com/apache/spark/pull/1440#discussion_r15081630
  
    --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala ---
    @@ -93,6 +93,10 @@ class HiveCompatibilitySuite extends HiveQueryFileTest with BeforeAndAfter {
         "partitions_json",
     
         // Timezone specific test answers.
    +    "timestamp_1",
    --- End diff --
    
    Yeah, though that probably doesn't matter in a test setup.  If you change the fixed timezone to California then jenkins will behave the same.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---