[GitHub] [spark] wangyum commented on a change in pull request #31886: [WIP][SPARK-34795][SQL][TEST] Adds a new job in GitHub Actions to check the output of TPC-DS queries

[GitBox <gi...@apache.org>]

wangyum commented on a change in pull request #31886:
URL: https://github.com/apache/spark/pull/31886#discussion_r597337553



##########
File path: .github/workflows/build_and_test.yml
##########
@@ -428,3 +428,35 @@ jobs:
     - name: Build with SBT
       run: |
         ./build/sbt -Pyarn -Pmesos -Pkubernetes -Phive -Phive-thriftserver -Phadoop-cloud -Pkinesis-asl -Phadoop-2.7 compile test:compile
+
+  tpcds-1g:
+    name: Run TPC-DS queries with SF=1
+    runs-on: ubuntu-20.04
+    steps:
+    - name: Checkout Spark repository
+      uses: actions/checkout@v2
+    - name: Checkout TPC-DS (SF=1) generated data repository
+      uses: actions/checkout@v2
+      with:
+        repository: maropu/spark-tpcds-sf-1
+        path: ./tpcds-sf-1
+        lfs: true

Review comment:
       Another option is we can generate data at runtime: https://github.com/apache/spark/pull/31303




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org