[GitHub] [hive] vihangk1 commented on pull request #4067: HIVE-27087: Fix TestMiniSparkOnYarnCliDriver test failures on branch-3

["vihangk1 (via GitHub)" <gi...@apache.org>]

vihangk1 commented on PR #4067:
URL: https://github.com/apache/hive/pull/4067#issuecomment-1470792448

   > @vihangk1 Did you debug the creation of the file locally to see which codepath sets the replication factor to 1? Maybe there is some logic to adapt the replication factor based on other things leading to the different behavior when running in CI.
   
   @zabetak I tried to look into this but there was nothing obvious that came out. I am not convinced that this is a bug yet. The replication factor is decided by the HDFS configuration `dfs.replication.factor` and I don't see any code in HoS or Hive which would affect that. Can we consider masking the replication factor for these tests for spark tests? If this was a real bug, someone would have reported it by now since it also happens on 3.1.3 so there is a high likelihood that this is related to our test environment.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org