You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/04/08 07:59:28 UTC

[GitHub] [hudi] rubenssoto opened a new issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

rubenssoto opened a new issue #2787:
URL: https://github.com/apache/hudi/issues/2787


   Hello guys,
   
   My hudi job start to have this error, could you help me with it?
   
   emr 6.2
   Hudi 0.8.0
   spark 3.0.1
   
   Thank you
   
   
   21/04/08 07:38:34 WARN TaskSetManager: Lost task 0.0 in stage 311.0 (TID 7540, ip-10-0-63-227.us-west-2.compute.internal, executor 2): org.apache.hudi.exception.HoodieUpsertException: Error upserting bucketType UPDATE for partition :0
   	at org.apache.hudi.table.action.commit.BaseSparkCommitActionExecutor.handleUpsertPartition(BaseSparkCommitActionExecutor.java:288)
   	at org.apache.hudi.table.action.commit.BaseSparkCommitActionExecutor.lambda$execute$ecf5068c$1(BaseSparkCommitActionExecutor.java:139)
   	at org.apache.spark.api.java.JavaRDDLike.$anonfun$mapPartitionsWithIndex$1(JavaRDDLike.scala:102)
   	at org.apache.spark.api.java.JavaRDDLike.$anonfun$mapPartitionsWithIndex$1$adapted(JavaRDDLike.scala:102)
   	at org.apache.spark.rdd.RDD.$anonfun$mapPartitionsWithIndex$2(RDD.scala:889)
   	at org.apache.spark.rdd.RDD.$anonfun$mapPartitionsWithIndex$2$adapted(RDD.scala:889)
   	at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
   	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:349)
   	at org.apache.spark.rdd.RDD.iterator(RDD.scala:313)
   	at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
   	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:349)
   	at org.apache.spark.rdd.RDD.$anonfun$getOrCompute$1(RDD.scala:362)
   	at org.apache.spark.storage.BlockManager.$anonfun$doPutIterator$1(BlockManager.scala:1388)
   	at org.apache.spark.storage.BlockManager.org$apache$spark$storage$BlockManager$$doPut(BlockManager.scala:1298)
   	at org.apache.spark.storage.BlockManager.doPutIterator(BlockManager.scala:1362)
   	at org.apache.spark.storage.BlockManager.getOrElseUpdate(BlockManager.scala:1186)
   	at org.apache.spark.rdd.RDD.getOrCompute(RDD.scala:360)
   	at org.apache.spark.rdd.RDD.iterator(RDD.scala:311)
   	at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
   	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:349)
   	at org.apache.spark.rdd.RDD.iterator(RDD.scala:313)
   	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
   	at org.apache.spark.scheduler.Task.run(Task.scala:127)
   	at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:446)
   	at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1377)
   	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:449)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   Caused by: org.apache.hudi.exception.HoodieException: org.apache.hudi.exception.HoodieException: java.util.concurrent.ExecutionException: org.apache.hudi.exception.HoodieException: operation has failed
   	at org.apache.hudi.table.action.commit.SparkMergeHelper.runMerge(SparkMergeHelper.java:102)
   	at org.apache.hudi.table.action.commit.BaseSparkCommitActionExecutor.handleUpdateInternal(BaseSparkCommitActionExecutor.java:317)
   	at org.apache.hudi.table.action.commit.BaseSparkCommitActionExecutor.handleUpdate(BaseSparkCommitActionExecutor.java:308)
   	at org.apache.hudi.table.action.commit.BaseSparkCommitActionExecutor.handleUpsertPartition(BaseSparkCommitActionExecutor.java:281)
   	... 28 more
   Caused by: org.apache.hudi.exception.HoodieException: java.util.concurrent.ExecutionException: org.apache.hudi.exception.HoodieException: operation has failed
   	at org.apache.hudi.common.util.queue.BoundedInMemoryExecutor.execute(BoundedInMemoryExecutor.java:143)
   	at org.apache.hudi.table.action.commit.SparkMergeHelper.runMerge(SparkMergeHelper.java:100)
   	... 31 more
   Caused by: java.util.concurrent.ExecutionException: org.apache.hudi.exception.HoodieException: operation has failed
   	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
   	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
   	at org.apache.hudi.common.util.queue.BoundedInMemoryExecutor.execute(BoundedInMemoryExecutor.java:141)
   	... 32 more
   Caused by: org.apache.hudi.exception.HoodieException: operation has failed
   	at org.apache.hudi.common.util.queue.BoundedInMemoryQueue.throwExceptionIfFailed(BoundedInMemoryQueue.java:247)
   	at org.apache.hudi.common.util.queue.BoundedInMemoryQueue.readNextRecord(BoundedInMemoryQueue.java:226)
   	at org.apache.hudi.common.util.queue.BoundedInMemoryQueue.access$100(BoundedInMemoryQueue.java:52)
   	at org.apache.hudi.common.util.queue.BoundedInMemoryQueue$QueueIterator.hasNext(BoundedInMemoryQueue.java:277)
   	at org.apache.hudi.common.util.queue.BoundedInMemoryQueueConsumer.consume(BoundedInMemoryQueueConsumer.java:36)
   	at org.apache.hudi.common.util.queue.BoundedInMemoryExecutor.lambda$null$2(BoundedInMemoryExecutor.java:121)
   	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   	... 3 more
   Caused by: org.apache.parquet.io.ParquetDecodingException: Can not read value at 0 in block -1 in file s3://30-ze-datalake-raw/freshdesk/tickets/3416b1b1-dc82-4256-8d4c-a2a62146e41c-0_0-299-7594_20210408071759.parquet
   	at org.apache.parquet.hadoop.InternalParquetRecordReader.nextKeyValue(InternalParquetRecordReader.java:251)
   	at org.apache.parquet.hadoop.ParquetReader.read(ParquetReader.java:132)
   	at org.apache.parquet.hadoop.ParquetReader.read(ParquetReader.java:136)
   	at org.apache.hudi.common.util.ParquetReaderIterator.hasNext(ParquetReaderIterator.java:49)
   	at org.apache.hudi.common.util.queue.IteratorBasedQueueProducer.produce(IteratorBasedQueueProducer.java:45)
   	at org.apache.hudi.common.util.queue.BoundedInMemoryExecutor.lambda$null$0(BoundedInMemoryExecutor.java:92)
   	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   	... 4 more
   Caused by: java.lang.UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary$PlainLongDictionary
   	at org.apache.parquet.column.Dictionary.decodeToBinary(Dictionary.java:41)
   	at org.apache.parquet.avro.AvroConverters$BinaryConverter.setDictionary(AvroConverters.java:75)
   	at org.apache.parquet.column.impl.ColumnReaderImpl.<init>(ColumnReaderImpl.java:341)
   	at org.apache.parquet.column.impl.ColumnReadStoreImpl.newMemColumnReader(ColumnReadStoreImpl.java:80)
   	at org.apache.parquet.column.impl.ColumnReadStoreImpl.getColumnReader(ColumnReadStoreImpl.java:75)
   	at org.apache.parquet.io.RecordReaderImplementation.<init>(RecordReaderImplementation.java:271)
   	at org.apache.parquet.io.MessageColumnIO$1.visit(MessageColumnIO.java:147)
   	at org.apache.parquet.io.MessageColumnIO$1.visit(MessageColumnIO.java:109)
   	at org.apache.parquet.filter2.compat.FilterCompat$NoOpFilter.accept(FilterCompat.java:165)
   	at org.apache.parquet.io.MessageColumnIO.getRecordReader(MessageColumnIO.java:109)
   	at org.apache.parquet.hadoop.InternalParquetRecordReader.checkRead(InternalParquetRecordReader.java:137)
   	at org.apache.parquet.hadoop.InternalParquetRecordReader.nextKeyValue(InternalParquetRecordReader.java:222)
   	... 11 more
   
   21/04/08 07:38:34 INFO TaskSetManager: Starting task 0.1 in stage 311.0 (TID 7541, ip-10-0-63-227.us-west-2.compute.internal, executor 2, partition 0, NODE_LOCAL, 7132 bytes)
   21/04/08 07:38:36 INFO TaskSetManager: Lost task 0.1 in stage 311.0 (TID 7541) on ip-10-0-63-227.us-west-2.compute.internal, executor 2: org.apache.hudi.exception.HoodieUpsertException (Error upserting bucketType UPDATE for partition :0) [duplicate 1]


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-816416482


   Can you give us the configs you used? is it failing at the beginning itself or after after few batch of writes? 
   looks like this is the root cause.
   ```
   Caused by: org.apache.parquet.io.ParquetDecodingException: Can not read value at 0 in block -1 in file s3://30-ze-datalake-raw/freshdesk/tickets/3416b1b1-dc82-4256-8d4c-a2a62146e41c-0_0-299-7594_20210408071759.parquet
   ```
   also, can you give us the schema of the dataset in use. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-830213357


   sure, will look into it. for now, looks like you are interested in knowing detailed error msg on schema incompatability. is my understanding right ? 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] rubenssoto commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
rubenssoto commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-818453992


   Hello,
   
   My Hudi config
   
   `Map(hoodie.datasource.hive_sync.database -> raw_freshdesk, 
   hoodie.parquet.small.file.limit -> 402653184, 
   hoodie.copyonwrite.record.size.estimate -> 1024, 
   hoodie.datasource.hive_sync.support_timestamp -> true, 
   hoodie.datasource.write.precombine.field -> updated_at, 
   hoodie.datasource.hive_sync.partition_extractor_class -> org.apache.hudi.hive.NonPartitionedExtractor, hoodie.parquet.max.file.size -> 419430400, 
   hoodie.parquet.block.size -> 402653184, 
   hoodie.datasource.hive_sync.table -> agents, 
   hoodie.datasource.write.operation -> upsert, hoodie.datasource.hive_sync.enable -> false, hoodie.datasource.write.recordkey.field -> id, 
   hoodie.table.name -> agents, 
   hoodie.datasource.hive_sync.jdbcurl -> jdbc:hive2://hive:10000, 
   hoodie.datasource.write.hive_style_partitioning -> false, 
   hoodie.datasource.write.table.name -> agents, hoodie.datasource.write.keygenerator.class -> org.apache.hudi.keygen.NonpartitionedKeyGenerator, 
   hoodie.keep.max.commits -> 38, 
   hoodie.upsert.shuffle.parallelism -> 100, 
   hoodie.cleaner.commits.retained -> 36,
    hoodie.keep.min.commits -> 37, hoodie.clean.async -> true)`
   
   After a few batchs of writes, probably is something related to schema, but hudi doesn't show where exactly is the problem, like the column name for example.
   The problem only happens at night, this is the part of the day that we have less data coming.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] rubenssoto commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
rubenssoto commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-827971949


   Hi Guys,
   
   I tried with another table...but the error message doesn't help
   
   `java.lang.Exception: Error on Table: tracking_speedy_gonzales_app, Error Message: org.apache.hudi.exception.HoodieUpsertException: Failed upsert schema compatibility check.
   	at TableProcessorWrapper$.$anonfun$main$4(TableProcessorWrapper.scala:32)
   	at TableProcessorWrapper$.$anonfun$main$4$adapted(TableProcessorWrapper.scala:29)
   	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
   	at java.util.concurrent.ForkJoinTask$RunnableExecuteAction.exec(ForkJoinTask.java:1402)
   	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
   	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
   	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
   	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
   21/04/27 22:07:43 ERROR ApplicationMaster: User class threw exception: java.lang.Exception: Error on Table: tracking_speedy_gonzales_app, Error Message: org.apache.hudi.exception.HoodieUpsertException: Failed upsert schema compatibility check.
   java.lang.Exception: Error on Table: tracking_speedy_gonzales_app, Error Message: org.apache.hudi.exception.HoodieUpsertException: Failed upsert schema compatibility check.
   	at jobs.TableProcessor.start(TableProcessor.scala:107)
   	at TableProcessorWrapper$.$anonfun$main$2(TableProcessorWrapper.scala:23)
   	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
   	at scala.concurrent.Future$.$anonfun$apply$1(Future.scala:659)
   	at scala.util.Success.$anonfun$map$1(Try.scala:255)
   	at scala.util.Success.map(Try.scala:213)
   	at scala.concurrent.Future.$anonfun$map$1(Future.scala:292)
   	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:33)
   	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:33)
   	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
   	at java.util.concurrent.ForkJoinTask$RunnableExecuteAction.exec(ForkJoinTask.java:1402)
   	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
   	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
   	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
   	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
   21/04/27 22:07:43 INFO ApplicationMaster: Final app status: FAILED, exitCode: 15, (reason: User class threw exception: java.lang.Exception: Error on Table: tracking_speedy_gonzales_app, Error Message: org.apache.hudi.exception.HoodieUpsertException: Failed upsert schema compatibility check.
   	at jobs.TableProcessor.start(TableProcessor.scala:107)
   	at TableProcessorWrapper$.$anonfun$main$2(TableProcessorWrapper.scala:23)
   	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
   	at scala.concurrent.Future$.$anonfun$apply$1(Future.scala:659)
   	at scala.util.Success.$anonfun$map$1(Try.scala:255)
   	at scala.util.Success.map(Try.scala:213)
   	at scala.concurrent.Future.$anonfun$map$1(Future.scala:292)
   	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:33)
   	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:33)
   	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:64)
   	at java.util.concurrent.ForkJoinTask$RunnableExecuteAction.exec(ForkJoinTask.java:1402)
   	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
   	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
   	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
   	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] absognety commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
absognety commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-947896356


   I have been frequently facing same issues for few tables  not all of them.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] rubenssoto commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
rubenssoto commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-831397967


   yeah thats it, because with this error I dont know how to solve the issue.
   
   @nsivabalan 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] absognety edited a comment on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
absognety edited a comment on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-947892572


   @nsivabalan is there a `mergeSchema` or `overwriteSchema` like options we have in deltalake available in hudi to allow schema evolution - that can circumvent schema mismatches or datatype mismatches?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] rubenssoto commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
rubenssoto commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-820462928


   Its a new Hudi table.
   
   It happens intermittently, probably some schema mismatch I think...is there any way to know where exactly the problem or I will have to inspect the new when the problem starts to happen?
   
   thank you.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] n3nash closed issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
n3nash closed issue #2787:
URL: https://github.com/apache/hudi/issues/2787


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-821755784


   Can you try enabling schema validation and we can go from there. 
   ```
   hoodie.avro.schema.validate
   ```
   set this property to true. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] absognety commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
absognety commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-947892572


   @nsivabalan is there a `mergeSchema` like option we have in deltalake available in hudi to allow schema evolution - that can circumvent schema mismatches or datatype mismatches?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] n3nash commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-827304591


   @rubenssoto This config is "safe" in a way that it will throw an error and fail the pipeline if there is any schema evolution issue. So you can turn it on and if pipeline fails, please get the logs so we can debug and you can turn this config off if needed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] n3nash commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-820150010


   This does look like related to some files having incompatible schema. @rubenssoto
   1) Is this a tables boostrapped into hudi or is this a new hudi tables ?
   2) Is this problem repeatable or happens intermittently ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] n3nash commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-859335968


   @rubenssoto Closing this ticket due to inactivity. Please re-open if you need further assistance. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] rubenssoto commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
rubenssoto commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-824357982


   Yeah I can.
   
   is it a safe configuration? Because I use a generic pipeline for many tables, so it will apply for all...
   
   Thank you


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on issue #2787: [SUPPORT] Error upserting bucketType UPDATE for partition

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #2787:
URL: https://github.com/apache/hudi/issues/2787#issuecomment-831969176


   If you happened to know both schemas(old and new), and if you can give it to me, I can run it locally to see schema incompatible issue. Or I can give you a patch that you can try it out on your end. Let me know how you wanna proceed. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org