You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/06/16 09:55:31 UTC
[GitHub] [hudi] zaminhassnain06 opened a new issue, #5887: [SUPPORT] org.apache.hudi.exception.HoodieException: field_name (Part -) field not found in record
zaminhassnain06 opened a new issue, #5887:
URL: https://github.com/apache/hudi/issues/5887
I'm running Hudi creating an external table from files on S3, and when trying to insert into this table it fails with exception org.apache.hudi.exception.HoodieException: The value of <field> not found in record. However it was working fine before yesterday. I have checked all the data in file the field is present.
The <field> is lastModifiedData and it is precombineKey
I am creating cluster from Airflow Dag
When I ran code manually from Jupyter notebook it processed the file successfully. However it is giving error with Airflow DAG.
Following is the EMR Error
y4j.protocol.Py4JJavaError: An error occurred while calling o103.save.
: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: org.apache.hudi.exception.HoodieException: LastModifiedDate(Part -LastModifiedDate) field not found in record. Acceptable fields were :
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on issue #5887: [SUPPORT] org.apache.hudi.exception.HoodieException: field_name (Part -) field not found in record
Posted by GitBox <gi...@apache.org>.
codope commented on issue #5887:
URL: https://github.com/apache/hudi/issues/5887#issuecomment-1157639342
This is unusual. Can you please share your setup details like spark, hudi versions (see details below) and full stacktrace?
**_Tips before filing an issue_**
- Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)?
- Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
- If you have triaged this as a bug, then file an [issue](https://issues.apache.org/jira/projects/HUDI/issues) directly.
**Describe the problem you faced**
A clear and concise description of the problem.
**To Reproduce**
Steps to reproduce the behavior:
1.
2.
3.
4.
**Expected behavior**
A clear and concise description of what you expected to happen.
**Environment Description**
* Hudi version :
* Spark version :
* Hive version :
* Hadoop version :
* Storage (HDFS/S3/GCS..) :
* Running on Docker? (yes/no) :
**Additional context**
Add any other context about the problem here.
**Stacktrace**
```Add the stacktrace of the error.```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope closed issue #5887: [SUPPORT] org.apache.hudi.exception.HoodieException: field_name (Part -) field not found in record
Posted by GitBox <gi...@apache.org>.
codope closed issue #5887: [SUPPORT] org.apache.hudi.exception.HoodieException: field_name (Part -<field_name>) field not found in record
URL: https://github.com/apache/hudi/issues/5887
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on issue #5887: [SUPPORT] org.apache.hudi.exception.HoodieException: field_name (Part -) field not found in record
Posted by GitBox <gi...@apache.org>.
codope commented on issue #5887:
URL: https://github.com/apache/hudi/issues/5887#issuecomment-1158798898
I would also recommend to open an issue with Airflow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on issue #5887: [SUPPORT] org.apache.hudi.exception.HoodieException: field_name (Part -) field not found in record
Posted by GitBox <gi...@apache.org>.
codope commented on issue #5887:
URL: https://github.com/apache/hudi/issues/5887#issuecomment-1158938489
Great! Closing this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] zaminhassnain06 commented on issue #5887: [SUPPORT] org.apache.hudi.exception.HoodieException: field_name (Part -) field not found in record
Posted by GitBox <gi...@apache.org>.
zaminhassnain06 commented on issue #5887:
URL: https://github.com/apache/hudi/issues/5887#issuecomment-1158800687
Hi, Issue is resolved it was something on AWS EMR side we contacted AWS Support as well. Thanks for your prompt response
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org