You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@texera.apache.org by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/05/03 03:52:43 UTC
[I] URLFetcherOpDesc.sourceSchema silently falls back to ANY when decodingMethod is null [texera]
Yicong-Huang opened a new issue, #4815:
URL: https://github.com/apache/texera/issues/4815
### What happened?
`common/workflow-operator/src/main/scala/org/apache/texera/amber/operator/source/fetcher/URLFetcherOpDesc.scala` declares `var decodingMethod: DecodingMethod = _`, which defaults to `null`. `sourceSchema` then asks `if (decodingMethod == DecodingMethod.UTF_8) STRING else ANY`, so a `null` `decodingMethod` silently produces an `ANY` column instead of failing with a clear error.
The descriptor marks `decodingMethod` `required = true` for the JSON schema, but no runtime guard enforces non-null at `sourceSchema` time. The result is a hidden default that can silently cast all output to `ANY` if the field never gets populated.
### How to reproduce?
```scala
import org.apache.texera.amber.operator.source.fetcher.URLFetcherOpDesc
import org.apache.texera.amber.core.tuple.AttributeType
val op = new URLFetcherOpDesc
op.url = "https://example.test/data"
op.sourceSchema().getAttributes.head.getType
// AttributeType.ANY — but the user never supplied a decoding method.
```
### Version
1.1.0-incubating (Pre-release/Master)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] URLFetcherOpDesc.sourceSchema silently falls back to ANY when decodingMethod is null [texera]
Posted by "Ma77Ball (via GitHub)" <gi...@apache.org>.
Ma77Ball commented on issue #4815:
URL: https://github.com/apache/texera/issues/4815#issuecomment-4436688455
/take
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] URLFetcherOpDesc.sourceSchema silently falls back to ANY when decodingMethod is null [texera]
Posted by "xuang7 (via GitHub)" <gi...@apache.org>.
xuang7 closed issue #4815: URLFetcherOpDesc.sourceSchema silently falls back to ANY when decodingMethod is null
URL: https://github.com/apache/texera/issues/4815
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org