You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Fabian Hueske (JIRA)" <ji...@apache.org> on 2018/03/04 18:52:00 UTC

[jira] [Created] (FLINK-8854) Mapping of SchemaValidator.deriveFieldMapping() is incorrect.

Fabian Hueske created FLINK-8854:
------------------------------------

             Summary: Mapping of SchemaValidator.deriveFieldMapping() is incorrect.
                 Key: FLINK-8854
                 URL: https://issues.apache.org/jira/browse/FLINK-8854
             Project: Flink
          Issue Type: Bug
          Components: Table API &amp; SQL
    Affects Versions: 1.5.0
            Reporter: Fabian Hueske
             Fix For: 1.5.0


The field mapping returned by {{SchemaValidator.deriveFieldMapping()}} is not correct.

It should not only include all fields of the table schema, but also all fields of the format schema (mapped to themselves). Otherwise, it is not possible to use a timestamp extractor on a field that is not in table schema. 

For example this configuration would fail:

{code}
sources:
  - name: TaxiRides
    schema:
      - name: rideId
        type: LONG
      - name: rowTime
        type: TIMESTAMP
        rowtime:
          timestamps:
            type: "from-field"
            from: "rideTime"
          watermarks:
            type: "periodic-bounded"
            delay: "60000"
    connector:
      ....
    format:
      property-version: 1
      type: json
      schema: "ROW(rideId LONG, rideTime TIMESTAMP)"
{code}

because {{rideTime}} is not in the table schema.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)