You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Mark Wagner (JIRA)" <ji...@apache.org> on 2017/04/07 19:29:41 UTC

[jira] [Created] (HIVE-16408) SchemaToTypeInfo in AvroSerde makes many calls to synchronized functions

Mark Wagner created HIVE-16408:
----------------------------------

             Summary: SchemaToTypeInfo in AvroSerde makes many calls to synchronized functions
                 Key: HIVE-16408
                 URL: https://issues.apache.org/jira/browse/HIVE-16408
             Project: Hive
          Issue Type: Bug
          Components: Serializers/Deserializers
            Reporter: Mark Wagner


The generateTypeInfo method uses schema.getProp and schema.getJsonProp to retrieve metadata from the Avro schema. Both of those methods result in synchronization on the schema. generateTypeInfo is being called for every nullable field in every record, which makes it a significant bottleneck in multi-threaded use.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)