You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by Clemens Vasters <cl...@microsoft.com.INVALID> on 2024/01/08 14:15:55 UTC
Media Type
The spec states that the media type for Avro should be "avro/binary, which is in conflict with the common pattern of the IANA media type registry and Avro is also not registered there.
In the CNCF CloudEvents and CNCF xRegistry efforts we take Avro dependencies and we also take dependencies on Avro in Microsoft Azure and Microsoft Fabric, and that aspect irks me.
Has there ever been an effort to register the media type formally?
Thank you
Clemens
clemensv@microsoft.com
Re: Media Type
Posted by Tim Robertson <ti...@apache.org>.
Hi folks
I stumbled upon this thread while searching for https://issues.apache.org/jira/browse/AVRO-488
At our organisation (GBIF.org) we issue Digital Object Identifiers (DOIs) for all datasets we deliver - some of which are in Avro format, and go into Google, Amazon and MS public datasets. In the DOI metadata we have to fill the MIME type and we thought it might be good to use a proper one as it'll live in this metadata for years.
Hope this helps.
Cheers,
Tim
On 2024/01/08 18:25:54 Ryan Skraba wrote:
> This sounds like an issue just waiting for someone to be sufficiently irked!
>
> Is there any reason NOT to use the common pattern? I really haven't run
> across any use cases that use the media type at all!
>
> All my best, Ryan
>
> On Mon, Jan 8, 2024 at 6:58 PM Ismaël Mejía <ie...@gmail.com> wrote:
>
> > I lack the background on why that odd "avro/binary" style was chosen.
> > Registering an IANA media type for Avro and supporting it in the different
> > implementations sounds like an excellent idea!
> >
> > Other Apache projects have registered IANA types like
> > 'application/vnd.apache.thrift.binary' or
> > 'application/vnd.apache.arrow.stream' but I have seeing "application/avro"
> > used in many projects in the wild like
> >
> > https://github.com/apache/camel/blob/2f11b3147d4d1d53bf59ffd54ac098f674c29efe/core/camel-api/src/main/java/org/apache/camel/spi/MimeType.java#L31-L34
> >
> > It should not be a major issue of course to support this (we would need to
> > update the spec and the language specific IPC implementations to support
> > the new type + deprecate the "avro/binary" media type.
> >
> > So far I have never seeing anyone mention registering a proper media type
> > for Avro. Anyone see any issues (that I might be missing) if we do this?
> > What do others think? Other ideas/comments?
> >
> > Ismaël
> >
> >
> > On Mon, Jan 8, 2024 at 4:32 PM Clemens Vasters
> > <cl...@microsoft.com.invalid> wrote:
> >
> > > The spec states that the media type for Avro should be "avro/binary,
> > which
> > > is in conflict with the common pattern of the IANA media type registry
> > and
> > > Avro is also not registered there.
> > >
> > > In the CNCF CloudEvents and CNCF xRegistry efforts we take Avro
> > > dependencies and we also take dependencies on Avro in Microsoft Azure and
> > > Microsoft Fabric, and that aspect irks me.
> > >
> > > Has there ever been an effort to register the media type formally?
> > >
> > > Thank you
> > > Clemens
> > >
> > > clemensv@microsoft.com
> > >
> >
>
Re: Media Type
Posted by Ryan Skraba <ry...@skraba.com>.
This sounds like an issue just waiting for someone to be sufficiently irked!
Is there any reason NOT to use the common pattern? I really haven't run
across any use cases that use the media type at all!
All my best, Ryan
On Mon, Jan 8, 2024 at 6:58 PM Ismaël Mejía <ie...@gmail.com> wrote:
> I lack the background on why that odd "avro/binary" style was chosen.
> Registering an IANA media type for Avro and supporting it in the different
> implementations sounds like an excellent idea!
>
> Other Apache projects have registered IANA types like
> 'application/vnd.apache.thrift.binary' or
> 'application/vnd.apache.arrow.stream' but I have seeing "application/avro"
> used in many projects in the wild like
>
> https://github.com/apache/camel/blob/2f11b3147d4d1d53bf59ffd54ac098f674c29efe/core/camel-api/src/main/java/org/apache/camel/spi/MimeType.java#L31-L34
>
> It should not be a major issue of course to support this (we would need to
> update the spec and the language specific IPC implementations to support
> the new type + deprecate the "avro/binary" media type.
>
> So far I have never seeing anyone mention registering a proper media type
> for Avro. Anyone see any issues (that I might be missing) if we do this?
> What do others think? Other ideas/comments?
>
> Ismaël
>
>
> On Mon, Jan 8, 2024 at 4:32 PM Clemens Vasters
> <cl...@microsoft.com.invalid> wrote:
>
> > The spec states that the media type for Avro should be "avro/binary,
> which
> > is in conflict with the common pattern of the IANA media type registry
> and
> > Avro is also not registered there.
> >
> > In the CNCF CloudEvents and CNCF xRegistry efforts we take Avro
> > dependencies and we also take dependencies on Avro in Microsoft Azure and
> > Microsoft Fabric, and that aspect irks me.
> >
> > Has there ever been an effort to register the media type formally?
> >
> > Thank you
> > Clemens
> >
> > clemensv@microsoft.com
> >
>
Re: Media Type
Posted by Ismaël Mejía <ie...@gmail.com>.
I lack the background on why that odd "avro/binary" style was chosen.
Registering an IANA media type for Avro and supporting it in the different
implementations sounds like an excellent idea!
Other Apache projects have registered IANA types like
'application/vnd.apache.thrift.binary' or
'application/vnd.apache.arrow.stream' but I have seeing "application/avro"
used in many projects in the wild like
https://github.com/apache/camel/blob/2f11b3147d4d1d53bf59ffd54ac098f674c29efe/core/camel-api/src/main/java/org/apache/camel/spi/MimeType.java#L31-L34
It should not be a major issue of course to support this (we would need to
update the spec and the language specific IPC implementations to support
the new type + deprecate the "avro/binary" media type.
So far I have never seeing anyone mention registering a proper media type
for Avro. Anyone see any issues (that I might be missing) if we do this?
What do others think? Other ideas/comments?
Ismaël
On Mon, Jan 8, 2024 at 4:32 PM Clemens Vasters
<cl...@microsoft.com.invalid> wrote:
> The spec states that the media type for Avro should be "avro/binary, which
> is in conflict with the common pattern of the IANA media type registry and
> Avro is also not registered there.
>
> In the CNCF CloudEvents and CNCF xRegistry efforts we take Avro
> dependencies and we also take dependencies on Avro in Microsoft Azure and
> Microsoft Fabric, and that aspect irks me.
>
> Has there ever been an effort to register the media type formally?
>
> Thank you
> Clemens
>
> clemensv@microsoft.com
>