Re: How to nil an entity that has length specified by an expression?

[Steve Lawrence <sl...@apache.org>]

There are a number of characters that are illegal to use in XML. The NUL 
character (0x00) is one of these. When Daffodil projects these characters to 
XML, we map those illegal characters to the Unicode Private Use Areas. Here's 
details on how we map these characters:

https://daffodil.apache.org/infoset/#xml-illegal-characters

This means that when 0x00 appears in an infoset, we map it to 0xE000 in XML. And 
these PUA areas must be used for validation regexes since that is what 
validators use. For example, you schema might look something like this:

   <element name="field" dfdl:lengthKind="explicit" dfdl:length="{ ../length }">
     <simpleType>
       <restriction base="xs:string">
         <pattern value="&#xE000;*" />
       </restriction>
     </simpleType>
   </element>



On 2025-11-26 03:59 PM, Mark Kozak wrote:
> Hi Folks,
> 
> I am reaching out after trying a dozen approaches today.
> 
> My goal is to validate a string whose length is given as an expression from a 
> previous field contains only the Null character (hex 00). I have tried a variety 
> of regular expression patterns which didn’t work. Just setting the entity to be 
> Nil would be great but I can’t use the but when dfdl:nilKind is literalCharacter 
> the entity must be fix-length.
> 
> Looking for a clever solution please.
> 
> Thanks, and have a great Thanksgiving Holiday!
> 
> -Mark
> 
> Mark Kozak
> 
> Director of Engineering
> 
> Adeptus Cyber Solutions
> 
> Adeptus-CS.com
> 

RE: How to nil an entity that has length specified by an expression?

[Mark Kozak <ma...@adeptus-cs.com>]

That's a clever solution to the illegal character problem. Works perfectly!. 
Thank you.

-----Original Message-----
From: Steve Lawrence <sl...@apache.org> 
Sent: Monday, December 1, 2025 9:00 AM
To: users@daffodil.apache.org
Subject: Re: How to nil an entity that has length specified by an expression?

There are a number of characters that are illegal to use in XML. The NUL character (0x00) is one of these. When Daffodil projects these characters to XML, we map those illegal characters to the Unicode Private Use Areas. Here's details on how we map these characters:

https://daffodil.apache.org/infoset/#xml-illegal-characters

This means that when 0x00 appears in an infoset, we map it to 0xE000 in XML. And these PUA areas must be used for validation regexes since that is what validators use. For example, you schema might look something like this:

   <element name="field" dfdl:lengthKind="explicit" dfdl:length="{ ../length }">
     <simpleType>
       <restriction base="xs:string">
         <pattern value="&#xE000;*" />
       </restriction>
     </simpleType>
   </element>



On 2025-11-26 03:59 PM, Mark Kozak wrote:
> Hi Folks,
> 
> I am reaching out after trying a dozen approaches today.
> 
> My goal is to validate a string whose length is given as an expression 
> from a previous field contains only the Null character (hex 00). I 
> have tried a variety of regular expression patterns which didn’t work. 
> Just setting the entity to be Nil would be great but I can’t use the 
> but when dfdl:nilKind is literalCharacter the entity must be fix-length.
> 
> Looking for a clever solution please.
> 
> Thanks, and have a great Thanksgiving Holiday!
> 
> -Mark
> 
> Mark Kozak
> 
> Director of Engineering
> 
> Adeptus Cyber Solutions
> 
> Adeptus-CS.com
>