You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@daffodil.apache.org by "Mike Beckerle (Jira)" <ji...@apache.org> on 2021/11/01 17:34:00 UTC
[jira] [Commented] (DAFFODIL-1830) PCAP - 50m.pcap and 100m.pcap do
not parse on 2.0.0-rc3
[ https://issues.apache.org/jira/browse/DAFFODIL-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17436953#comment-17436953 ]
Mike Beckerle commented on DAFFODIL-1830:
-----------------------------------------
Reported as an issue on the PCAP DFDL schema - see https://github.com/DFDLSchemas/PCAP/issues/14
> PCAP - 50m.pcap and 100m.pcap do not parse on 2.0.0-rc3
> -------------------------------------------------------
>
> Key: DAFFODIL-1830
> URL: https://issues.apache.org/jira/browse/DAFFODIL-1830
> Project: Daffodil
> Issue Type: Bug
> Components: General
> Affects Versions: 2.0.0
> Environment: Performance test platform
> Reporter: Dave Thompson
> Assignee: Dave Thompson
> Priority: Blocker
> Fix For: 2.0.0
>
>
> When attempting to run the pcap performance tests found that the 50m.pcap and 100m.pcap test files did not successfully parse. Executed the daffodil parse command separately for each file and got the following results.
> 50m.pcap Command with -I null: [~] ()$ daffodil/daffodil-cli/target/universal/stage/bin/daffodil parse -I null -s /home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd /home/dfdl/ngf-dfdl/daffodil-perf/src/test/resources/edu/illinois/ncsa/daffodil/pcap/50m.pcap Message: [warning] Left over data. Consumed 12432 bit(s) with 419426128 bit(s) remaining. Command with -I xml: [~] ()$ daffodil/daffodil-cli/target/universal/stage/bin/daffodil parse -I xml -s /home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd /home/dfdl/ngf-dfdl/daffodil-perf/src/test/resources/edu/illinois/ncsa/daffodil/pcap/50m.pcap Results: <pcap:PCAP xmlns:pcap="urn:pcap:2.4"> <PCAPHeader> ���� <MagicNumber>D4C3B2A1</MagicNumber> ���� <Version> �������� <Major>2</Major> �������� <Minor>4</Minor> ���� </Version> ���� <Zone>0</Zone> ���� <SigFigs>0</SigFigs> ���� <SnapLen>65535</SnapLen> ���� <Network>1</Network> </PCAPHeader> <Packet> ���� <PacketHeader> �������� <Seconds>1367244575</Seconds> �������� <USeconds>191642</USeconds> �������� <InclLen>1514</InclLen> �������� <OrigLen>1514</OrigLen> ���� </PacketHeader> ���� <pcap:LinkLayer> �������� <pcap:Ethernet> ������������ <MACDest>3C4A92729886</MACDest> ������������ <MACSrc>001B2134662C</MACSrc> ������������ <Ethertype>2048</Ethertype> ������������ <pcap:NetworkLayer> ���������������� <pcap:IPv4> �������������������� <IPv4Header> ������������������������ <Version>4</Version> ������������������������ <IHL>5</IHL> ������������������������ <DSCP>0</DSCP> ������������������������ <ECN>0</ECN> ������������������������ <Length>1500</Length> ������������������������ <Identification>36974</Identification> ������������������������ <Flags>2</Flags> ������������������������ <FragmentOffset>0</FragmentOffset> ������������������������ <TTL>49</TTL> ������������������������ <Protocol>6</Protocol> ������������������������ <Checksum>20238</Checksum> ������������������������ <IPSrc>146.137.96.7</IPSrc> ������������������������ <IPDest>192.168.177.102</IPDest> �������������������� </IPv4Header> �������������������� <Protocol>6</Protocol> �������������������� <pcap:TransportLayer> ������������������������ <pcap:TCP> ���������������������������� <TCPHeader> ������������������������ ����������<PortSRC>80</PortSRC> �������������������������������� <PortDest>37199</PortDest> �������������������������������� <Seq>802941038</Seq> �������������������������������� <Ack>71825065</Ack> �������������������������������� <DataOffset>8</DataOffset> �������������������������������� <Reserved>0</Reserved> �������������������������������� <Flags>16</Flags> �������������������������������� <WindowSize>54</WindowSize> �������������������������������� <Checksum>40234</Checksum> �������������������������������� <Urgent>0</Urgent> �������������������������������� <Options>0101080A314391951321EA44</Options> ���������������������������� </TCPHeader> ���������������������������� <Data>68C263E237A3DB9073CC9809FF2E3DFFB1C5A686E28FCDA362C25F5615AF4E0D7DD623CF008103C51DF23C88CF155B66AC29B15D65F4BE96D075B441736CBB415B6C2787117ED7AB3F430C86E9177848E6B1070D18B3CDC48E7318E18FC961ECA4398897F076D21CCC4B583B316026B713139E8976129726E9A4F8501AD1666C716E2A06BF669B89DB22F110CC3643B6719D26985E2137EC436D71FB0C3FFD67E34CDC88980B39BC2D6EDCC0131F6FF8697C8A316F7CA6618741ED768107FB5C5BBCCC8BE25B50042FB49FB5C5779BDAF70A78EC5B6DF1C3467B8245B4637F6A4B4837B5978AF69156D47DA6F6ADB2BD1BF53DA676C917F64AB6448B613389696EEDBD025B625ED033719DAFC475065F898174D52E7594D8666ADF21F07F857539B1D79837718F681F85FD240E9ADA4745FBD13AC4648BD13E2D55B4630F6B9B966B6A97FC1E3B84BAD324B7168397692D6E415B249A4DEDD33AA4CC695DE836743DCD74C615B5BD8AFB94B01FC3A7A6ED33E11956B92F986044BB292E5952F8332F9B252D78BDB6A41973591097AAE282DE5912302521ED026745483BF7530B48569382E3159DFF84EC23E45EC0E21672F8761DEA2DFA5EC966D9A29FA9DA2C5BF5B37A9B65BB7E766AB374EB67AD36CB2EFDF99ACDB2573F17B259F64BFF2598F1C8F1DF3A874A98F8DF3C49FC6F0E8EFFD63C1107ACA0CD2A6CC6B6183E685D27DB7D280153BDCD04B3DD54DF69AAEFD1E1B14F37C6C6B61B30D1F1466C9F3A60C4F0980E2356C70C18312A66CCC0139D69F866ACB07F5B5E1AD998E1CBD3C6A45FF0186BE08F36F9754CBC116FAD03069EE86E51CFEFA475C4A039C66DB4C75498D6944E53AC5827FDB48DE283A1C7F81403267AC0A02DBA59C8E166F241295BEB41CAAF0C78EB2143BFD671E1CB36D8A86D4ED8F72E0063ACB3B65463AC4DC6071B60EC2DC27E6C6E2AFA3B6CC06BBCD7616B09DEC372F80E941DB2BE1345C628DB08B3253191EB26053FBFB625E5CAF6E0F75E6C494E4143928FF01A7E94D4663C1793E70FE2CC2147DF83D8945CC3D792DA8DBDA16D67D5C47375CEAFAD44DF7783564326495B0C79266D57C3C69324FB049CF24C3EA9CB38777A20DAD4AE86D290D4457C4E82674FD07991E9EC45D1E5603AF3B1251D32CE7CA6348B3839655BB0CCA76C0BA521660FC68E19BCB314813369CFE4E7184CFA0E2B43A908730ED0613A43C6BCAC2E320CC54CD61C1986E221DB6A7A7FCC784F0CF4847DB7CDDC6E633D91F1D39AC8FA0D9B678391E1696D65A3FA3B6690854143D750A88FD0B3B72ED339CF2379B23D45E8AB2A8CBEA6C787D53BC618744E4F0FAB53EB23A6F7301F6931CDDB2160A6DBA998F0AC8D7C1E4BF1707AD57FF7EC37F8CC647AE8FB0FC01DACEBE9B4A78B337D94972862FEF4EE49DA4DF9C6F441E3AC633AE5A8E1E04D6792776C0B8F7346BC71063223250CCD6B839E7DD86698F2901979466C9951A6187567643C94BBCE680EA24DCFA9667418FA9AB1DD84335E7FEF42E401E2BD0BDB8CAE2AED1DB3E0F65E714EC2C7EE8CAC774E4F5FD858A49DF7729DCED82BF8B5C28F66C8F3C61943CCFA9FE9665E8CF7A2FFD36E92ED90496E2332F662CF3863D40CAF2AAD534D769E20FC7AC678C8793EA761664A68FBCC4C2AC65C33EDC6BA36B3A42AECBA39B3C2583767AE5315FB045F9B095B9DD916AAD3193B0D799E680B3EFB9AB92D147EE64498AE88307CBD9BB927321ED2CBCC7D1161F8FA38F3A05C3B10C7668E8AFA2388C9C9CC9055B26AC82A392D7C8E91AC1AB24ACE318D2D348D2D9D646CA149CE6EBBBE3625AFFDDF79DE64E409C94E2DAF0E9673B2FBFF1A7E9EE325B7193E9BDC113E774AEE12F5E43E9441B116248F04E745C97DE1F3BD594CC6997494B562EC2C77F03A322BDD8845B34C795DF248C4E75C5CFEB3DA429FC189773EEDF2399D6157B3B69BEA3B4CF51EA3AEE3477DE17EF4F5EAEFC9DB66EDF9BF3717C970D63EFD79A86DD660C4F746F8D9C5AC8321F460DC049C63FA7B</Data> ������������������������ </pcap:TCP> �������������������� </pcap:TransportLayer> ���������������� </pcap:IPv4> ������������ </pcap:NetworkLayer> �������� </pcap:Ethernet> ���� </pcap:LinkLayer> </Packet> </pcap:PCAP> [warning] Left over data. Consumed 12432 bit(s) with 419426128 bit(s) remaining. 100m.pcap Command: [~] ()$ daffodil/daffodil-cli/target/universal/stage/bin/daffodil parse -I xml -s /home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd /home/dfdl/ngf-dfdl/daffodil-perf/src/test/resources/edu/illinois/ncsa/daffodil/pcap/100m.pcap Error message (same for -I null or -I xml): [error] Parse Error: Failed to populate Packet[1]. Expected 1 item(s). Cause: Parse Error: All alternatives failed. Reason(s): List(Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv4 Schema context: sequence Location line 179 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100, Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv6 Schema context: sequence Location line 287 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd, Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100. Schema context: Packet Location line 29 column 10 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 104858829 [error] Parse Error: All alternatives failed. Reason(s): List(Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv4 Schema context: sequence Location line 179 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100, Parse Error: Alternative failed. Reason(s): List(Parse Error: Assertion failed. Ethertype is not IPv6 Schema context: sequence Location line 287 column 8 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100) Schema context: pcap:IPv4 Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd, Location line 177 column 4 in file:/home/dfdl/dfdl-dataformats/data-formats/PCAP/src/main/resources/com/tresys/pcap/xsd/pcap.dfdl.xsd Data location was preceding byte 54 limit(bytes) 100
--
This message was sent by Atlassian Jira
(v8.3.4#803005)