You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafficserver.apache.org by "Leif Hedstrom (JIRA)" <ji...@apache.org> on 2010/09/16 21:33:32 UTC
[jira] Created: (TS-441) Errors and crashes reported on the cache
Errors and crashes reported on the cache
----------------------------------------
Key: TS-441
URL: https://issues.apache.org/jira/browse/TS-441
Project: Traffic Server
Issue Type: Bug
Components: Cache
Affects Versions: 2.1.2
Reporter: Leif Hedstrom
Priority: Critical
Fix For: 2.1.3
This is from Pranav Desai:
I am running a load test with some video files to see . I am using
curl-loader to generate the load. I have modified it to add a random
number to the URLs before sending so I can test with a single URL and
still stress the cache. The webserver is a lighttpd server with
rewrite rules to translate the random strings back to a common URL.
The URL is essentially a 15MB video file. I can provide more details
on the setup if needed.
Here are the errors I see in /var/log/messages
Sep 16 12:05:31 c1b14 traffic_server[30008]: {1095895360} NOTE:
OpenReadHead failed for cachekey F99D907A : vector inconsistency with
2408
Sep 16 12:05:33 c1b14 traffic_server[30008]: {1077999936} NOTE:
OpenReadHead failed for cachekey 8CEE75D9 : vector inconsistency with
2416
Sep 16 12:05:33 c1b14 traffic_server[30008]: {1079052608} NOTE:
OpenReadHead failed for cachekey 2DC0CAB : vector inconsistency with
2416
Sep 16 12:05:34 c1b14 traffic_server[30008]: {1083263296} NOTE:
OpenReadHead failed for cachekey 21712A98 : vector inconsistency with
2416
Sep 16 12:05:36 c1b14 traffic_server[30008]: {1105369408} NOTE:
OpenReadHead failed for cachekey FFD8902 : vector inconsistency with
2416
Sep 16 12:05:36 c1b14 traffic_server[30008]: {1074841920} NOTE:
OpenReadHead failed for cachekey C28AE2D3 : vector inconsistency with
2416
Sep 16 12:05:37 c1b14 traffic_server[30008]: {1083263296} NOTE:
OpenReadHead failed for cachekey 38E6F4CE : vector inconsistency with
2416
...
lots of them.
Sep 16 12:05:53 c1b14 traffic_server[30008]: {1102211392} NOTE:
OpenReadHead failed for cachekey 160CEE08 : vector inconsistency with
2416
Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} FATAL:
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} FATAL:
(last system error 104: Connection reset by peer)
Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} NOTE:
[LocalManager::mgmtShutdown] Executing shutdown request.
Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} NOTE:
[LocalManager::processShutdown] Executing process shutdown request.
Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} ERROR:
[LocalManager::sendMgmtMsgToProcesses] Error writing message
Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} ERROR:
(last system error 32: Broken pipe)
Sep 16 12:05:55 c1b14 traffic_cop[29996]: cop received child status
signal [29998 2816]
Sep 16 12:05:55 c1b14 traffic_cop[29996]: traffic_manager not running,
making sure traffic_server is dead
Sep 16 12:05:55 c1b14 traffic_cop[29996]: spawning traffic_manager
Sep 16 12:05:55 c1b14 traffic_manager[30116]: NOTE: --- Manager Starting ---
I dont know if its generating a core, atleast I couldnt find one, it
does have a bunch of these messages in traffic.out. I can send the
traffic.out file if it helps. I do have ulimit set correctly on the
shell that I run 'trafficserver start' from, but not sure if its
needed within the script as well ?
-------------- End header heap dump -----------
WARNING: Unmarshal failed due to unknow obj type 121 after 776
bytes---- Dumping header heap @ 0x2aaab7284808 - len 1209 ------
0x2aaab7284808: 0xdcbafeed 0xa1e63532 0xb7284b80 0x2aaa
0x2aaab7284818: 0xb7284890 0x2aaa 0x378 0x907cbe00
0x2aaab7284828: 0x0 0x0 0x0 0x1fab0054
0x2aaab7284838: 0x0 0x0 0x1c01430 0x0
0x2aaab7284848: 0xb7284b80 0x2aaa 0x141 0xd48914a0
0x2aaab7284858: 0x1b564038 0x816a7c80 0x0 0x0
0x2aaab7284868: 0x7e29048b 0x6fbc0a8e 0x5b1c996 0x4daab81d
I dont see this behavior with 2.0.1.
Let me know if you need more information.
Thanks
-- Pranav
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Work started: (TS-441) Errors and crashes reported on the
cache
Posted by "John Plevyak (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TS-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Work on TS-441 started by John Plevyak.
> Errors and crashes reported on the cache
> ----------------------------------------
>
> Key: TS-441
> URL: https://issues.apache.org/jira/browse/TS-441
> Project: Traffic Server
> Issue Type: Bug
> Components: Cache
> Affects Versions: 2.1.2
> Reporter: Leif Hedstrom
> Assignee: John Plevyak
> Priority: Critical
> Fix For: 2.1.3
>
>
> This is from Pranav Desai:
> I am running a load test with some video files to see . I am using
> curl-loader to generate the load. I have modified it to add a random
> number to the URLs before sending so I can test with a single URL and
> still stress the cache. The webserver is a lighttpd server with
> rewrite rules to translate the random strings back to a common URL.
> The URL is essentially a 15MB video file. I can provide more details
> on the setup if needed.
> Here are the errors I see in /var/log/messages
> Sep 16 12:05:31 c1b14 traffic_server[30008]: {1095895360} NOTE:
> OpenReadHead failed for cachekey F99D907A : vector inconsistency with
> 2408
> Sep 16 12:05:33 c1b14 traffic_server[30008]: {1077999936} NOTE:
> OpenReadHead failed for cachekey 8CEE75D9 : vector inconsistency with
> 2416
> Sep 16 12:05:33 c1b14 traffic_server[30008]: {1079052608} NOTE:
> OpenReadHead failed for cachekey 2DC0CAB : vector inconsistency with
> 2416
> Sep 16 12:05:34 c1b14 traffic_server[30008]: {1083263296} NOTE:
> OpenReadHead failed for cachekey 21712A98 : vector inconsistency with
> 2416
> Sep 16 12:05:36 c1b14 traffic_server[30008]: {1105369408} NOTE:
> OpenReadHead failed for cachekey FFD8902 : vector inconsistency with
> 2416
> Sep 16 12:05:36 c1b14 traffic_server[30008]: {1074841920} NOTE:
> OpenReadHead failed for cachekey C28AE2D3 : vector inconsistency with
> 2416
> Sep 16 12:05:37 c1b14 traffic_server[30008]: {1083263296} NOTE:
> OpenReadHead failed for cachekey 38E6F4CE : vector inconsistency with
> 2416
> ...
> lots of them.
> Sep 16 12:05:53 c1b14 traffic_server[30008]: {1102211392} NOTE:
> OpenReadHead failed for cachekey 160CEE08 : vector inconsistency with
> 2416
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} FATAL:
> [LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} FATAL:
> (last system error 104: Connection reset by peer)
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} NOTE:
> [LocalManager::mgmtShutdown] Executing shutdown request.
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} NOTE:
> [LocalManager::processShutdown] Executing process shutdown request.
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} ERROR:
> [LocalManager::sendMgmtMsgToProcesses] Error writing message
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} ERROR:
> (last system error 32: Broken pipe)
> Sep 16 12:05:55 c1b14 traffic_cop[29996]: cop received child status
> signal [29998 2816]
> Sep 16 12:05:55 c1b14 traffic_cop[29996]: traffic_manager not running,
> making sure traffic_server is dead
> Sep 16 12:05:55 c1b14 traffic_cop[29996]: spawning traffic_manager
> Sep 16 12:05:55 c1b14 traffic_manager[30116]: NOTE: --- Manager Starting ---
> I dont know if its generating a core, atleast I couldnt find one, it
> does have a bunch of these messages in traffic.out. I can send the
> traffic.out file if it helps. I do have ulimit set correctly on the
> shell that I run 'trafficserver start' from, but not sure if its
> needed within the script as well ?
> -------------- End header heap dump -----------
> WARNING: Unmarshal failed due to unknow obj type 121 after 776
> bytes---- Dumping header heap @ 0x2aaab7284808 - len 1209 ------
> 0x2aaab7284808: 0xdcbafeed 0xa1e63532 0xb7284b80 0x2aaa
> 0x2aaab7284818: 0xb7284890 0x2aaa 0x378 0x907cbe00
> 0x2aaab7284828: 0x0 0x0 0x0 0x1fab0054
> 0x2aaab7284838: 0x0 0x0 0x1c01430 0x0
> 0x2aaab7284848: 0xb7284b80 0x2aaa 0x141 0xd48914a0
> 0x2aaab7284858: 0x1b564038 0x816a7c80 0x0 0x0
> 0x2aaab7284868: 0x7e29048b 0x6fbc0a8e 0x5b1c996 0x4daab81d
> I dont see this behavior with 2.0.1.
> Let me know if you need more information.
> Thanks
> -- Pranav
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (TS-441) Errors and crashes reported on the cache
Posted by "Pranav Desai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TS-441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12912800#action_12912800 ]
Pranav Desai commented on TS-441:
---------------------------------
started with running traffic_server without the traffic_manager.
./bin/traffic_server -n 1 -K -k
and
./bin/traffic_server
In both cases the server crashed after a few minute at the same place. The load as mentioned above is curl-loader generated.
Here is the stack trace. I still cant seem to get the core dump. Am I missing something, debug build etc. ?
FATAL: HTTP.cc:1526: failed assert `!"unknown m_polarity"`
./bin/traffic_server - STACK TRACE:
./bin/traffic_server(ink_fatal+0x86)[0x6f2056]
./bin/traffic_server(_ink_assert+0x81)[0x6f0d61]
./bin/traffic_server(_ZN11HTTPHdrImpl9unmarshalEl+0x35)[0x5ea385]
./bin/traffic_server(_ZN7HdrHeap9unmarshalEiiPP14HdrHeapObjImplP11RefCountObj+0x146)[0x5df926]
./bin/traffic_server(_ZN8HTTPInfo9unmarshalEPciP11RefCountObj+0xc5)[0x5ea205]
./bin/traffic_server(_ZN7CacheVC14handleReadDoneEiP5Event+0x750)[0x6648a0]
./bin/traffic_server(_ZN19AIOCallbackInternal11io_completeEiPv+0x26)[0x66ce26]
./bin/traffic_server(_ZN7EThread13process_eventEP5Eventi+0x22f)[0x6e7c0f]
./bin/traffic_server(_ZN7EThread7executeEv+0x1aa)[0x6e810a]
./bin/traffic_server[0x6e76da]
/lib64/libpthread.so.0[0x7f4a565e52e7]
/lib64/libc.so.6(clone+0x6d)[0x32a18ce3bd]
There are few other errors before the trace:
Sep 20 18:12:47 c1b14 traffic_server[11069]: {1119537472} NOTE: OpenReadHead failed for cachekey 5D0E9DC9 : vector inconsistency with 2416
> Errors and crashes reported on the cache
> ----------------------------------------
>
> Key: TS-441
> URL: https://issues.apache.org/jira/browse/TS-441
> Project: Traffic Server
> Issue Type: Bug
> Components: Cache
> Affects Versions: 2.1.2
> Reporter: Leif Hedstrom
> Priority: Critical
> Fix For: 2.1.3
>
>
> This is from Pranav Desai:
> I am running a load test with some video files to see . I am using
> curl-loader to generate the load. I have modified it to add a random
> number to the URLs before sending so I can test with a single URL and
> still stress the cache. The webserver is a lighttpd server with
> rewrite rules to translate the random strings back to a common URL.
> The URL is essentially a 15MB video file. I can provide more details
> on the setup if needed.
> Here are the errors I see in /var/log/messages
> Sep 16 12:05:31 c1b14 traffic_server[30008]: {1095895360} NOTE:
> OpenReadHead failed for cachekey F99D907A : vector inconsistency with
> 2408
> Sep 16 12:05:33 c1b14 traffic_server[30008]: {1077999936} NOTE:
> OpenReadHead failed for cachekey 8CEE75D9 : vector inconsistency with
> 2416
> Sep 16 12:05:33 c1b14 traffic_server[30008]: {1079052608} NOTE:
> OpenReadHead failed for cachekey 2DC0CAB : vector inconsistency with
> 2416
> Sep 16 12:05:34 c1b14 traffic_server[30008]: {1083263296} NOTE:
> OpenReadHead failed for cachekey 21712A98 : vector inconsistency with
> 2416
> Sep 16 12:05:36 c1b14 traffic_server[30008]: {1105369408} NOTE:
> OpenReadHead failed for cachekey FFD8902 : vector inconsistency with
> 2416
> Sep 16 12:05:36 c1b14 traffic_server[30008]: {1074841920} NOTE:
> OpenReadHead failed for cachekey C28AE2D3 : vector inconsistency with
> 2416
> Sep 16 12:05:37 c1b14 traffic_server[30008]: {1083263296} NOTE:
> OpenReadHead failed for cachekey 38E6F4CE : vector inconsistency with
> 2416
> ...
> lots of them.
> Sep 16 12:05:53 c1b14 traffic_server[30008]: {1102211392} NOTE:
> OpenReadHead failed for cachekey 160CEE08 : vector inconsistency with
> 2416
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} FATAL:
> [LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} FATAL:
> (last system error 104: Connection reset by peer)
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} NOTE:
> [LocalManager::mgmtShutdown] Executing shutdown request.
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} NOTE:
> [LocalManager::processShutdown] Executing process shutdown request.
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} ERROR:
> [LocalManager::sendMgmtMsgToProcesses] Error writing message
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} ERROR:
> (last system error 32: Broken pipe)
> Sep 16 12:05:55 c1b14 traffic_cop[29996]: cop received child status
> signal [29998 2816]
> Sep 16 12:05:55 c1b14 traffic_cop[29996]: traffic_manager not running,
> making sure traffic_server is dead
> Sep 16 12:05:55 c1b14 traffic_cop[29996]: spawning traffic_manager
> Sep 16 12:05:55 c1b14 traffic_manager[30116]: NOTE: --- Manager Starting ---
> I dont know if its generating a core, atleast I couldnt find one, it
> does have a bunch of these messages in traffic.out. I can send the
> traffic.out file if it helps. I do have ulimit set correctly on the
> shell that I run 'trafficserver start' from, but not sure if its
> needed within the script as well ?
> -------------- End header heap dump -----------
> WARNING: Unmarshal failed due to unknow obj type 121 after 776
> bytes---- Dumping header heap @ 0x2aaab7284808 - len 1209 ------
> 0x2aaab7284808: 0xdcbafeed 0xa1e63532 0xb7284b80 0x2aaa
> 0x2aaab7284818: 0xb7284890 0x2aaa 0x378 0x907cbe00
> 0x2aaab7284828: 0x0 0x0 0x0 0x1fab0054
> 0x2aaab7284838: 0x0 0x0 0x1c01430 0x0
> 0x2aaab7284848: 0xb7284b80 0x2aaa 0x141 0xd48914a0
> 0x2aaab7284858: 0x1b564038 0x816a7c80 0x0 0x0
> 0x2aaab7284868: 0x7e29048b 0x6fbc0a8e 0x5b1c996 0x4daab81d
> I dont see this behavior with 2.0.1.
> Let me know if you need more information.
> Thanks
> -- Pranav
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (TS-441) Errors and crashes reported on the cache
Posted by "John Plevyak (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TS-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Plevyak resolved TS-441.
-----------------------------
Resolution: Fixed
This was fixed in SVN during the TS-446, TS-445, and TS-43 work.
> Errors and crashes reported on the cache
> ----------------------------------------
>
> Key: TS-441
> URL: https://issues.apache.org/jira/browse/TS-441
> Project: Traffic Server
> Issue Type: Bug
> Components: Cache
> Affects Versions: 2.1.2
> Reporter: Leif Hedstrom
> Assignee: John Plevyak
> Priority: Critical
> Fix For: 2.1.3
>
>
> This is from Pranav Desai:
> I am running a load test with some video files to see . I am using
> curl-loader to generate the load. I have modified it to add a random
> number to the URLs before sending so I can test with a single URL and
> still stress the cache. The webserver is a lighttpd server with
> rewrite rules to translate the random strings back to a common URL.
> The URL is essentially a 15MB video file. I can provide more details
> on the setup if needed.
> Here are the errors I see in /var/log/messages
> Sep 16 12:05:31 c1b14 traffic_server[30008]: {1095895360} NOTE:
> OpenReadHead failed for cachekey F99D907A : vector inconsistency with
> 2408
> Sep 16 12:05:33 c1b14 traffic_server[30008]: {1077999936} NOTE:
> OpenReadHead failed for cachekey 8CEE75D9 : vector inconsistency with
> 2416
> Sep 16 12:05:33 c1b14 traffic_server[30008]: {1079052608} NOTE:
> OpenReadHead failed for cachekey 2DC0CAB : vector inconsistency with
> 2416
> Sep 16 12:05:34 c1b14 traffic_server[30008]: {1083263296} NOTE:
> OpenReadHead failed for cachekey 21712A98 : vector inconsistency with
> 2416
> Sep 16 12:05:36 c1b14 traffic_server[30008]: {1105369408} NOTE:
> OpenReadHead failed for cachekey FFD8902 : vector inconsistency with
> 2416
> Sep 16 12:05:36 c1b14 traffic_server[30008]: {1074841920} NOTE:
> OpenReadHead failed for cachekey C28AE2D3 : vector inconsistency with
> 2416
> Sep 16 12:05:37 c1b14 traffic_server[30008]: {1083263296} NOTE:
> OpenReadHead failed for cachekey 38E6F4CE : vector inconsistency with
> 2416
> ...
> lots of them.
> Sep 16 12:05:53 c1b14 traffic_server[30008]: {1102211392} NOTE:
> OpenReadHead failed for cachekey 160CEE08 : vector inconsistency with
> 2416
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} FATAL:
> [LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} FATAL:
> (last system error 104: Connection reset by peer)
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} NOTE:
> [LocalManager::mgmtShutdown] Executing shutdown request.
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} NOTE:
> [LocalManager::processShutdown] Executing process shutdown request.
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} ERROR:
> [LocalManager::sendMgmtMsgToProcesses] Error writing message
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} ERROR:
> (last system error 32: Broken pipe)
> Sep 16 12:05:55 c1b14 traffic_cop[29996]: cop received child status
> signal [29998 2816]
> Sep 16 12:05:55 c1b14 traffic_cop[29996]: traffic_manager not running,
> making sure traffic_server is dead
> Sep 16 12:05:55 c1b14 traffic_cop[29996]: spawning traffic_manager
> Sep 16 12:05:55 c1b14 traffic_manager[30116]: NOTE: --- Manager Starting ---
> I dont know if its generating a core, atleast I couldnt find one, it
> does have a bunch of these messages in traffic.out. I can send the
> traffic.out file if it helps. I do have ulimit set correctly on the
> shell that I run 'trafficserver start' from, but not sure if its
> needed within the script as well ?
> -------------- End header heap dump -----------
> WARNING: Unmarshal failed due to unknow obj type 121 after 776
> bytes---- Dumping header heap @ 0x2aaab7284808 - len 1209 ------
> 0x2aaab7284808: 0xdcbafeed 0xa1e63532 0xb7284b80 0x2aaa
> 0x2aaab7284818: 0xb7284890 0x2aaa 0x378 0x907cbe00
> 0x2aaab7284828: 0x0 0x0 0x0 0x1fab0054
> 0x2aaab7284838: 0x0 0x0 0x1c01430 0x0
> 0x2aaab7284848: 0xb7284b80 0x2aaa 0x141 0xd48914a0
> 0x2aaab7284858: 0x1b564038 0x816a7c80 0x0 0x0
> 0x2aaab7284868: 0x7e29048b 0x6fbc0a8e 0x5b1c996 0x4daab81d
> I dont see this behavior with 2.0.1.
> Let me know if you need more information.
> Thanks
> -- Pranav
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (TS-441) Errors and crashes reported on the cache
Posted by "Leif Hedstrom (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TS-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leif Hedstrom reassigned TS-441:
--------------------------------
Assignee: John Plevyak
> Errors and crashes reported on the cache
> ----------------------------------------
>
> Key: TS-441
> URL: https://issues.apache.org/jira/browse/TS-441
> Project: Traffic Server
> Issue Type: Bug
> Components: Cache
> Affects Versions: 2.1.2
> Reporter: Leif Hedstrom
> Assignee: John Plevyak
> Priority: Critical
> Fix For: 2.1.3
>
>
> This is from Pranav Desai:
> I am running a load test with some video files to see . I am using
> curl-loader to generate the load. I have modified it to add a random
> number to the URLs before sending so I can test with a single URL and
> still stress the cache. The webserver is a lighttpd server with
> rewrite rules to translate the random strings back to a common URL.
> The URL is essentially a 15MB video file. I can provide more details
> on the setup if needed.
> Here are the errors I see in /var/log/messages
> Sep 16 12:05:31 c1b14 traffic_server[30008]: {1095895360} NOTE:
> OpenReadHead failed for cachekey F99D907A : vector inconsistency with
> 2408
> Sep 16 12:05:33 c1b14 traffic_server[30008]: {1077999936} NOTE:
> OpenReadHead failed for cachekey 8CEE75D9 : vector inconsistency with
> 2416
> Sep 16 12:05:33 c1b14 traffic_server[30008]: {1079052608} NOTE:
> OpenReadHead failed for cachekey 2DC0CAB : vector inconsistency with
> 2416
> Sep 16 12:05:34 c1b14 traffic_server[30008]: {1083263296} NOTE:
> OpenReadHead failed for cachekey 21712A98 : vector inconsistency with
> 2416
> Sep 16 12:05:36 c1b14 traffic_server[30008]: {1105369408} NOTE:
> OpenReadHead failed for cachekey FFD8902 : vector inconsistency with
> 2416
> Sep 16 12:05:36 c1b14 traffic_server[30008]: {1074841920} NOTE:
> OpenReadHead failed for cachekey C28AE2D3 : vector inconsistency with
> 2416
> Sep 16 12:05:37 c1b14 traffic_server[30008]: {1083263296} NOTE:
> OpenReadHead failed for cachekey 38E6F4CE : vector inconsistency with
> 2416
> ...
> lots of them.
> Sep 16 12:05:53 c1b14 traffic_server[30008]: {1102211392} NOTE:
> OpenReadHead failed for cachekey 160CEE08 : vector inconsistency with
> 2416
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} FATAL:
> [LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} FATAL:
> (last system error 104: Connection reset by peer)
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} NOTE:
> [LocalManager::mgmtShutdown] Executing shutdown request.
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} NOTE:
> [LocalManager::processShutdown] Executing process shutdown request.
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} ERROR:
> [LocalManager::sendMgmtMsgToProcesses] Error writing message
> Sep 16 12:05:55 c1b14 traffic_manager[29998]: {139744257029936} ERROR:
> (last system error 32: Broken pipe)
> Sep 16 12:05:55 c1b14 traffic_cop[29996]: cop received child status
> signal [29998 2816]
> Sep 16 12:05:55 c1b14 traffic_cop[29996]: traffic_manager not running,
> making sure traffic_server is dead
> Sep 16 12:05:55 c1b14 traffic_cop[29996]: spawning traffic_manager
> Sep 16 12:05:55 c1b14 traffic_manager[30116]: NOTE: --- Manager Starting ---
> I dont know if its generating a core, atleast I couldnt find one, it
> does have a bunch of these messages in traffic.out. I can send the
> traffic.out file if it helps. I do have ulimit set correctly on the
> shell that I run 'trafficserver start' from, but not sure if its
> needed within the script as well ?
> -------------- End header heap dump -----------
> WARNING: Unmarshal failed due to unknow obj type 121 after 776
> bytes---- Dumping header heap @ 0x2aaab7284808 - len 1209 ------
> 0x2aaab7284808: 0xdcbafeed 0xa1e63532 0xb7284b80 0x2aaa
> 0x2aaab7284818: 0xb7284890 0x2aaa 0x378 0x907cbe00
> 0x2aaab7284828: 0x0 0x0 0x0 0x1fab0054
> 0x2aaab7284838: 0x0 0x0 0x1c01430 0x0
> 0x2aaab7284848: 0xb7284b80 0x2aaa 0x141 0xd48914a0
> 0x2aaab7284858: 0x1b564038 0x816a7c80 0x0 0x0
> 0x2aaab7284868: 0x7e29048b 0x6fbc0a8e 0x5b1c996 0x4daab81d
> I dont see this behavior with 2.0.1.
> Let me know if you need more information.
> Thanks
> -- Pranav
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.