evostream hangs with 100% cpu
rogiermars asked 12 years ago
Hi,
After some time my evostreamms hangs with 100% cpu usage. It doesn’t respond to any command via the console or the web_ui. Also the log does not contain any entries after this condition occurs.
Name : evostream
Arch : noarch
Version : 1.6.2.2286
Release : 1.el6
Size : 2.4 k
I run CentOS 6.4 64 bit. The strace output of the process gives an endless string of the lines pasted below. I’ve also pasted the entries in the last section of the logfile below.
I hope you can help me solve this problem as we are doing a proof of concept with Evostream for a possible customer.
Cheers,
Rogier
================ STRACE ===========================
wait4(-1, 0x7ffffdc4ccdc, WNOHANG, NULL) = 0
wait4(-1, 0x7ffffdc4ccdc, WNOHANG, NULL) = 0
wait4(-1, 0x7ffffdc4ccdc, WNOHANG, NULL) = 0
wait4(-1, 0x7ffffdc4ccdc, WNOHANG, NULL) = 0
wait4(-1, 0x7ffffdc4ccdc, WNOHANG, NULL) = 0
wait4(-1, 0x7ffffdc4ccdc, WNOHANG, NULL) = 0
wait4(-1, 0x7ffffdc4ccdc, WNOHANG, NULL) = 0
wait4(-1, 0x7ffffdc4ccdc, WNOHANG, NULL) = 0
================ Evostreamms log ===========================
PID: 17441; TIMESTAMP: 1366309703
1366309703:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol [PT(42342)] unregistered from application: evostreamms
1366309703:0:/thelib/src/streaming/hls/hlsplaylist.cpp:360:CloseSegment:Segment is not opened
1366309703:0:/common/src/utils/misc/file.cpp:83:Initialize:Unable to open file with mode `a+b`. Error was: (2) No such file or directory
1366309703:0:/thelib/src/streaming/hls/hlsplaylist.cpp:625:ClosePlaylist:Unable to open playlist
1366309704:3:/thelib/src/application/baseclientapplication.cpp:282:SignalStreamRegistered:Stream OFHLS(40329) with name `leo3` registered to application `evostreamms` from protocol PT(42343)
1366309704:0:/common/src/platform/linux/linuxplatform.cpp:402:createFolder:Unable to create folder /var/www/hls/hlstest/leo3/
1366309704:0:/thelib/src/streaming/hls/hlsplaylist.cpp:76:Init:Unable to create target folder /var/www/hls/hlstest/leo3/
1366309704:0:/thelib/src/streaming/hls/outfilehlsstream.cpp:117:FinishInitialization:Unable to initialize play list
1366309704:0:/thelib/src/streaming/baseoutstream.cpp:268:GenericProcessData:Unable to initialize output stream
1366309704:6:/thelib/src/protocols/rtmp/streaming/innetrtmpstream.cpp:380:FeedData:Unable to feed OS: 0x1e2aac0
1366309704:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream OFHLS(40329) with name `leo3` unregistered from application `evostreamms` from protocol PT(42343)
1366309704:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol [PT(42343)] unregistered from application: evostreamms
1366309704:0:/thelib/src/streaming/hls/hlsplaylist.cpp:360:CloseSegment:Segment is not opened
1366309704:0:/common/src/utils/misc/file.cpp:83:Initialize:Unable to open file with mode `a+b`. Error was: (2) No such file or directory
1366309704:0:/thelib/src/streaming/hls/hlsplaylist.cpp:625:ClosePlaylist:Unable to open playlist
1366309705:3:/thelib/src/application/baseclientapplication.cpp:282:SignalStreamRegistered:Stream OFHLS(40330) with name `leo3` registered to application `evostreamms` from protocol PT(42344)
1366309705:0:/common/src/platform/linux/linuxplatform.cpp:402:createFolder:Unable to create folder /var/www/hls/hlstest/leo3/
1366309705:0:/thelib/src/streaming/hls/hlsplaylist.cpp:76:Init:Unable to create target folder /var/www/hls/hlstest/leo3/
1366309705:0:/thelib/src/streaming/hls/outfilehlsstream.cpp:117:FinishInitialization:Unable to initialize play list
1366309705:0:/thelib/src/streaming/baseoutstream.cpp:268:GenericProcessData:Unable to initialize output stream
1366309705:6:/thelib/src/protocols/rtmp/streaming/innetrtmpstream.cpp:380:FeedData:Unable to feed OS: 0x19bb8a0
1366309705:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream OFHLS(40330) with name `leo3` unregistered from application `evostreamms` from protocol PT(42344)
1366309705:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol [PT(42344)] unregistered from application: evostreamms
1366309705:0:/thelib/src/streaming/hls/hlsplaylist.cpp:360:CloseSegment:Segment is not opened
1366309705:0:/common/src/utils/misc/file.cpp:83:Initialize:Unable to open file with mode `a+b`. Error was: (2) No such file or directory
1366309705:0:/thelib/src/streaming/hls/hlsplaylist.cpp:625:ClosePlaylist:Unable to open playlist
1366309706:3:/thelib/src/application/baseclientapplication.cpp:282:SignalStreamRegistered:Stream OFHLS(40331) with name `leo3` registered to application `evostreamms` from protocol PT(42345)
1366309706:0:/common/src/platform/linux/linuxplatform.cpp:402:createFolder:Unable to create folder /var/www/hls/hlstest/leo3/
1366309706:0:/thelib/src/streaming/hls/hlsplaylist.cpp:76:Init:Unable to create target folder /var/www/hls/hlstest/leo3/
1366309706:0:/thelib/src/streaming/hls/outfilehlsstream.cpp:117:FinishInitialization:Unable to initialize play list
1366309706:0:/thelib/src/streaming/baseoutstream.cpp:268:GenericProcessData:Unable to initialize output stream
1366309706:6:/thelib/src/protocols/rtmp/streaming/innetrtmpstream.cpp:380:FeedData:Unable to feed OS: 0x1e2aac0
1366309706:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream OFHLS(40331) with name `leo3` unregistered from application `evostreamms` from protocol PT(42345)
1366309706:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol [PT(42345)] unregistered from application: evostreamms
1366309706:0:/thelib/src/streaming/hls/hlsplaylist.cpp:360:CloseSegment:Segment is not opened
1366309706:0:/common/src/utils/misc/file.cpp:83:Initialize:Unable to open file with mode `a+b`. Error was: (2) No such file or directory
1366309706:0:/thelib/src/streaming/hls/hlsplaylist.cpp:625:ClosePlaylist:Unable to open playlist
1366309707:3:/thelib/src/application/baseclientapplication.cpp:282:SignalStreamRegistered:Stream OFHLS(40332) with name `leo3` registered to application `evostreamms` from protocol PT(42346)
1366309707:0:/common/src/platform/linux/linuxplatform.cpp:402:createFolder:Unable to create folder /var/www/hls/hlstest/leo3/
1366309707:0:/thelib/src/streaming/hls/hlsplaylist.cpp:76:Init:Unable to create target folder /var/www/hls/hlstest/leo3/
1366309707:0:/thelib/src/streaming/hls/outfilehlsstream.cpp:117:FinishInitialization:Unable to initialize play list
1366309707:0:/thelib/src/streaming/baseoutstream.cpp:268:GenericProcessData:Unable to initialize output stream
1366309707:6:/thelib/src/protocols/rtmp/streaming/innetrtmpstream.cpp:380:FeedData:Unable to feed OS: 0x19bb8a0
1366309707:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream OFHLS(40332) with name `leo3` unregistered from application `evostreamms` from protocol PT(42346)
1366309707:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol [PT(42346)] unregistered from application: evostreamms
1366309707:0:/thelib/src/streaming/hls/hlsplaylist.cpp:360:CloseSegment:Segment is not opened
1366309707:0:/common/src/utils/misc/file.cpp:83:Initialize:Unable to open file with mode `a+b`. Error was: (2) No such file or directory
1366309707:0:/thelib/src/streaming/hls/hlsplaylist.cpp:625:ClosePlaylist:Unable to open playlist
1366309708:3:/thelib/src/application/baseclientapplication.cpp:282:SignalStreamRegistered:Stream OFHLS(40333) with name `leo3` registered to application `evostreamms` from protocol PT(42347)
1366309708:0:/common/src/platform/linux/linuxplatform.cpp:402:createFolder:Unable to create folder /var/www/hls/hlstest/leo3/
1366309708:0:/thelib/src/streaming/hls/hlsplaylist.cpp:76:Init:Unable to create target folder /var/www/hls/hlstest/leo3/
1366309708:0:/thelib/src/streaming/hls/outfilehlsstream.cpp:117:FinishInitialization:Unable to initialize play list
1366309708:0:/thelib/src/streaming/baseoutstream.cpp:268:GenericProcessData:Unable to initialize output stream
1366309708:6:/thelib/src/protocols/rtmp/streaming/innetrtmpstream.cpp:380:FeedData:Unable to feed OS: 0x1e2aac0
1366309708:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream OFHLS(40333) with name `leo3` unregistered from application `evostreamms` from protocol PT(42347)
1366309708:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol [PT(42347)] unregistered from application: evostreamms
1366309708:0:/thelib/src/streaming/hls/hlsplaylist.cpp:360:CloseSegment:Segment is not opened
1366309708:0:/common/src/utils/misc/file.cpp:83:Initialize:Unable to open file with mode `a+b`. Error was: (2) No such file or directory
1366309708:0:/thelib/src/streaming/hls/hlsplaylist.cpp:625:ClosePlaylist:Unable to open playlist
1366309709:3:/thelib/src/application/baseclientapplication.cpp:282:SignalStreamRegistered:Stream OFHLS(40334) with name `leo3` registered to application `evostreamms` from protocol PT(42348)
1366309709:2:/applications/evorouter/src/protocols/timer/keepalivetimerprotocol.cpp:90:TimePeriodElapsed:No traffic on stream INR(40310) with name `leo1`. Destroy it
1366309709:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream INR(40310) with name `leo1` unregistered from application `evostreamms` from protocol OR(42323)
1366309709:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol CTCP(31) <-> TCP(42322) <-> [OR(42323)] unregistered from application: evostreamms
1366309709:2:/applications/evorouter/src/protocols/timer/keepalivetimerprotocol.cpp:90:TimePeriodElapsed:No traffic on stream INR(40313) with name `leo2`. Destroy it
1366309709:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream INR(40313) with name `leo2` unregistered from application `evostreamms` from protocol OR(42325)
1366309709:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol CTCP(32) <-> TCP(42324) <-> [OR(42325)] unregistered from application: evostreamms
1366309709:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream OFHLS(40311) with name `leo1` unregistered from application `evostreamms` from protocol PT(42326)
1366309709:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol [PT(42326)] unregistered from application: evostreamms
1366309709:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream OFHDS(40312) with name `leo1` unregistered from application `evostreamms` from protocol PT(42327)
1366309709:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol [PT(42327)] unregistered from application: evostreamms
1366309709:4:/thelib/src/netio/epoll/iohandlermanager.cpp:130:UnRegisterIOHandler:Handlers count changed: 19->18 IOHT_TCP_CARRIER
1366309709:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream OFHLS(40314) with name `leo2` unregistered from application `evostreamms` from protocol PT(42328)
1366309709:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol [PT(42328)] unregistered from application: evostreamms
1366309709:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream OFHDS(40315) with name `leo2` unregistered from application `evostreamms` from protocol PT(42329)
1366309709:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol [PT(42329)] unregistered from application: evostreamms
1366309709:4:/thelib/src/netio/epoll/iohandlermanager.cpp:130:UnRegisterIOHandler:Handlers count changed: 18->17 IOHT_TCP_CARRIER
1366309709:2:/thelib/src/streaming/baseoutstream.cpp:93:UnLink:BaseOutStream::UnLink: This stream is not linked
1366309709:0:/thelib/src/streaming/hds/outfilehdsstream.cpp:575:CloseFragment:Fragment not opened
1366309709:0:/common/src/utils/misc/file.cpp:83:Initialize:Unable to open file with mode `w+b`. Error was: (2) No such file or directory
1366309709:0:/thelib/src/mediaformats/writers/fmp4/atom_abst.cpp:393:WriteBootStrap:Unable to initialize bootstrap: !
1366309709:2:/thelib/src/streaming/baseoutstream.cpp:93:UnLink:BaseOutStream::UnLink: This stream is not linked
1366309709:2:/thelib/src/streaming/baseoutstream.cpp:93:UnLink:BaseOutStream::UnLink: This stream is not linked
1366309709:0:/thelib/src/streaming/hds/outfilehdsstream.cpp:575:CloseFragment:Fragment not opened
1366309709:0:/common/src/utils/misc/file.cpp:83:Initialize:Unable to open file with mode `w+b`. Error was: (2) No such file or directory
1366309709:0:/thelib/src/mediaformats/writers/fmp4/atom_abst.cpp:393:WriteBootStrap:Unable to initialize bootstrap: !
1366309709:2:/thelib/src/streaming/baseoutstream.cpp:93:UnLink:BaseOutStream::UnLink: This stream is not linked
1366309709:4:/thelib/src/netio/epoll/iohandlermanager.cpp:120:RegisterIOHandler:Handlers count changed: 17->18 IOHT_TCP_CONNECTOR
1366309709:0:/common/src/platform/linux/linuxplatform.cpp:402:createFolder:Unable to create folder /var/www/hls/hlstest/leo3/
1366309709:0:/thelib/src/streaming/hls/hlsplaylist.cpp:76:Init:Unable to create target folder /var/www/hls/hlstest/leo3/
1366309709:0:/thelib/src/streaming/hls/outfilehlsstream.cpp:117:FinishInitialization:Unable to initialize play list
1366309709:0:/thelib/src/streaming/baseoutstream.cpp:268:GenericProcessData:Unable to initialize output stream
1366309709:6:/thelib/src/protocols/rtmp/streaming/innetrtmpstream.cpp:380:FeedData:Unable to feed OS: 0x19bb8a0
1366309709:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream OFHLS(40334) with name `leo3` unregistered from application `evostreamms` from protocol PT(42348)
1366309709:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol [PT(42348)] unregistered from application: evostreamms
1366309709:0:/thelib/src/streaming/hls/hlsplaylist.cpp:360:CloseSegment:Segment is not opened
1366309709:0:/common/src/utils/misc/file.cpp:83:Initialize:Unable to open file with mode `a+b`. Error was: (2) No such file or directory
1366309709:0:/thelib/src/streaming/hls/hlsplaylist.cpp:625:ClosePlaylist:Unable to open playlist
1366309709:4:/thelib/src/netio/epoll/iohandlermanager.cpp:120:RegisterIOHandler:Handlers count changed: 18->19 IOHT_TCP_CARRIER
1366309709:4:/thelib/src/netio/epoll/iohandlermanager.cpp:130:UnRegisterIOHandler:Handlers count changed: 19->18 IOHT_TCP_CONNECTOR
1366309710:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol CTCP(31) <-> TCP(42349) <-> OSSL(42350) <-> OHTT(42351) <-> [JVAR(42352)] unregistered from application: lminterface
1366309710:0:/applications/lminterface/src/application/lmcontroller.cpp:134:SignalResponse:The license terms expired or invalid
1366309710:4:/thelib/src/netio/epoll/iohandlermanager.cpp:130:UnRegisterIOHandler:Handlers count changed: 18->17 IOHT_TCP_CARRIER
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:401:Pulse:Unable to execute epoll_wait: (9) Bad file descriptor
1366309710:2:/crtmpserver/src/crtmpserver.cpp:405:Cleanup:Shutting down protocols manager
1366309710:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol T(22) <-> [TMR(2)] unregistered from application: evostreamms
1366309710:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol T(23) <-> [TMR(3)] unregistered from application: evostreamms
1366309710:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol T(24) <-> [TMR(4)] unregistered from application: evostreamms
1366309710:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol T(25) <-> [TMR(5)] unregistered from application: evostreamms
1366309710:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol T(29) <-> [TMR(6)] unregistered from application: lminterface
1366309710:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol T(30) <-> [TMR(7)] unregistered from application: lminterface
1366309710:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream INR(10) with name `leo3` unregistered from application `evostreamms` from protocol OR(13)
1366309710:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol CTCP(28) <-> TCP(12) <-> [OR(13)] unregistered from application: evostreamms
1366309710:0:/applications/evorouter/src/application/originapplication.cpp:1672:EnqueueTimedOperation:Unable to get the timer protocol
1366309710:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream OFHLS(11) with name `leo3` unregistered from application `evostreamms` from protocol PT(18)
1366309710:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol [PT(18)] unregistered from application: evostreamms
1366309710:3:/thelib/src/application/baseclientapplication.cpp:293:SignalStreamUnRegistered:Stream OFHDS(12) with name `leo3` unregistered from application `evostreamms` from protocol PT(19)
1366309710:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol [PT(19)] unregistered from application: evostreamms
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol CTCP(33) <-> TCP(41) <-> [BVAR(42)] unregistered from application: evostreamms
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:0:/thelib/src/netio/epoll/iohandlermanager.cpp:247:EnableAcceptConnections:Unable to enable accept connections: (9) Bad file descriptor
1366309710:6:/thelib/src/application/baseclientapplication.cpp:271:UnRegisterProtocol:Protocol CTCP(34) <-> TCP(43) <-> [BVAR(44)] unregistered from application: evostreamms
1366309710:4:/thelib/src/netio/epoll/iohandlermanager.cpp:130:UnRegisterIOHandler:Handlers count changed: 17->16 IOHT_TIMER
1366309710:4:/thelib/src/netio/epoll/iohandlermanager.cpp:130:UnRegisterIOHandler:Handlers count changed: 16->15 IOHT_TIMER
1366309710:4:/thelib/src/netio/epoll/iohandlermanager.cpp:130:UnRegisterIOHandler:Handlers count changed: 15->14 IOHT_TIMER
1366309710:4:/thelib/src/netio/epoll/iohandlermanager.cpp:130:UnRegisterIOHandler:Handlers count changed: 14->13 IOHT_TIMER