Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rsyslogd fails to start in staging #37

Closed
mikkonie opened this issue Nov 22, 2024 · 4 comments
Closed

Rsyslogd fails to start in staging #37

mikkonie opened this issue Nov 22, 2024 · 4 comments
Assignees
@mikkonie
Labels
bug Something isn't working environment Issues regarding dependencies, CI, deployment etc.
Milestone
v4.3.3-1

Comments

@mikkonie
Copy link
Contributor

After some fixes, I've gotten rsyslogd working nicely on this image in dev. However, when attempting to deploy sodar-docker-compose in staging, I get the following:

irods-1  |  * Starting enhanced syslogd rsyslogd
irods-1  | rsyslog startup failure, child did not respond within startup timeout (60 seconds)

I'm not yet sure if this is a problem within the image, the Docker Compose environment or our Ansible playbook, but opening the issue here for starters.

I'm guessing it should be somehow environment related, but the only "moving part" I can think of are the logging volume mounts, so I probably better start with verifying those. Also I need to see what kind of workarounds others have proposed online regarding this error.
@mikkonie mikkonie added bug Something isn't working environment Issues regarding dependencies, CI, deployment etc. labels Nov 22, 2024
@mikkonie mikkonie added this to the v4.3.3-1 milestone Nov 22, 2024
@mikkonie mikkonie self-assigned this Nov 22, 2024
@mikkonie
Copy link
Contributor Author

Debug log:

irods-1  |  * Starting enhanced syslogd rsyslogd
irods-1  | 
irods-1  | 5357.436665966:main thread    : glbl.c: debug level 2 set via config file
irods-1  | 5357.436681027:main thread    : glbl.c: This is rsyslog version 8.2001.0
irods-1  | 5357.436683760:main thread    : rsconf.c: cnf:global:cfsysline: $FileCreateMode 0644
irods-1  | 5357.436685929:main thread    : rsconf.c: cnf:global:cfsysline: $DirCreateMode 0755
irods-1  | 5357.436687730:main thread    : rsconf.c: cnf:global:cfsysline: $Umask 0000
irods-1  | 5357.436744632:main thread    : rsconf.c: cnf:global:cfsysline: $template irods_format,"%msg%\n"
irods-1  | 5357.436749819:main thread    : ../template.c: tplAddLine processing template 'irods_format'
irods-1  | 5357.436753218:main thread    : lexer.l: lexer: propfilt is ':programname,startswith,"irodsServer"'
irods-1  | 5357.436757605:main thread    : conf.c: tried selector action for builtin:omfile: 0
irods-1  | 5357.436759323:main thread    : ../action.c: Module builtin:omfile processes this action.
irods-1  | 5357.436761909:main thread    : ../action.c: template: 'irods_format' assigned
irods-1  | 5357.436766853:main thread    : action-0-builtin:omfile queue: queue.c: parameter dump:
irods-1  | 5357.436768966:main thread    : action-0-builtin:omfile queue: queue.c: queue.filename '[NONE]'
irods-1  | 5357.436770191:main thread    : action-0-builtin:omfile queue: queue.c: queue.size: 1000
irods-1  | 5357.436771319:main thread    : action-0-builtin:omfile queue: queue.c: queue.dequeuebatchsize: 16
irods-1  | 5357.436773181:main thread    : action-0-builtin:omfile queue: queue.c: queue.mindequeuebatchsize: 0
irods-1  | 5357.436781279:main thread    : action-0-builtin:omfile queue: queue.c: queue.mindequeuebatchsize.timeout: 0
irods-1  | 5357.436785151:main thread    : action-0-builtin:omfile queue: queue.c: queue.maxdiskspace: 0
irods-1  | 5357.436786544:main thread    : action-0-builtin:omfile queue: queue.c: queue.highwatermark: -1
irods-1  | 5357.436787914:main thread    : action-0-builtin:omfile queue: queue.c: queue.lowwatermark: -1
irods-1  | 5357.436789295:main thread    : action-0-builtin:omfile queue: queue.c: queue.fulldelaymark: -1
irods-1  | 5357.436800281:main thread    : action-0-builtin:omfile queue: queue.c: queue.lightdelaymark: -1
irods-1  | 5357.436803875:main thread    : action-0-builtin:omfile queue: queue.c: queue.takeflowctlfrommsg: 0
irods-1  | 5357.436805208:main thread    : action-0-builtin:omfile queue: queue.c: queue.discardmark: 980
irods-1  | 5357.436806568:main thread    : action-0-builtin:omfile queue: queue.c: queue.discardseverity: 8
irods-1  | 5357.436807902:main thread    : action-0-builtin:omfile queue: queue.c: queue.checkpointinterval: 0
irods-1  | 5357.436830821:main thread    : action-0-builtin:omfile queue: queue.c: queue.syncqueuefiles: 0
irods-1  | 5357.436834790:main thread    : action-0-builtin:omfile queue: queue.c: queue.type: 3 [Direct]
irods-1  | 5357.436836115:main thread    : action-0-builtin:omfile queue: queue.c: queue.workerthreads: 1
irods-1  | 5357.436837253:main thread    : action-0-builtin:omfile queue: queue.c: queue.timeoutshutdown: 0
irods-1  | 5357.436838385:main thread    : action-0-builtin:omfile queue: queue.c: queue.timeoutactioncompletion: 1000
irods-1  | 5357.436839568:main thread    : action-0-builtin:omfile queue: queue.c: queue.timeoutenqueue: 50
irods-1  | 5357.436840888:main thread    : action-0-builtin:omfile queue: queue.c: queue.timeoutworkerthreadshutdown: 60000
irods-1  | 5357.436842164:main thread    : action-0-builtin:omfile queue: queue.c: queue.workerthreadminimummessages: -1
irods-1  | 5357.436843494:main thread    : action-0-builtin:omfile queue: queue.c: queue.maxfilesize: 1048576
irods-1  | 5357.436844638:main thread    : action-0-builtin:omfile queue: queue.c: queue.saveonshutdown: 1
irods-1  | 5357.436845739:main thread    : action-0-builtin:omfile queue: queue.c: queue.dequeueslowdown: 0
irods-1  | 5357.436846962:main thread    : action-0-builtin:omfile queue: queue.c: queue.dequeuetimebegin: 0
irods-1  | 5357.436848246:main thread    : action-0-builtin:omfile queue: queue.c: queue.dequeuetimeend: 25
irods-1  | 5357.436850108:main thread    : ../action.c: Action 0x55e820ec2200: queue 0x55e820ec2650 created
irods-1  | 5357.436853371:main thread    : lexer.l: lexer: propfilt is ':programname,startswith,"irodsDelayServer"'
irods-1  | 5357.436893712:main thread    : rainerscript.c: Decoding property-based filter ':programname,startswith,"irodsServer"'
irods-1  | 5357.436900294:main thread    : rsconf.c: cnf:global:script
irods-1  | 5357.436903092:main thread    : conf.c: tried selector action for builtin:omfile: 0
irods-1  | 5357.436907790:main thread    : ../action.c: Module builtin:omfile processes this action.
irods-1  | 5357.436915520:main thread    : ../action.c: template: 'irods_format' assigned
irods-1  | 5357.436920433:main thread    : action-1-builtin:omfile queue: queue.c: parameter dump:
irods-1  | 5357.436922096:main thread    : action-1-builtin:omfile queue: queue.c: queue.filename '[NONE]'
irods-1  | 5357.436923638:main thread    : action-1-builtin:omfile queue: queue.c: queue.size: 1000
irods-1  | 5357.436924934:main thread    : action-1-builtin:omfile queue: queue.c: queue.dequeuebatchsize: 16
irods-1  | 5357.436926211:main thread    : action-1-builtin:omfile queue: queue.c: queue.mindequeuebatchsize: 0
irods-1  | 5357.436927516:main thread    : action-1-builtin:omfile queue: queue.c: queue.mindequeuebatchsize.timeout: 0
irods-1  | 5357.436928984:main thread    : action-1-builtin:omfile queue: queue.c: queue.maxdiskspace: 0
irods-1  | 5357.436930387:main thread    : action-1-builtin:omfile queue: queue.c: queue.highwatermark: -1
irods-1  | 5357.436931721:main thread    : action-1-builtin:omfile queue: queue.c: queue.lowwatermark: -1
irods-1  | 5357.436933043:main thread    : action-1-builtin:omfile queue: queue.c: queue.fulldelaymark: -1
irods-1  | 5357.436934454:main thread    : action-1-builtin:omfile queue: queue.c: queue.lightdelaymark: -1
irods-1  | 5357.436935748:main thread    : action-1-builtin:omfile queue: queue.c: queue.takeflowctlfrommsg: 0
irods-1  | 5357.436937117:main thread    : action-1-builtin:omfile queue: queue.c: queue.discardmark: 980
irods-1  | 5357.436938688:main thread    : action-1-builtin:omfile queue: queue.c: queue.discardseverity: 8
irods-1  | 5357.436951476:main thread    : action-1-builtin:omfile queue: queue.c: queue.checkpointinterval: 0
irods-1  | 5357.436955111:main thread    : action-1-builtin:omfile queue: queue.c: queue.syncqueuefiles: 0
irods-1  | 5357.436956403:main thread    : action-1-builtin:omfile queue: queue.c: queue.type: 3 [Direct]
irods-1  | 5357.436957491:main thread    : action-1-builtin:omfile queue: queue.c: queue.workerthreads: 1
irods-1  | 5357.436958774:main thread    : action-1-builtin:omfile queue: queue.c: queue.timeoutshutdown: 0
irods-1  | 5357.436960112:main thread    : action-1-builtin:omfile queue: queue.c: queue.timeoutactioncompletion: 1000
irods-1  | 5357.436980560:main thread    : action-1-builtin:omfile queue: queue.c: queue.timeoutenqueue: 50
irods-1  | 5357.436981892:main thread    : action-1-builtin:omfile queue: queue.c: queue.timeoutworkerthreadshutdown: 60000
irods-1  | 5357.436983228:main thread    : action-1-builtin:omfile queue: queue.c: queue.workerthreadminimummessages: -1
irods-1  | 5357.436984629:main thread    : action-1-builtin:omfile queue: queue.c: queue.maxfilesize: 1048576
irods-1  | 5357.436985792:main thread    : action-1-builtin:omfile queue: queue.c: queue.saveonshutdown: 1
irods-1  | 5357.436987466:main thread    : action-1-builtin:omfile queue: queue.c: queue.dequeueslowdown: 0
irods-1  | 5357.436988753:main thread    : action-1-builtin:omfile queue: queue.c: queue.dequeuetimebegin: 0
irods-1  | 5357.436990269:main thread    : action-1-builtin:omfile queue: queue.c: queue.dequeuetimeend: 25
irods-1  | 5357.436992017:main thread    : ../action.c: Action 0x55e820ec2fa0: queue 0x55e820ec33b0 created
irods-1  | 5357.436994690:main thread    : lexer.l: config parser: reached end of file /etc/rsyslog.d/00-irods.conf
irods-1  | 5357.436998651:main thread    : lexer.l: config parser: resume parsing of file /etc/rsyslog.d/50-default.conf at line 1
irods-1  | 5357.437002114:main thread    : rainerscript.c: Decoding property-based filter ':programname,startswith,"irodsDelayServer"'
irods-1  | 5357.437004719:main thread    : rsconf.c: cnf:global:script
irods-1  | 5357.437006935:main thread    : conf.c: tried selector action for builtin:omfile: 0
irods-1  | 5357.437008220:main thread    : ../action.c: Module builtin:omfile processes this action.
irods-1  | 5357.437009748:main thread    : ../action.c: template: 'RSYSLOG_TraditionalFileFormat' assigned
irods-1  | 5357.437012276:main thread    : action-2-builtin:omfile queue: queue.c: parameter dump:
irods-1  | 5357.437015767:main thread    : action-2-builtin:omfile queue: queue.c: queue.filename '[NONE]'
irods-1  | 5357.437017053:main thread    : action-2-builtin:omfile queue: queue.c: queue.size: 1000
irods-1  | 5357.437018184:main thread    : action-2-builtin:omfile queue: queue.c: queue.dequeuebatchsize: 16
irods-1  | 5357.437020540:main thread    : action-2-builtin:omfile queue: queue.c: queue.mindequeuebatchsize: 0
irods-1  | 5357.437021816:main thread    : action-2-builtin:omfile queue: queue.c: queue.mindequeuebatchsize.timeout: 0
irods-1  | 5357.437023497:main thread    : action-2-builtin:omfile queue: queue.c: queue.maxdiskspace: 0
irods-1  | 5357.437025036:main thread    : action-2-builtin:omfile queue: queue.c: queue.highwatermark: -1
irods-1  | 5357.437026277:main thread    : action-2-builtin:omfile queue: queue.c: queue.lowwatermark: -1
irods-1  | 5357.437027530:main thread    : action-2-builtin:omfile queue: queue.c: queue.fulldelaymark: -1
irods-1  | 5357.437029068:main thread    : action-2-builtin:omfile queue: queue.c: queue.lightdelaymark: -1
irods-1  | 5357.437030344:main thread    : action-2-builtin:omfile queue: queue.c: queue.takeflowctlfrommsg: 0
irods-1  | 5357.437031627:main thread    : action-2-builtin:omfile queue: queue.c: queue.discardmark: 980
irods-1  | 5357.437032948:main thread    : action-2-builtin:omfile queue: queue.c: queue.discardseverity: 8
irods-1  | 5357.437034188:main thread    : action-2-builtin:omfile queue: queue.c: queue.checkpointinterval: 0
irods-1  | 5357.437035753:main thread    : action-2-builtin:omfile queue: queue.c: queue.syncqueuefiles: 0
irods-1  | 5357.437037011:main thread    : action-2-builtin:omfile queue: queue.c: queue.type: 3 [Direct]
irods-1  | 5357.437038310:main thread    : action-2-builtin:omfile queue: queue.c: queue.workerthreads: 1
irods-1  | 5357.437039763:main thread    : action-2-builtin:omfile queue: queue.c: queue.timeoutshutdown: 0
irods-1  | 5357.437041103:main thread    : action-2-builtin:omfile queue: queue.c: queue.timeoutactioncompletion: 1000
irods-1  | 5357.437042488:main thread    : action-2-builtin:omfile queue: queue.c: queue.timeoutenqueue: 50
irods-1  | 5357.437043870:main thread    : action-2-builtin:omfile queue: queue.c: queue.timeoutworkerthreadshutdown: 60000
irods-1  | 5357.437045357:main thread    : action-2-builtin:omfile queue: queue.c: queue.workerthreadminimummessages: -1
irods-1  | 5357.437052439:main thread    : action-2-builtin:omfile queue: queue.c: queue.maxfilesize: 1048576
irods-1  | 5357.437053822:main thread    : action-2-builtin:omfile queue: queue.c: queue.saveonshutdown: 1
irods-1  | 5357.437058510:main thread    : action-2-builtin:omfile queue: queue.c: queue.dequeueslowdown: 0
irods-1  | 5357.437062140:main thread    : action-2-builtin:omfile queue: queue.c: queue.dequeuetimebegin: 0
irods-1  | 5357.437063387:main thread    : action-2-builtin:omfile queue: queue.c: queue.dequeuetimeend: 25
irods-1  | 5357.437064621:main thread    : ../action.c: Action 0x55e820ec1670: queue 0x55e820ec1ac0 created
irods-1  | 5357.437066610:main thread    : conf.c: Decoding traditional PRI filter 'auth,authpriv.*'
irods-1  | 5357.437068270:main thread    : srutils.c: symbolic name: * ==> 255
irods-1  | 5357.437071684:main thread    : srutils.c: symbolic name: auth ==> 32
irods-1  | 5357.437074415:main thread    : srutils.c: symbolic name: authpriv ==> 80
irods-1  | 5357.437076927:main thread    : rsconf.c: cnf:global:script
irods-1  | 5357.437079400:main thread    : conf.c: tried selector action for builtin:omfile: 0
irods-1  | 5357.437082926:main thread    : ../action.c: Module builtin:omfile processes this action.
irods-1  | 5357.437084762:main thread    : ../action.c: template: 'RSYSLOG_TraditionalFileFormat' assigned
irods-1  | 5357.437087048:main thread    : action-3-builtin:omfile queue: queue.c: parameter dump:
irods-1  | 5357.437088409:main thread    : action-3-builtin:omfile queue: queue.c: queue.filename '[NONE]'
irods-1  | 5357.437089789:main thread    : action-3-builtin:omfile queue: queue.c: queue.size: 1000
irods-1  | 5357.437091041:main thread    : action-3-builtin:omfile queue: queue.c: queue.dequeuebatchsize: 16
irods-1  | 5357.437092276:main thread    : action-3-builtin:omfile queue: queue.c: queue.mindequeuebatchsize: 0
irods-1  | 5357.437093528:main thread    : action-3-builtin:omfile queue: queue.c: queue.mindequeuebatchsize.timeout: 0
irods-1  | 5357.437094779:main thread    : action-3-builtin:omfile queue: queue.c: queue.maxdiskspace: 0
irods-1  | 5357.437096070:main thread    : action-3-builtin:omfile queue: queue.c: queue.highwatermark: -1
irods-1  | 5357.437097462:main thread    : action-3-builtin:omfile queue: queue.c: queue.lowwatermark: -1
irods-1  | 5357.437098686:main thread    : action-3-builtin:omfile queue: queue.c: queue.fulldelaymark: -1
irods-1  | 5357.437100152:main thread    : action-3-builtin:omfile queue: queue.c: queue.lightdelaymark: -1
irods-1  | 5357.437102279:main thread    : action-3-builtin:omfile queue: queue.c: queue.takeflowctlfrommsg: 0
irods-1  | 5357.437103676:main thread    : action-3-builtin:omfile queue: queue.c: queue.discardmark: 980
irods-1  | 5357.437105092:main thread    : action-3-builtin:omfile queue: queue.c: queue.discardseverity: 8
irods-1  | 5357.437106379:main thread    : action-3-builtin:omfile queue: queue.c: queue.checkpointinterval: 0
irods-1  | 5357.437107505:main thread    : action-3-builtin:omfile queue: queue.c: queue.syncqueuefiles: 0
irods-1  | 5357.437108847:main thread    : action-3-builtin:omfile queue: queue.c: queue.type: 3 [Direct]
irods-1  | 5357.437110072:main thread    : action-3-builtin:omfile queue: queue.c: queue.workerthreads: 1
irods-1  | 5357.437111322:main thread    : action-3-builtin:omfile queue: queue.c: queue.timeoutshutdown: 0
irods-1  | 5357.437112572:main thread    : action-3-builtin:omfile queue: queue.c: queue.timeoutactioncompletion: 1000
irods-1  | 5357.437113795:main thread    : action-3-builtin:omfile queue: queue.c: queue.timeoutenqueue: 50
irods-1  | 5357.437115042:main thread    : action-3-builtin:omfile queue: queue.c: queue.timeoutworkerthreadshutdown: 60000
irods-1  | 5357.437116287:main thread    : action-3-builtin:omfile queue: queue.c: queue.workerthreadminimummessages: -1
irods-1  | 5357.437117787:main thread    : action-3-builtin:omfile queue: queue.c: queue.maxfilesize: 1048576
irods-1  | 5357.437118972:main thread    : action-3-builtin:omfile queue: queue.c: queue.saveonshutdown: 1
irods-1  | 5357.437120239:main thread    : action-3-builtin:omfile queue: queue.c: queue.dequeueslowdown: 0
irods-1  | 5357.437121472:main thread    : action-3-builtin:omfile queue: queue.c: queue.dequeuetimebegin: 0
irods-1  | 5357.437122780:main thread    : action-3-builtin:omfile queue: queue.c: queue.dequeuetimeend: 25
irods-1  | 5357.437124164:main thread    : ../action.c: Action 0x55e820ec37c0: queue 0x55e820ec3c30 created
irods-1  | 5357.437129236:main thread    : conf.c: Decoding traditional PRI filter '*.*;auth,authpriv.none'
irods-1  | 5357.437131234:main thread    : srutils.c: symbolic name: * ==> 255
irods-1  | 5357.437133874:main thread    : srutils.c: symbolic name: none ==> 16
irods-1  | 5357.437136202:main thread    : srutils.c: symbolic name: auth ==> 32
irods-1  | 5357.437138471:main thread    : srutils.c: symbolic name: authpriv ==> 80
irods-1  | 5357.437141153:main thread    : rsconf.c: cnf:global:script
irods-1  | 5357.437143218:main thread    : conf.c: tried selector action for builtin:omfile: 0
irods-1  | 5357.437144722:main thread    : ../action.c: Module builtin:omfile processes this action.
irods-1  | 5357.437146227:main thread    : ../action.c: template: 'RSYSLOG_TraditionalFileFormat' assigned
irods-1  | 5357.437148102:main thread    : action-4-builtin:omfile queue: queue.c: parameter dump:
irods-1  | 5357.437149445:main thread    : action-4-builtin:omfile queue: queue.c: queue.filename '[NONE]'
irods-1  | 5357.437150931:main thread    : action-4-builtin:omfile queue: queue.c: queue.size: 1000
irods-1  | 5357.437152062:main thread    : action-4-builtin:omfile queue: queue.c: queue.dequeuebatchsize: 16
irods-1  | 5357.437153692:main thread    : action-4-builtin:omfile queue: queue.c: queue.mindequeuebatchsize: 0
irods-1  | 5357.437154926:main thread    : action-4-builtin:omfile queue: queue.c: queue.mindequeuebatchsize.timeout: 0
irods-1  | 5357.437156174:main thread    : action-4-builtin:omfile queue: queue.c: queue.maxdiskspace: 0
irods-1  | 5357.437157772:main thread    : action-4-builtin:omfile queue: queue.c: queue.highwatermark: -1
irods-1  | 5357.437158999:main thread    : action-4-builtin:omfile queue: queue.c: queue.lowwatermark: -1
irods-1  | 5357.437160249:main thread    : action-4-builtin:omfile queue: queue.c: queue.fulldelaymark: -1
irods-1  | 5357.437161461:main thread    : action-4-builtin:omfile queue: queue.c: queue.lightdelaymark: -1
irods-1  | 5357.437162680:main thread    : action-4-builtin:omfile queue: queue.c: queue.takeflowctlfrommsg: 0
irods-1  | 5357.437163907:main thread    : action-4-builtin:omfile queue: queue.c: queue.discardmark: 980
irods-1  | 5357.437165110:main thread    : action-4-builtin:omfile queue: queue.c: queue.discardseverity: 8
irods-1  | 5357.437166321:main thread    : action-4-builtin:omfile queue: queue.c: queue.checkpointinterval: 0
irods-1  | 5357.437167517:main thread    : action-4-builtin:omfile queue: queue.c: queue.syncqueuefiles: 0
irods-1  | 5357.437170096:main thread    : action-4-builtin:omfile queue: queue.c: queue.type: 3 [Direct]
irods-1  | 5357.437173637:main thread    : action-4-builtin:omfile queue: queue.c: queue.workerthreads: 1
irods-1  | 5357.437174906:main thread    : action-4-builtin:omfile queue: queue.c: queue.timeoutshutdown: 0
irods-1  | 5357.437176021:main thread    : action-4-builtin:omfile queue: queue.c: queue.timeoutactioncompletion: 1000
irods-1  | 5357.437177100:main thread    : action-4-builtin:omfile queue: queue.c: queue.timeoutenqueue: 50
irods-1  | 5357.437178357:main thread    : action-4-builtin:omfile queue: queue.c: queue.timeoutworkerthreadshutdown: 60000
irods-1  | 5357.437179630:main thread    : action-4-builtin:omfile queue: queue.c: queue.workerthreadminimummessages: -1
irods-1  | 5357.437180781:main thread    : action-4-builtin:omfile queue: queue.c: queue.maxfilesize: 1048576
irods-1  | 5357.437181959:main thread    : action-4-builtin:omfile queue: queue.c: queue.saveonshutdown: 1
irods-1  | 5357.437183177:main thread    : action-4-builtin:omfile queue: queue.c: queue.dequeueslowdown: 0
irods-1  | 5357.437184349:main thread    : action-4-builtin:omfile queue: queue.c: queue.dequeuetimebegin: 0
irods-1  | 5357.437185592:main thread    : action-4-builtin:omfile queue: queue.c: queue.dequeuetimeend: 25
irods-1  | 5357.437186760:main thread    : ../action.c: Action 0x55e820ec4350: queue 0x55e820ec47e0 created
irods-1  | 5357.437188546:main thread    : conf.c: Decoding traditional PRI filter 'kern.*'
irods-1  | 5357.437189710:main thread    : srutils.c: symbolic name: * ==> 255
irods-1  | 5357.437191934:main thread    : srutils.c: symbolic name: kern ==> 0
irods-1  | 5357.437194645:main thread    : rsconf.c: cnf:global:script
irods-1  | 5357.437196812:main thread    : conf.c: tried selector action for builtin:omfile: 0
irods-1  | 5357.437198197:main thread    : ../action.c: Module builtin:omfile processes this action.
irods-1  | 5357.437200791:main thread    : ../action.c: template: 'RSYSLOG_TraditionalFileFormat' assigned
irods-1  | 5357.437202834:main thread    : action-5-builtin:omfile queue: queue.c: parameter dump:
irods-1  | 5357.437204175:main thread    : action-5-builtin:omfile queue: queue.c: queue.filename '[NONE]'
irods-1  | 5357.437205298:main thread    : action-5-builtin:omfile queue: queue.c: queue.size: 1000
irods-1  | 5357.437206478:main thread    : action-5-builtin:omfile queue: queue.c: queue.dequeuebatchsize: 16
irods-1  | 5357.437207729:main thread    : action-5-builtin:omfile queue: queue.c: queue.mindequeuebatchsize: 0
irods-1  | 5357.437208948:main thread    : action-5-builtin:omfile queue: queue.c: queue.mindequeuebatchsize.timeout: 0
irods-1  | 5357.437210219:main thread    : action-5-builtin:omfile queue: queue.c: queue.maxdiskspace: 0
irods-1  | 5357.437211441:main thread    : action-5-builtin:omfile queue: queue.c: queue.highwatermark: -1
irods-1  | 5357.437212676:main thread    : action-5-builtin:omfile queue: queue.c: queue.lowwatermark: -1
irods-1  | 5357.437214129:main thread    : action-5-builtin:omfile queue: queue.c: queue.fulldelaymark: -1
irods-1  | 5357.437215624:main thread    : action-5-builtin:omfile queue: queue.c: queue.lightdelaymark: -1
irods-1  | 5357.437216868:main thread    : action-5-builtin:omfile queue: queue.c: queue.takeflowctlfrommsg: 0
irods-1  | 5357.437218157:main thread    : action-5-builtin:omfile queue: queue.c: queue.discardmark: 980
irods-1  | 5357.437219368:main thread    : action-5-builtin:omfile queue: queue.c: queue.discardseverity: 8
irods-1  | 5357.437220609:main thread    : action-5-builtin:omfile queue: queue.c: queue.checkpointinterval: 0
irods-1  | 5357.437221815:main thread    : action-5-builtin:omfile queue: queue.c: queue.syncqueuefiles: 0
irods-1  | 5357.437223055:main thread    : action-5-builtin:omfile queue: queue.c: queue.type: 3 [Direct]
irods-1  | 5357.437224258:main thread    : action-5-builtin:omfile queue: queue.c: queue.workerthreads: 1
irods-1  | 5357.437225698:main thread    : action-5-builtin:omfile queue: queue.c: queue.timeoutshutdown: 0
irods-1  | 5357.437227077:main thread    : action-5-builtin:omfile queue: queue.c: queue.timeoutactioncompletion: 1000
irods-1  | 5357.437228337:main thread    : action-5-builtin:omfile queue: queue.c: queue.timeoutenqueue: 50
irods-1  | 5357.437229576:main thread    : action-5-builtin:omfile queue: queue.c: queue.timeoutworkerthreadshutdown: 60000
irods-1  | 5357.437230989:main thread    : action-5-builtin:omfile queue: queue.c: queue.workerthreadminimummessages: -1
irods-1  | 5357.437233235:main thread    : action-5-builtin:omfile queue: queue.c: queue.maxfilesize: 1048576
irods-1  | 5357.437234576:main thread    : action-5-builtin:omfile queue: queue.c: queue.saveonshutdown: 1
irods-1  | 5357.437236059:main thread    : action-5-builtin:omfile queue: queue.c: queue.dequeueslowdown: 0
irods-1  | 5357.437237387:main thread    : action-5-builtin:omfile queue: queue.c: queue.dequeuetimebegin: 0
irods-1  | 5357.437238777:main thread    : action-5-builtin:omfile queue: queue.c: queue.dequeuetimeend: 25
irods-1  | 5357.437240104:main thread    : ../action.c: Action 0x55e820ec4f00: queue 0x55e820ec5390 created
irods-1  | 5357.437243364:main thread    : conf.c: Decoding traditional PRI filter 'mail.*'
irods-1  | 5357.437246964:main thread    : srutils.c: symbolic name: * ==> 255
irods-1  | 5357.437249159:main thread    : srutils.c: symbolic name: mail ==> 16
irods-1  | 5357.437251393:main thread    : rsconf.c: cnf:global:script
irods-1  | 5357.437253429:main thread    : conf.c: tried selector action for builtin:omfile: 0
irods-1  | 5357.437254727:main thread    : ../action.c: Module builtin:omfile processes this action.
irods-1  | 5357.437256163:main thread    : ../action.c: template: 'RSYSLOG_TraditionalFileFormat' assigned
irods-1  | 5357.437266884:main thread    : action-6-builtin:omfile queue: queue.c: parameter dump:
irods-1  | 5357.437270711:main thread    : action-6-builtin:omfile queue: queue.c: queue.filename '[NONE]'
irods-1  | 5357.437271978:main thread    : action-6-builtin:omfile queue: queue.c: queue.size: 1000
irods-1  | 5357.437273067:main thread    : action-6-builtin:omfile queue: queue.c: queue.dequeuebatchsize: 16
irods-1  | 5357.437274431:main thread    : action-6-builtin:omfile queue: queue.c: queue.mindequeuebatchsize: 0
irods-1  | 5357.437275625:main thread    : action-6-builtin:omfile queue: queue.c: queue.mindequeuebatchsize.timeout: 0
irods-1  | 5357.437276749:main thread    : action-6-builtin:omfile queue: queue.c: queue.maxdiskspace: 0
irods-1  | 5357.437277971:main thread    : action-6-builtin:omfile queue: queue.c: queue.highwatermark: -1
irods-1  | 5357.437299468:main thread    : action-6-builtin:omfile queue: queue.c: queue.lowwatermark: -1
irods-1  | 5357.437303012:main thread    : action-6-builtin:omfile queue: queue.c: queue.fulldelaymark: -1
irods-1  | 5357.437304261:main thread    : action-6-builtin:omfile queue: queue.c: queue.lightdelaymark: -1
irods-1  | 5357.437305558:main thread    : action-6-builtin:omfile queue: queue.c: queue.takeflowctlfrommsg: 0
irods-1  | 5357.437307067:main thread    : action-6-builtin:omfile queue: queue.c: queue.discardmark: 980
irods-1  | 5357.437321768:main thread    : action-6-builtin:omfile queue: queue.c: queue.discardseverity: 8
irods-1  | 5357.437325617:main thread    : action-6-builtin:omfile queue: queue.c: queue.checkpointinterval: 0
irods-1  | 5357.437326854:main thread    : action-6-builtin:omfile queue: queue.c: queue.syncqueuefiles: 0
irods-1  | 5357.437328034:main thread    : action-6-builtin:omfile queue: queue.c: queue.type: 3 [Direct]
irods-1  | 5357.437329700:main thread    : action-6-builtin:omfile queue: queue.c: queue.workerthreads: 1
irods-1  | 5357.437348301:main thread    : action-6-builtin:omfile queue: queue.c: queue.timeoutshutdown: 0
irods-1  | 5357.437351825:main thread    : action-6-builtin:omfile queue: queue.c: queue.timeoutactioncompletion: 1000
irods-1  | 5357.437353084:main thread    : action-6-builtin:omfile queue: queue.c: queue.timeoutenqueue: 50
irods-1  | 5357.437354212:main thread    : action-6-builtin:omfile queue: queue.c: queue.timeoutworkerthreadshutdown: 60000
irods-1  | 5357.437355496:main thread    : action-6-builtin:omfile queue: queue.c: queue.workerthreadminimummessages: -1
irods-1  | 5357.437356637:main thread    : action-6-builtin:omfile queue: queue.c: queue.maxfilesize: 1048576
irods-1  | 5357.437357887:main thread    : action-6-builtin:omfile queue: queue.c: queue.saveonshutdown: 1
irods-1  | 5357.437359066:main thread    : action-6-builtin:omfile queue: queue.c: queue.dequeueslowdown: 0
irods-1  | 5357.437360133:main thread    : action-6-builtin:omfile queue: queue.c: queue.dequeuetimebegin: 0
irods-1  | 5357.437361616:main thread    : action-6-builtin:omfile queue: queue.c: queue.dequeuetimeend: 25
irods-1  | 5357.437362991:main thread    : ../action.c: Action 0x55e820ec5ab0: queue 0x55e820ec5f40 created
irods-1  | 5357.437368110:main thread    : conf.c: Decoding traditional PRI filter 'mail.err'
irods-1  | 5357.437371176:main thread    : srutils.c: symbolic name: err ==> 3
irods-1  | 5357.437373740:main thread    : srutils.c: symbolic name: mail ==> 16
irods-1  | 5357.437376409:main thread    : rsconf.c: cnf:global:script
irods-1  | 5357.437378311:main thread    : conf.c: tried selector action for builtin:omfile: -2001
irods-1  | 5357.437379927:main thread    : conf.c: tried selector action for builtin:ompipe: -2001
irods-1  | 5357.437381537:main thread    : conf.c: tried selector action for builtin-shell: -2001
irods-1  | 5357.437383476:main thread    : conf.c: tried selector action for builtin:omdiscard: -2001
irods-1  | 5357.437385259:main thread    : conf.c: tried selector action for builtin:omfwd: -2001
irods-1  | 5357.437387064:main thread    : omusrmsg.c: write-alltried selector action for builtin:omusrmsg: 0
irods-1  | 5357.437389876:main thread    : ../action.c: Module builtin:omusrmsg processes this action.
irods-1  | 5357.437391424:main thread    : ../action.c: template: ' WallFmt' assigned
irods-1  | 5357.437393783:main thread    : action-7-builtin:omusrmsg queue: queue.c: parameter dump:
irods-1  | 5357.437397395:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.filename '[NONE]'
irods-1  | 5357.437398931:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.size: 1000
irods-1  | 5357.437400312:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.dequeuebatchsize: 16
irods-1  | 5357.437401672:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.mindequeuebatchsize: 0
irods-1  | 5357.437402917:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.mindequeuebatchsize.timeout: 0
irods-1  | 5357.437404194:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.maxdiskspace: 0
irods-1  | 5357.437405452:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.highwatermark: -1
irods-1  | 5357.437406752:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.lowwatermark: -1
irods-1  | 5357.437408063:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.fulldelaymark: -1
irods-1  | 5357.437409333:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.lightdelaymark: -1
irods-1  | 5357.437410602:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.takeflowctlfrommsg: 0
irods-1  | 5357.437411885:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.discardmark: 980
irods-1  | 5357.437413228:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.discardseverity: 8
irods-1  | 5357.437414492:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.checkpointinterval: 0
irods-1  | 5357.437415725:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.syncqueuefiles: 0
irods-1  | 5357.437416966:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.type: 3 [Direct]
irods-1  | 5357.437418180:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.workerthreads: 1
irods-1  | 5357.437419388:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.timeoutshutdown: 0
irods-1  | 5357.437420756:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.timeoutactioncompletion: 1000
irods-1  | 5357.437422156:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.timeoutenqueue: 50
irods-1  | 5357.437423472:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.timeoutworkerthreadshutdown: 60000
irods-1  | 5357.437424707:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.workerthreadminimummessages: -1
irods-1  | 5357.437426100:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.maxfilesize: 1048576
irods-1  | 5357.437427343:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.saveonshutdown: 1
irods-1  | 5357.437428607:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.dequeueslowdown: 0
irods-1  | 5357.437429823:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.dequeuetimebegin: 0
irods-1  | 5357.437431036:main thread    : action-7-builtin:omusrmsg queue: queue.c: queue.dequeuetimeend: 25
irods-1  | 5357.437432293:main thread    : ../action.c: Action 0x55e820ec6790: queue 0x55e820ec6b50 created
irods-1  | 5357.437435425:main thread    : lexer.l: config parser: reached end of file /etc/rsyslog.d/50-default.conf
irods-1  | 5357.437439032:main thread    : lexer.l: config parser: resume parsing of file /etc/rsyslog.conf at line 59
irods-1  | 5357.437440699:main thread    : lexer.l: config parser: reached end of file /etc/rsyslog.conf
irods-1  | 5357.437443084:main thread    : lexer.l: config parser: parsing completed
irods-1  | 5357.437444862:main thread    : conf.c: Decoding traditional PRI filter '*.emerg'
irods-1  | 5357.437446556:main thread    : srutils.c: symbolic name: emerg ==> 0
irods-1  | 5357.437449583:main thread    : rsconf.c: cnf:global:script
irods-1  | 5357.437451484:main thread    : ruleset.c: begin ruleset optimization phase
irods-1  | 5357.437454061:main thread    : ruleset.c: ruleset 'RSYSLOG_DefaultRuleset' before optimization:
irods-1  | 5357.437455936:main thread    : ruleset 0x55e820eafea0: ruleset.c: rsyslog ruleset RSYSLOG_DefaultRuleset:
irods-1  | 5357.437457876:main thread    : rainerscript.c: PROPFILT
irods-1  | 5357.437459841:main thread    : rainerscript.c: 	Property.: 'programname'
irods-1  | 5357.437461128:main thread    : rainerscript.c: 	Operation: 'startswith'
irods-1  | 5357.437463919:main thread    : rainerscript.c: 	Value....: 'irodsServer'
irods-1  | 5357.437465134:main thread    : rainerscript.c: THEN
irods-1  | 5357.437466421:main thread    : rainerscript.c:   ACTION 0 [builtin:omfile:/var/log/irods/irods.log;irods_format]
irods-1  | 5357.437469091:main thread    : rainerscript.c:   STOP
irods-1  | 5357.437471583:main thread    : rainerscript.c: END PROPFILT
irods-1  | 5357.437473027:main thread    : rainerscript.c: PROPFILT
irods-1  | 5357.437474327:main thread    : rainerscript.c: 	Property.: 'programname'
irods-1  | 5357.437475579:main thread    : rainerscript.c: 	Operation: 'startswith'
irods-1  | 5357.437478050:main thread    : rainerscript.c: 	Value....: 'irodsDelayServer'
irods-1  | 5357.437479133:main thread    : rainerscript.c: THEN
irods-1  | 5357.437480349:main thread    : rainerscript.c:   ACTION 1 [builtin:omfile:/var/log/irods/irods.log;irods_format]
irods-1  | 5357.437482835:main thread    : rainerscript.c:   STOP
irods-1  | 5357.437485180:main thread    : rainerscript.c: END PROPFILT
irods-1  | 5357.437486711:main thread    : rainerscript.c: PRIFILT 'auth,authpriv.*'
irods-1  | 5357.437488018:main thread    : rainerscript.c: pmask:  X  X  X  X FF  X  X  X  X  X FF  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X 
irods-1  | 5357.437518408:main thread    : rainerscript.c:   ACTION 2 [builtin:omfile:/var/log/auth.log]
irods-1  | 5357.437521139:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.437522463:main thread    : rainerscript.c: PRIFILT '*.*;auth,authpriv.none'
irods-1  | 5357.437523706:main thread    : rainerscript.c: pmask: FF FF FF FF  X FF FF FF FF FF  X FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF 
irods-1  | 5357.437578475:main thread    : rainerscript.c:   ACTION 3 [builtin:omfile:-/var/log/syslog]
irods-1  | 5357.437580664:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.437581969:main thread    : rainerscript.c: PRIFILT 'kern.*'
irods-1  | 5357.437582995:main thread    : rainerscript.c: pmask: FF  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X 
irods-1  | 5357.437667617:main thread    : rainerscript.c:   ACTION 4 [builtin:omfile:-/var/log/kern.log]
irods-1  | 5357.437669812:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.437671071:main thread    : rainerscript.c: PRIFILT 'mail.*'
irods-1  | 5357.437672089:main thread    : rainerscript.c: pmask:  X  X FF  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X 
irods-1  | 5357.437730677:main thread    : rainerscript.c:   ACTION 5 [builtin:omfile:-/var/log/mail.log]
irods-1  | 5357.437750256:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.437751568:main thread    : rainerscript.c: PRIFILT 'mail.err'
irods-1  | 5357.437752764:main thread    : rainerscript.c: pmask:  X  X  F  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X 
irods-1  | 5357.438013058:main thread    : rainerscript.c:   ACTION 6 [builtin:omfile:/var/log/mail.err]
irods-1  | 5357.438015382:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438016453:main thread    : rainerscript.c: PRIFILT '*.emerg'
irods-1  | 5357.438017499:main thread    : rainerscript.c: pmask:  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1 
irods-1  | 5357.438061501:main thread    : rainerscript.c:   ACTION 7 [builtin:omusrmsg::omusrmsg:*]
irods-1  | 5357.438064348:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438065956:main thread    : ruleset 0x55e820eafea0: ruleset.c: ruleset RSYSLOG_DefaultRuleset assigned parser list:
irods-1  | 5357.438067788:main thread    : rainerscript.c: optimizing cnfstmt type 4002
irods-1  | 5357.438069199:main thread    : rainerscript.c: optimizing cnfstmt type 4004
irods-1  | 5357.438072666:main thread    : rainerscript.c: optimizing cnfstmt type 4000
irods-1  | 5357.438076334:main thread    : rainerscript.c: optimizing cnfstmt type 4002
irods-1  | 5357.438077481:main thread    : rainerscript.c: optimizing cnfstmt type 4004
irods-1  | 5357.438078548:main thread    : rainerscript.c: optimizing cnfstmt type 4000
irods-1  | 5357.438079607:main thread    : rainerscript.c: optimizing cnfstmt type 4001
irods-1  | 5357.438080801:main thread    : rainerscript.c: optimizing cnfstmt type 4004
irods-1  | 5357.438082005:main thread    : rainerscript.c: optimizing cnfstmt type 4001
irods-1  | 5357.438083131:main thread    : rainerscript.c: optimizing cnfstmt type 4004
irods-1  | 5357.438084326:main thread    : rainerscript.c: optimizing cnfstmt type 4001
irods-1  | 5357.438085528:main thread    : rainerscript.c: optimizing cnfstmt type 4004
irods-1  | 5357.438086774:main thread    : rainerscript.c: optimizing cnfstmt type 4001
irods-1  | 5357.438087980:main thread    : rainerscript.c: optimizing cnfstmt type 4004
irods-1  | 5357.438089206:main thread    : rainerscript.c: optimizing cnfstmt type 4001
irods-1  | 5357.438090398:main thread    : rainerscript.c: optimizing cnfstmt type 4004
irods-1  | 5357.438091614:main thread    : rainerscript.c: optimizing cnfstmt type 4001
irods-1  | 5357.438092835:main thread    : rainerscript.c: optimizing cnfstmt type 4004
irods-1  | 5357.438094204:main thread    : ruleset.c: ruleset 'RSYSLOG_DefaultRuleset' after optimization:
irods-1  | 5357.438101519:main thread    : ruleset 0x55e820eafea0: ruleset.c: rsyslog ruleset RSYSLOG_DefaultRuleset:
irods-1  | 5357.438105024:main thread    : rainerscript.c: PROPFILT
irods-1  | 5357.438106347:main thread    : rainerscript.c: 	Property.: 'programname'
irods-1  | 5357.438107767:main thread    : rainerscript.c: 	Operation: 'startswith'
irods-1  | 5357.438110461:main thread    : rainerscript.c: 	Value....: 'irodsServer'
irods-1  | 5357.438111484:main thread    : rainerscript.c: THEN
irods-1  | 5357.438112744:main thread    : rainerscript.c:   ACTION 0 [builtin:omfile:/var/log/irods/irods.log;irods_format]
irods-1  | 5357.438115425:main thread    : rainerscript.c:   STOP
irods-1  | 5357.438117678:main thread    : rainerscript.c: END PROPFILT
irods-1  | 5357.438118994:main thread    : rainerscript.c: PROPFILT
irods-1  | 5357.438120264:main thread    : rainerscript.c: 	Property.: 'programname'
irods-1  | 5357.438121391:main thread    : rainerscript.c: 	Operation: 'startswith'
irods-1  | 5357.438123608:main thread    : rainerscript.c: 	Value....: 'irodsDelayServer'
irods-1  | 5357.438124776:main thread    : rainerscript.c: THEN
irods-1  | 5357.438125984:main thread    : rainerscript.c:   ACTION 1 [builtin:omfile:/var/log/irods/irods.log;irods_format]
irods-1  | 5357.438128268:main thread    : rainerscript.c:   STOP
irods-1  | 5357.438130401:main thread    : rainerscript.c: END PROPFILT
irods-1  | 5357.438131664:main thread    : rainerscript.c: PRIFILT 'auth,authpriv.*'
irods-1  | 5357.438132838:main thread    : rainerscript.c: pmask:  X  X  X  X FF  X  X  X  X  X FF  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X 
irods-1  | 5357.438178412:main thread    : rainerscript.c:   ACTION 2 [builtin:omfile:/var/log/auth.log]
irods-1  | 5357.438180801:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438193465:main thread    : rainerscript.c: PRIFILT '*.*;auth,authpriv.none'
irods-1  | 5357.438196903:main thread    : rainerscript.c: pmask: FF FF FF FF  X FF FF FF FF FF  X FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF 
irods-1  | 5357.438304396:main thread    : rainerscript.c:   ACTION 3 [builtin:omfile:-/var/log/syslog]
irods-1  | 5357.438318471:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438321906:main thread    : rainerscript.c: PRIFILT 'kern.*'
irods-1  | 5357.438323099:main thread    : rainerscript.c: pmask: FF  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X 
irods-1  | 5357.438354083:main thread    : rainerscript.c:   ACTION 4 [builtin:omfile:-/var/log/kern.log]
irods-1  | 5357.438356686:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438358074:main thread    : rainerscript.c: PRIFILT 'mail.*'
irods-1  | 5357.438359247:main thread    : rainerscript.c: pmask:  X  X FF  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X 
irods-1  | 5357.438422335:main thread    : rainerscript.c:   ACTION 5 [builtin:omfile:-/var/log/mail.log]
irods-1  | 5357.438439478:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438440792:main thread    : rainerscript.c: PRIFILT 'mail.err'
irods-1  | 5357.438443412:main thread    : rainerscript.c: pmask:  X  X  F  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X 
irods-1  | 5357.438507045:main thread    : rainerscript.c:   ACTION 6 [builtin:omfile:/var/log/mail.err]
irods-1  | 5357.438509346:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438526245:main thread    : rainerscript.c: PRIFILT '*.emerg'
irods-1  | 5357.438529492:main thread    : rainerscript.c: pmask:  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1 
irods-1  | 5357.438569364:main thread    : rainerscript.c:   ACTION 7 [builtin:omusrmsg::omusrmsg:*]
irods-1  | 5357.438572184:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438573587:main thread    : ruleset 0x55e820eafea0: ruleset.c: ruleset RSYSLOG_DefaultRuleset assigned parser list:
irods-1  | 5357.438575242:main thread    : ruleset.c: ruleset optimization phase finished.
irods-1  | 5357.438576894:main thread    : rsconf.c: Number of actions in this configuration: 8
irods-1  | 5357.438578487:main thread    : rsconf.c: telling rsyslog core that config load for 0x55e820eac070 is done
irods-1  | 5357.438581198:main thread    : glbl.c: Timezone information table (0 entries):
irods-1  | 5357.438585019:main thread    : rsconf.c: telling modules that config load for 0x55e820eac070 is done
irods-1  | 5357.438586558:main thread    : rsconf.c: beginCnfLoad(0x55e81ff43990) for module 'builtin:omfile'
irods-1  | 5357.438587650:main thread    : rsconf.c: calling endCnfLoad() for module 'builtin:omfile'
irods-1  | 5357.438588999:main thread    : rsconf.c: beginCnfLoad(0x55e81ff46c70) for module 'builtin:ompipe'
irods-1  | 5357.438590169:main thread    : rsconf.c: calling endCnfLoad() for module 'builtin:ompipe'
irods-1  | 5357.438591708:main thread    : rsconf.c: beginCnfLoad((nil)) for module 'builtin-shell'
irods-1  | 5357.438593257:main thread    : rsconf.c: beginCnfLoad((nil)) for module 'builtin:omdiscard'
irods-1  | 5357.438594556:main thread    : rsconf.c: beginCnfLoad(0x55e81ff40270) for module 'builtin:omfwd'
irods-1  | 5357.438595769:main thread    : rsconf.c: calling endCnfLoad() for module 'builtin:omfwd'
irods-1  | 5357.438597105:main thread    : rsconf.c: beginCnfLoad((nil)) for module 'builtin:omusrmsg'
irods-1  | 5357.438598367:main thread    : rsconf.c: beginCnfLoad((nil)) for module 'builtin:pmrfc5424'
irods-1  | 5357.438599651:main thread    : rsconf.c: beginCnfLoad((nil)) for module 'builtin:pmrfc3164'
irods-1  | 5357.438600910:main thread    : rsconf.c: beginCnfLoad((nil)) for module 'builtin:smfile'
irods-1  | 5357.438602158:main thread    : rsconf.c: beginCnfLoad((nil)) for module 'builtin:smtradfile'
irods-1  | 5357.438603384:main thread    : rsconf.c: beginCnfLoad((nil)) for module 'builtin:smfwd'
irods-1  | 5357.438604652:main thread    : rsconf.c: beginCnfLoad((nil)) for module 'builtin:smtradfwd'
irods-1  | 5357.438605934:main thread    : rsconf.c: beginCnfLoad(0x7f0b6aa1bab0) for module 'imuxsock'
irods-1  | 5357.438607627:main thread    : rsconf.c: calling endCnfLoad() for module 'imuxsock'
irods-1  | 5357.438609225:main thread    : rsconf.c: telling modules to check config 0x55e820eac070
irods-1  | 5357.438610647:main thread    : rsconf.c: module builtin:omfile tells us config can be activated
irods-1  | 5357.438612009:main thread    : rsconf.c: module builtin:ompipe tells us config can be activated
irods-1  | 5357.438613310:main thread    : rsconf.c: module builtin:omfwd tells us config can be activated
irods-1  | 5357.438614733:main thread    : rsconf.c: module imuxsock tells us config can be activated
irods-1  | 5357.438615967:main thread    : rsconf.c: rsyslog finished loading master config 0x55e820eac070
irods-1  | 5357.438617590:main thread    : rsconf.c: configuration object 0x55e820eac070
irods-1  | 5357.438619016:main thread    : rsconf.c: Global Settings:
irods-1  | 5357.438620586:main thread    : rsconf.c:   bDebugPrintTemplateList.............: 1
irods-1  | 5357.438622113:main thread    : rsconf.c:   bDebugPrintModuleList               : 0
irods-1  | 5357.438623515:main thread    : rsconf.c:   bDebugPrintCfSysLineHandlerList.....: 0
irods-1  | 5357.438624792:main thread    : rsconf.c:   bLogStatusMsgs                      : 1
irods-1  | 5357.438626038:main thread    : rsconf.c:   bErrMsgToStderr.....................: 1
irods-1  | 5357.438627360:main thread    : rsconf.c:   drop Msgs with malicious PTR Record : 0
irods-1  | 5357.438628827:main thread    : ruleset.c: All Rulesets:
irods-1  | 5357.438630373:main thread    : ruleset 0x55e820eafea0: ruleset.c: rsyslog ruleset RSYSLOG_DefaultRuleset:
irods-1  | 5357.438633096:main thread    : rainerscript.c: PROPFILT
irods-1  | 5357.438636576:main thread    : rainerscript.c: 	Property.: 'programname'
irods-1  | 5357.438637763:main thread    : rainerscript.c: 	Operation: 'startswith'
irods-1  | 5357.438639813:main thread    : rainerscript.c: 	Value....: 'irodsServer'
irods-1  | 5357.438641037:main thread    : rainerscript.c: THEN
irods-1  | 5357.438642216:main thread    : rainerscript.c:   ACTION 0 [builtin:omfile:/var/log/irods/irods.log;irods_format]
irods-1  | 5357.438644663:main thread    : rainerscript.c:   STOP
irods-1  | 5357.438647229:main thread    : rainerscript.c: END PROPFILT
irods-1  | 5357.438648451:main thread    : rainerscript.c: PROPFILT
irods-1  | 5357.438649667:main thread    : rainerscript.c: 	Property.: 'programname'
irods-1  | 5357.438651111:main thread    : rainerscript.c: 	Operation: 'startswith'
irods-1  | 5357.438653440:main thread    : rainerscript.c: 	Value....: 'irodsDelayServer'
irods-1  | 5357.438654609:main thread    : rainerscript.c: THEN
irods-1  | 5357.438655843:main thread    : rainerscript.c:   ACTION 1 [builtin:omfile:/var/log/irods/irods.log;irods_format]
irods-1  | 5357.438658281:main thread    : rainerscript.c:   STOP
irods-1  | 5357.438660555:main thread    : rainerscript.c: END PROPFILT
irods-1  | 5357.438661993:main thread    : rainerscript.c: PRIFILT 'auth,authpriv.*'
irods-1  | 5357.438663276:main thread    : rainerscript.c: pmask:  X  X  X  X FF  X  X  X  X  X FF  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X 
irods-1  | 5357.438693076:main thread    : rainerscript.c:   ACTION 2 [builtin:omfile:/var/log/auth.log]
irods-1  | 5357.438695848:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438697173:main thread    : rainerscript.c: PRIFILT '*.*;auth,authpriv.none'
irods-1  | 5357.438698374:main thread    : rainerscript.c: pmask: FF FF FF FF  X FF FF FF FF FF  X FF FF FF FF FF FF FF FF FF FF FF FF FF FF FF 
irods-1  | 5357.438726805:main thread    : rainerscript.c:   ACTION 3 [builtin:omfile:-/var/log/syslog]
irods-1  | 5357.438729322:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438730531:main thread    : rainerscript.c: PRIFILT 'kern.*'
irods-1  | 5357.438731711:main thread    : rainerscript.c: pmask: FF  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X 
irods-1  | 5357.438758549:main thread    : rainerscript.c:   ACTION 4 [builtin:omfile:-/var/log/kern.log]
irods-1  | 5357.438761117:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438762650:main thread    : rainerscript.c: PRIFILT 'mail.*'
irods-1  | 5357.438763842:main thread    : rainerscript.c: pmask:  X  X FF  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X 
irods-1  | 5357.438791723:main thread    : rainerscript.c:   ACTION 5 [builtin:omfile:-/var/log/mail.log]
irods-1  | 5357.438793919:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438795154:main thread    : rainerscript.c: PRIFILT 'mail.err'
irods-1  | 5357.438796575:main thread    : rainerscript.c: pmask:  X  X  F  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X  X 
irods-1  | 5357.438824592:main thread    : rainerscript.c:   ACTION 6 [builtin:omfile:/var/log/mail.err]
irods-1  | 5357.438826877:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438828228:main thread    : rainerscript.c: PRIFILT '*.emerg'
irods-1  | 5357.438829615:main thread    : rainerscript.c: pmask:  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1 
irods-1  | 5357.438859061:main thread    : rainerscript.c:   ACTION 7 [builtin:omusrmsg::omusrmsg:*]
irods-1  | 5357.438861632:main thread    : rainerscript.c: END PRIFILT
irods-1  | 5357.438863279:main thread    : ruleset 0x55e820eafea0: ruleset.c: ruleset RSYSLOG_DefaultRuleset assigned parser list:
irods-1  | 5357.438864625:main thread    : ruleset.c: End of Rulesets.
irods-1  | 5357.438865921:main thread    : rsconf.c: 
irods-1  | 5357.438867369:main thread    : ../template.c: Template: Name='RSYSLOG_DebugFormat' 
irods-1  | 5357.438870117:main thread    : ../template.c: 	Entry(55e820eb2960): type 1, (CONSTANT), value: 'Debug line with all properties:
irods-1  | FROMHOST: ''
irods-1  | 5357.438874487:main thread    : ../template.c: 	Entry(55e820eb2a20): type 2, (FIELD), value: '7' 
irods-1  | 5357.438878235:main thread    : ../template.c: 	Entry(55e820eb2b90): type 1, (CONSTANT), value: '', fromhost-ip: ''
irods-1  | 5357.438881803:main thread    : ../template.c: 	Entry(55e820eb2c50): type 2, (FIELD), value: '8' 
irods-1  | 5357.438886723:main thread    : ../template.c: 	Entry(55e820eb2dc0): type 1, (CONSTANT), value: '', HOSTNAME: ''
irods-1  | 5357.438889950:main thread    : ../template.c: 	Entry(55e820eb2e80): type 2, (FIELD), value: '3' 
irods-1  | 5357.438893453:main thread    : ../template.c: 	Entry(55e820eb2ff0): type 1, (CONSTANT), value: '', PRI: '
irods-1  | 5357.438896955:main thread    : ../template.c: 	Entry(55e820eb30b0): type 2, (FIELD), value: '9' 
irods-1  | 5357.438900287:main thread    : ../template.c: 	Entry(55e820eb3220): type 1, (CONSTANT), value: ',
irods-1  | syslogtag ''
irods-1  | 5357.438903710:main thread    : ../template.c: 	Entry(55e820eb32e0): type 2, (FIELD), value: '4' 
irods-1  | 5357.438907557:main thread    : ../template.c: 	Entry(55e820eb3450): type 1, (CONSTANT), value: '', programname: ''
irods-1  | 5357.438914967:main thread    : ../template.c: 	Entry(55e820eb3510): type 2, (FIELD), value: '17' 
irods-1  | 5357.438918739:main thread    : ../template.c: 	Entry(55e820eb3680): type 1, (CONSTANT), value: '', APP-NAME: ''
irods-1  | 5357.438922331:main thread    : ../template.c: 	Entry(55e820eb3740): type 2, (FIELD), value: '20' 
irods-1  | 5357.438926211:main thread    : ../template.c: 	Entry(55e820eb38b0): type 1, (CONSTANT), value: '', PROCID: ''
irods-1  | 5357.438929424:main thread    : ../template.c: 	Entry(55e820eb3970): type 2, (FIELD), value: '21' 
irods-1  | 5357.438932489:main thread    : ../template.c: 	Entry(55e820eb3ae0): type 1, (CONSTANT), value: '', MSGID: ''
irods-1  | 5357.438935666:main thread    : ../template.c: 	Entry(55e820eb3ba0): type 2, (FIELD), value: '22' 
irods-1  | 5357.438938764:main thread    : ../template.c: 	Entry(55e820eb3d10): type 1, (CONSTANT), value: '',
irods-1  | TIMESTAMP: ''
irods-1  | 5357.438941971:main thread    : ../template.c: 	Entry(55e820eb3dd0): type 2, (FIELD), value: '2' 
irods-1  | 5357.438945074:main thread    : ../template.c: 	Entry(55e820eb3f40): type 1, (CONSTANT), value: '', STRUCTURED-DATA: ''
irods-1  | 5357.438948774:main thread    : ../template.c: 	Entry(55e820eb4000): type 2, (FIELD), value: '19' 
irods-1  | 5357.438952286:main thread    : ../template.c: 	Entry(55e820eb4170): type 1, (CONSTANT), value: '',
irods-1  | msg: ''
irods-1  | 5357.438955960:main thread    : ../template.c: 	Entry(55e820eb4230): type 2, (FIELD), value: '1' 
irods-1  | 5357.438959666:main thread    : ../template.c: 	Entry(55e820eb43a0): type 1, (CONSTANT), value: ''
irods-1  | escaped msg: ''
irods-1  | 5357.438963217:main thread    : ../template.c: 	Entry(55e820eb4460): type 2, (FIELD), value: '1' [drop control-characters] [COMPLEX]
irods-1  | 5357.438968925:main thread    : ../template.c: 	Entry(55e820eb45d0): type 1, (CONSTANT), value: ''
irods-1  | inputname: '
irods-1  | 5357.438972141:main thread    : ../template.c: 	Entry(55e820eb4690): type 2, (FIELD), value: '6' 
irods-1  | 5357.438975961:main thread    : ../template.c: 	Entry(55e820eb4800): type 1, (CONSTANT), value: ' rawmsg: ''
irods-1  | 5357.438979179:main thread    : ../template.c: 	Entry(55e820eb48c0): type 2, (FIELD), value: '5' 
irods-1  | 5357.438982251:main thread    : ../template.c: 	Entry(55e820eb4a30): type 1, (CONSTANT), value: ''
irods-1  | $!:'
irods-1  | 5357.438985456:main thread    : ../template.c: 	Entry(55e820eb4af0): type 2, (FIELD), value: '200' [EE-Property: '!'] 
irods-1  | 5357.438990090:main thread    : ../template.c: 	Entry(55e820eb4c80): type 1, (CONSTANT), value: '
irods-1  | $.:'
irods-1  | 5357.438993476:main thread    : ../template.c: 	Entry(55e820eb4d40): type 2, (FIELD), value: '202' [Local Var: '!'] 
irods-1  | 5357.438998276:main thread    : ../template.c: 	Entry(55e820eb4ed0): type 1, (CONSTANT), value: '
irods-1  | $/:'
irods-1  | 5357.439001613:main thread    : ../template.c: 	Entry(55e820eb4f90): type 2, (FIELD), value: '203' 
irods-1  | 5357.439004720:main thread    : ../template.c: 	Entry(55e820eb5120): type 1, (CONSTANT), value: '
irods-1  | 
irods-1  | '
irods-1  | 5357.439007922:main thread    : ../template.c: Template: Name='RSYSLOG_SyslogProtocol23Format' 
irods-1  | 5357.439010683:main thread    : ../template.c: 	Entry(55e820eb5310): type 1, (CONSTANT), value: '<'
irods-1  | 5357.439014363:main thread    : ../template.c: 	Entry(55e820eb53d0): type 2, (FIELD), value: '9' 
irods-1  | 5357.439017834:main thread    : ../template.c: 	Entry(55e820eb5540): type 1, (CONSTANT), value: '>1 '
irods-1  | 5357.439021194:main thread    : ../template.c: 	Entry(55e820eb5600): type 2, (FIELD), value: '2' [Format as RFC3339-Date] [COMPLEX]
irods-1  | 5357.439026358:main thread    : ../template.c: 	Entry(55e820eb5770): type 1, (CONSTANT), value: ' '
irods-1  | 5357.439030698:main thread    : ../template.c: 	Entry(55e820eb5830): type 2, (FIELD), value: '3' 
irods-1  | 5357.439033991:main thread    : ../template.c: 	Entry(55e820eb59a0): type 1, (CONSTANT), value: ' '
irods-1  | 5357.439037484:main thread    : ../template.c: 	Entry(55e820eb5a60): type 2, (FIELD), value: '20' 
irods-1  | 5357.439040766:main thread    : ../template.c: 	Entry(55e820eb5bd0): type 1, (CONSTANT), value: ' '
irods-1  | 5357.439044570:main thread    : ../template.c: 	Entry(55e820eb5c90): type 2, (FIELD), value: '21' 
irods-1  | 5357.439052702:main thread    : ../template.c: 	Entry(55e820eb5e00): type 1, (CONSTANT), value: ' '
irods-1  | 5357.439058130:main thread    : ../template.c: 	Entry(55e820eb5ec0): type 2, (FIELD), value: '22' 
irods-1  | 5357.439061424:main thread    : ../template.c: 	Entry(55e820eb6030): type 1, (CONSTANT), value: ' '
irods-1  | 5357.439064748:main thread    : ../template.c: 	Entry(55e820eb60f0): type 2, (FIELD), value: '19' 
irods-1  | 5357.439068190:main thread    : ../template.c: 	Entry(55e820eb6260): type 1, (CONSTANT), value: ' '
irods-1  | 5357.439071712:main thread    : ../template.c: 	Entry(55e820eb6320): type 2, (FIELD), value: '1' 
irods-1  | 5357.439074837:main thread    : ../template.c: 	Entry(55e820eb6490): type 1, (CONSTANT), value: '
irods-1  | '
irods-1  | 5357.439078058:main thread    : ../template.c: Template: Name='RSYSLOG_FileFormat' 
irods-1  | 5357.439080334:main thread    : ../template.c: Template: Name='RSYSLOG_TraditionalFileFormat' 
irods-1  | 5357.439082643:main thread    : ../template.c: Template: Name=' WallFmt' 
irods-1  | 5357.439085300:main thread    : ../template.c: 	Entry(55e820eb67a0): type 1, (CONSTANT), value: '
irods-1  | Message from syslogd@'
irods-1  | 5357.439088836:main thread    : ../template.c: 	Entry(55e820eb6860): type 2, (FIELD), value: '3' 
irods-1  | 5357.439092503:main thread    : ../template.c: 	Entry(55e820eb69d0): type 1, (CONSTANT), value: ' at '
irods-1  | 5357.439096077:main thread    : ../template.c: 	Entry(55e820eb6a90): type 2, (FIELD), value: '16' 
irods-1  | 5357.439099198:main thread    : ../template.c: 	Entry(55e820eb6c00): type 1, (CONSTANT), value: ' ...
irods-1  |  '
irods-1  | 5357.439102640:main thread    : ../template.c: 	Entry(55e820eb6cc0): type 2, (FIELD), value: '4' 
irods-1  | 5357.439106754:main thread    : ../template.c: 	Entry(55e820eb6e30): type 2, (FIELD), value: '1' 
irods-1  | 5357.439110006:main thread    : ../template.c: 	Entry(55e820eb6f10): type 1, (CONSTANT), value: '
'rods-1  | 
irods-1  | 5357.439113216:main thread    : ../template.c: Template: Name='RSYSLOG_ForwardFormat' 
irods-1  | 5357.439115860:main thread    : ../template.c: Template: Name='RSYSLOG_TraditionalForwardFormat' 
irods-1  | 5357.439118184:main thread    : ../template.c: Template: Name=' StdUsrMsgFmt' 
irods-1  | 5357.439120359:main thread    : ../template.c: 	Entry(55e820eb7220): type 1, (CONSTANT), value: ' '
irods-1  | 5357.439123564:main thread    : ../template.c: 	Entry(55e820eb72e0): type 2, (FIELD), value: '4' 
irods-1  | 5357.439127078:main thread    : ../template.c: 	Entry(55e820eb7450): type 2, (FIELD), value: '1' 
irods-1  | 5357.439131010:main thread    : ../template.c: 	Entry(55e820eb7530): type 1, (CONSTANT), value: '
'rods-1  | 
irods-1  | 5357.439134242:main thread    : ../template.c: Template: Name=' StdDBFmt' [SQL-Format (MySQL)] 
irods-1  | 5357.439138097:main thread    : ../template.c: 	Entry(55e820eb7810): type 1, (CONSTANT), value: 'insert into SystemEvents (Message, Facility, FromHost, Priority, DeviceReportedTime, ReceivedAt, InfoUnitID, SysLogTag) values (''
irods-1  | 5357.439141367:main thread    : ../template.c: 	Entry(55e820eb78d0): type 2, (FIELD), value: '1' 
irods-1  | 5357.439144947:main thread    : ../template.c: 	Entry(55e820eb7a40): type 1, (CONSTANT), value: '', '
irods-1  | 5357.439148079:main thread    : ../template.c: 	Entry(55e820eb7b00): type 2, (FIELD), value: '12' 
irods-1  | 5357.439151738:main thread    : ../template.c: 	Entry(55e820eb7c70): type 1, (CONSTANT), value: ', ''
irods-1  | 5357.439154885:main thread    : ../template.c: 	Entry(55e820eb7d30): type 2, (FIELD), value: '3' 
irods-1  | 5357.439158395:main thread    : ../template.c: 	Entry(55e820eb7ea0): type 1, (CONSTANT), value: '', '
irods-1  | 5357.439161518:main thread    : ../template.c: 	Entry(55e820eb7f60): type 2, (FIELD), value: '14' 
irods-1  | 5357.439164829:main thread    : ../template.c: 	Entry(55e820eb80d0): type 1, (CONSTANT), value: ', ''
irods-1  | 5357.439169719:main thread    : ../template.c: 	Entry(55e820eb8190): type 2, (FIELD), value: '2' [Format as MySQL-Date] [COMPLEX]
irods-1  | 5357.439176031:main thread    : ../template.c: 	Entry(55e820eb8300): type 1, (CONSTANT), value: '', ''
irods-1  | 5357.439179178:main thread    : ../template.c: 	Entry(55e820eb83c0): type 2, (FIELD), value: '16' [Format as MySQL-Date] [COMPLEX]
irods-1  | 5357.439184282:main thread    : ../template.c: 	Entry(55e820eb8530): type 1, (CONSTANT), value: '', '
irods-1  | 5357.439187393:main thread    : ../template.c: 	Entry(55e820eb85f0): type 2, (FIELD), value: '11' 
irods-1  | 5357.439190545:main thread    : ../template.c: 	Entry(55e820eb8760): type 1, (CONSTANT), value: ', ''
irods-1  | 5357.439193727:main thread    : ../template.c: 	Entry(55e820eb8820): type 2, (FIELD), value: '4' 
irods-1  | 5357.439197139:main thread    : ../template.c: 	Entry(55e820eb8990): type 1, (CONSTANT), value: '')'
irods-1  | 5357.439200312:main thread    : ../template.c: Template: Name='RSYSLOG_SysklogdFileFormat' 
irods-1  | 5357.439202473:main thread    : ../template.c: 	Entry(55e820eb8af0): type 2, (FIELD), value: '2' 
irods-1  | 5357.439206059:main thread    : ../template.c: 	Entry(55e820eb8c60): type 1, (CONSTANT), value: ' '
irods-1  | 5357.439209555:main thread    : ../template.c: 	Entry(55e820eb8d20): type 2, (FIELD), value: '3' 
irods-1  | 5357.439212674:main thread    : ../template.c: 	Entry(55e820eb8e90): type 1, (CONSTANT), value: ' '
irods-1  | 5357.439215799:main thread    : ../template.c: 	Entry(55e820eb8f50): type 2, (FIELD), value: '4' 
irods-1  | 5357.439219194:main thread    : ../template.c: 	Entry(55e820eb90c0): type 2, (FIELD), value: '1' [SP iff no first SP] [COMPLEX]
irods-1  | 5357.439224918:main thread    : ../template.c: 	Entry(55e820eb91a0): type 2, (FIELD), value: '1' 
irods-1  | 5357.439228267:main thread    : ../template.c: 	Entry(55e820eb9280): type 1, (CONSTANT), value: '
irods-1  | '
irods-1  | 5357.439231381:main thread    : ../template.c: Template: Name=' StdPgSQLFmt' [SQL-Format (standard SQL)] 
irods-1  | 5357.439234874:main thread    : ../template.c: 	Entry(55e820eb9560): type 1, (CONSTANT), value: 'insert into SystemEvents (Message, Facility, FromHost, Priority, DeviceReportedTime, ReceivedAt, InfoUnitID, SysLogTag) values (''
irods-1  | 5357.439238209:main thread    : ../template.c: 	Entry(55e820eb9620): type 2, (FIELD), value: '1' 
irods-1  | 5357.439242194:main thread    : ../template.c: 	Entry(55e820eb9790): type 1, (CONSTANT), value: '', '
irods-1  | 5357.439245321:main thread    : ../template.c: 	Entry(55e820eb9850): type 2, (FIELD), value: '12' 
irods-1  | 5357.439248571:main thread    : ../template.c: 	Entry(55e820eb99c0): type 1, (CONSTANT), value: ', ''
irods-1  | 5357.439252251:main thread    : ../template.c: 	Entry(55e820eb9a80): type 2, (FIELD), value: '3' 
irods-1  | 5357.439255287:main thread    : ../template.c: 	Entry(55e820eb9bf0): type 1, (CONSTANT), value: '', '
irods-1  | 5357.439258426:main thread    : ../template.c: 	Entry(55e820eb9cb0): type 2, (FIELD), value: '14' 
irods-1  | 5357.439261617:main thread    : ../template.c: 	Entry(55e820eb9e20): type 1, (CONSTANT), value: ', ''
irods-1  | 5357.439265494:main thread    : ../template.c: 	Entry(55e820eb9ee0): type 2, (FIELD), value: '2' [Format as PgSQL-Date] [COMPLEX]
irods-1  | 5357.439270574:main thread    : ../template.c: 	Entry(55e820eba050): type 1, (CONSTANT), value: '', ''
irods-1  | 5357.439273588:main thread    : ../template.c: 	Entry(55e820eba110): type 2, (FIELD), value: '16' [Format as PgSQL-Date] [COMPLEX]
irods-1  | 5357.439279521:main thread    : ../template.c: 	Entry(55e820eba280): type 1, (CONSTANT), value: '', '
irods-1  | 5357.439282668:main thread    : ../template.c: 	Entry(55e820eba340): type 2, (FIELD), value: '11' 
irods-1  | 5357.439286004:main thread    : ../template.c: 	Entry(55e820eba4b0): type 1, (CONSTANT), value: ', ''
irods-1  | 5357.439289833:main thread    : ../template.c: 	Entry(55e820eba570): type 2, (FIELD), value: '4' 
irods-1  | 5357.439293047:main thread    : ../template.c: 	Entry(55e820eba6e0): type 1, (CONSTANT), value: '')'
irods-1  | 5357.439296265:main thread    : ../template.c: Template: Name=' StdJSONFmt' 
irods-1  | 5357.439298384:main thread    : ../template.c: 	Entry(55e820eba8c0): type 1, (CONSTANT), value: '{"message":"'
irods-1  | 5357.439302068:main thread    : ../template.c: 	Entry(55e820eba980): type 2, (FIELD), value: '1' [format as JSON] [COMPLEX]
irods-1  | 5357.439312118:main thread    : ../template.c: 	Entry(55e820ebaaf0): type 1, (CONSTANT), value: '","fromhost":"'
irods-1  | 5357.439315096:main thread    : ../template.c: 	Entry(55e820ebabb0): type 2, (FIELD), value: '3' [format as JSON] [COMPLEX]
irods-1  | 5357.439320503:main thread    : ../template.c: 	Entry(55e820ebad20): type 1, (CONSTANT), value: '","facility":"'
irods-1  | 5357.439323740:main thread    : ../template.c: 	Entry(55e820ebade0): type 2, (FIELD), value: '13' 
irods-1  | 5357.439327174:main thread    : ../template.c: 	Entry(55e820ebaf50): type 1, (CONSTANT), value: '","priority":"'
irods-1  | 5357.439330527:main thread    : ../template.c: 	Entry(55e820ebb010): type 2, (FIELD), value: '15' 
irods-1  | 5357.439333964:main thread    : ../template.c: 	Entry(55e820ebb180): type 1, (CONSTANT), value: '","timereported":"'
irods-1  | 5357.439337139:main thread    : ../template.c: 	Entry(55e820ebb240): type 2, (FIELD), value: '2' [Format as RFC3339-Date] [COMPLEX]
irods-1  | 5357.439342875:main thread    : ../template.c: 	Entry(55e820ebb3b0): type 1, (CONSTANT), value: '","timegenerated":"'
irods-1  | 5357.439346905:main thread    : ../template.c: 	Entry(55e820ebb470): type 2, (FIELD), value: '16' [Format as RFC3339-Date] [COMPLEX]
irods-1  | 5357.439352258:main thread    : ../template.c: 	Entry(55e820ebb5e0): type 1, (CONSTANT), value: '"}'
irods-1  | 5357.439355467:main thread    : ../template.c: Template: Name=' StdClickHouseFmt' [SQL-Format (standard SQL)] 
irods-1  | 5357.439358720:main thread    : ../template.c: 	Entry(55e820ebb7c0): type 1, (CONSTANT), value: 'INSERT INTO rsyslog.SystemEvents (severity, facility, timestamp, hostname, tag, message) VALUES ('
irods-1  | 5357.439362203:main thread    : ../template.c: 	Entry(55e820ebb880): type 2, (FIELD), value: '14' 
irods-1  | 5357.439365440:main thread    : ../template.c: 	Entry(55e820ebb9f0): type 1, (CONSTANT), value: ', '
irods-1  | 5357.439369120:main thread    : ../template.c: 	Entry(55e820ebbab0): type 2, (FIELD), value: '12' 
irods-1  | 5357.439372551:main thread    : ../template.c: 	Entry(55e820ebbc20): type 1, (CONSTANT), value: ', ''
irods-1  | 5357.439375705:main thread    : ../template.c: 	Entry(55e820ebbce0): type 2, (FIELD), value: '2' [Format as Unix timestamp] [COMPLEX]
irods-1  | 5357.439381483:main thread    : ../template.c: 	Entry(55e820ebbe50): type 1, (CONSTANT), value: '', ''
irods-1  | 5357.439385311:main thread    : ../template.c: 	Entry(55e820ebbf10): type 2, (FIELD), value: '3' 
irods-1  | 5357.439388670:main thread    : ../template.c: 	Entry(55e820ebc080): type 1, (CONSTANT), value: '', ''
irods-1  | 5357.439392170:main thread    : ../template.c: 	Entry(55e820ebc140): type 2, (FIELD), value: '4' 
irods-1  | 5357.439395553:main thread    : ../template.c: 	Entry(55e820ebc2b0): type 1, (CONSTANT), value: '', ''
irods-1  | 5357.439398962:main thread    : ../template.c: 	Entry(55e820ebc370): type 2, (FIELD), value: '1' 
irods-1  | 5357.439402876:main thread    : ../template.c: 	Entry(55e820ebc4e0): type 1, (CONSTANT), value: '')'
irods-1  | 5357.439406541:main thread    : ../template.c: Template: Name='RSYSLOG_omudpspoofDfltSourceTpl' 
irods-1  | 5357.439408780:main thread    : ../template.c: 	Entry(55e820ebc640): type 2, (FIELD), value: '8' 
irods-1  | 5357.439412683:main thread    : ../template.c: Template: Name='irods_format' 
irods-1  | 5357.439414970:main thread    : ../template.c: 	Entry(55e820ebfc70): type 2, (FIELD), value: '1' 
irods-1  | 5357.439418087:main thread    : ../template.c: 	Entry(55e820ebfd30): type 1, (CONSTANT), value: '
irods-1  | '
irods-1  | 5357.439421752:main thread    : rsconf.c: Main queue size 100000 messages.
irods-1  | 5357.439423309:main thread    : rsconf.c: Main queue worker threads: 2, wThread shutdown: 60000, Perists every 0 updates.
irods-1  | 5357.439425077:main thread    : rsconf.c: Main queue timeouts: shutdown: 1500, action completion shutdown: 1000, enq: 2000
irods-1  | 5357.439426696:main thread    : rsconf.c: Main queue watermarks: high: 80000, low: 20000, discard: 98000, discard-severity: 8
irods-1  | 5357.439428393:main thread    : rsconf.c: Main queue save on shutdown 1, max disk space allowed 0
irods-1  | 5357.439429750:main thread    : rsconf.c: Work Directory: '/var/spool/rsyslog'.
irods-1  | 5357.439431081:main thread    : rsconf.c: Modules used in this configuration:
irods-1  | 5357.439432462:main thread    : rsconf.c:     builtin:omfile
irods-1  | 5357.439433790:main thread    : rsconf.c:     builtin:ompipe
irods-1  | 5357.439436291:main thread    : rsconf.c:     builtin-shell
irods-1  | 5357.439437655:main thread    : rsconf.c:     builtin:omdiscard
irods-1  | 5357.439438923:main thread    : rsconf.c:     builtin:omfwd
irods-1  | 5357.439440180:main thread    : rsconf.c:     builtin:omusrmsg
irods-1  | 5357.439441402:main thread    : rsconf.c:     builtin:pmrfc5424
irods-1  | 5357.439442748:main thread    : rsconf.c:     builtin:pmrfc3164
irods-1  | 5357.439443983:main thread    : rsconf.c:     builtin:smfile
irods-1  | 5357.439445440:main thread    : rsconf.c:     builtin:smtradfile
irods-1  | 5357.439446639:main thread    : rsconf.c:     builtin:smfwd
irods-1  | 5357.439448037:main thread    : rsconf.c:     builtin:smtradfwd
irods-1  | 5357.439449306:main thread    : rsconf.c:     imuxsock
irods-1  | 5357.439451147:main thread    : glbl.c: GenerateLocalHostName uses 'irods'
irods-1  | 5357.439453647:main thread    : ratelimit.c: ratelimit:rsyslogd[dflt]:new ratelimiter:bReduceRepeatMsgs 1
irods-1  | 5357.439455381:main thread    : ratelimit.c: ratelimit:rsyslogd[internal_messages]:new ratelimiter:bReduceRepeatMsgs 1
irods-1  | 5357.439458528:main thread    : rsyslogd.c: rsyslogd: checking if startup is ok, pidfile '/run/rsyslogd.pid'.
irods-1  | 5357.439465667:main thread    : rsyslogd.c: rsyslogd: parent ready for forking
irods-1  | 5357.439582598:main thread    : rsyslogd.c: rsyslogd: parent waiting up to 60 seconds to read startup message
irods-1  | 5357.439643097:main thread    : rsyslogd.c: rsyslogd: in child, finalizing initialization
irods-1  | 5417.499630521:main thread    : rsyslogd.c: rsyslogd: select() returns 0: OK
irods-1  | rsyslog startup failure, child did not respond within startup timeout (60 seconds)

@mikkonie
Copy link
Contributor Author

The solution to this can be found in this issue discussion.

Adding $MaxOpenFiles with a low-ish number to the rsyslog conf prevents this failure for happening.

I'll try to figure out some resonable number to set here. The documentation is here

Ideally, we should add a volume for the syslog configs in the docker compose env, so things like these could be edited. And/or make it configurable as a template on build.

@mikkonie
Copy link
Contributor Author

I guess another possible way to fix this would be to use ulimits in Docker Compose?

This is really outside my expertise tbh, comments are welcome.

mikkonie added a commit that referenced this issue Nov 27, 2024
@mikkonie
add rsyslog MaxOpenFiles workaround (#37)
d0efe95
@mikkonie
Copy link
Contributor Author

Confirmed as fixed in staging with the $MaxOpenFiles workaround. If someone has ideas for a better fix, I'm all ears, but closing this issue for now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mikkonie mikkonie

Labels
bug Something isn't working environment Issues regarding dependencies, CI, deployment etc.
Projects
None yet
Milestone
v4.3.3-1
Development

No branches or pull requests
1 participant
@mikkonie