[receiver/filelog] Limiting "finding files: no files match the configured criteria" logs

[omrozowicz-splunk]

Component(s)

receiver/filelog

Is your feature request related to a problem? Please describe.

Some users use filelog receiver as a part of a tool for Kubernetes logs monitoring. They configure agents as Deamonset with one config for every physical node, and on some of them the file does not exist - which is an expected behaviour.

On an older version 0.70.0, only one finding files: no files match the configured criteria {"kind": "receiver", "name": "filelog/localhostlog" message was produced, while on the latest version it is logged on every poll():

2023-09-24T23:21:00.934Z	info	fileconsumer/file.go:118	finding files: no files match the configured criteria	{"kind": "receiver", "name": "filelog/localhostlog", "data_type": "logs", "component": "fileconsumer"}
2023-09-24T23:21:02.134Z	info	fileconsumer/file.go:118	finding files: no files match the configured criteria	{"kind": "receiver", "name": "filelog/localhostlog", "data_type": "logs", "component": "fileconsumer"}
2023-09-24T23:21:03.334Z	info	fileconsumer/file.go:118	finding files: no files match the configured criteria	{"kind": "receiver", "name": "filelog/localhostlog", "data_type": "logs", "component": "fileconsumer"}
2023-09-24T23:21:04.334Z	info	fileconsumer/file.go:118	finding files: no files match the configured criteria	{"kind": "receiver", "name": "filelog/localhostlog", "data_type": "logs", "component": "fileconsumer"}

And it's flooding agent's log.

Describe the solution you'd like

I know that this can be treated as an expected behaviour, but this is not an error message, just an info - so I am not sure if logging it out as frequently is absolutely required. I was thinking about adding a log limiter just for this finding files log.

Describe alternatives you've considered

A workaround for this is setting logging level to warn, but this also removes any other info message user considered important.

Additional context

No response

[github-actions]

Pinging code owners:

• receiver/filelog: @djaglowski

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[dlorent]

Was just about to submit this issue.

It's quite annoying with the excessive logging.

In my case, i'm using it to log some specific otel-collectors which is not necessarily running on each host. producing constant warnings with.

opentelemetry-collector-agent-kw5jv opentelemetry-collector 2023-09-25T10:10:08.552Z	warn	fileconsumer/file.go:118	finding files: no files match the configured criteria	{"kind": "receiver", "name": "filelog", "data_type": "logs", "component": "fileconsumer"}