Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

otelcol.receiver timing out if downstream component offline #2424

Open
smaddock opened this issue Jan 15, 2025 · 0 comments
Open

otelcol.receiver timing out if downstream component offline #2424

smaddock opened this issue Jan 15, 2025 · 0 comments
Labels
bug Something isn't working

Comments

@smaddock
Copy link

smaddock commented Jan 15, 2025

What's wrong?

Currently, if an otelcol.exporter has errors, that causes the otelcol.receiver to time out. Receivers in Alloy should function regardless of whether the components they connect to are successful. The effect is then that our app fails because the in-app exporter expects a resilient receiver to be present. Instead, if an Alloy exporter has errors, those should be logged by Alloy, and not pass the instability up the chain.

Steps to reproduce

Build a simple otelcol pipeline in Alloy with a dud final endpoint and try to write to the receiver.

System information

Linux 5.10.0-33-amd64

Software version

alloy, version v1.5.1 (branch: HEAD, revision: dc8a365)

Configuration

otelcol.receiver.otlp "test" {
	http {}

	output {
		logs = [otelcol.exporter.loki.test.input]
	}
}

otelcol.exporter.loki "test" {
	forward_to = [loki.write.test.receiver]
}

loki.write "test" {
	endpoint {
		url = "https://nowhere/loki/api/v1/push"
	}
}

Logs

Jan 15 16:10:09 alloy[]: level=warn msg="error sending batch, will retry" component_path=/ component_id=loki.write.test component=client host=nowhere status=-1 tenant="" error="Post \"https://nowhere/loki/api/v1/push\": dial tcp: lookup nowhere on 1.1.1.1:53: no such host"
Jan 15 16:10:09 my-app[]: ERROR: Export failure: cURL error 28: Operation timed out after 10000 milliseconds with 0 bytes received for http://localhost:4318/v1/logs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant