Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add persistent queues #675

Conversation

omrozowicz-splunk
Copy link
Contributor

Things included in this PR:

  1. enable persistent queues configuration in the helm chart
  2. post delete hook which deletes ACLs set for directories used by agent, gateway and clusterReceiver while those pods run as non-root users

Continuation of this PR: #668

…nt queue, nest persistentQueueEnabled in sendingQueue, add rendered examples
@dmitryax
Copy link
Contributor

dmitryax commented Mar 1, 2023

@omrozowicz-splunk can you please split the PR separately for each problem?

@@ -0,0 +1,6 @@
# Example of chart configuration
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: Can we rename this example to enabled-persistent-queue, I'm trying to keep our examples more organized?

# NOTE: The File Storage extension will persist state to the node's local file system.
# While using the persistent queue it is advised to increase memory limit for agent (agent.resources.limits.memory)
# to 1Gi.
persistentQueueEnabled:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We have sendingQueue.enabled right above this. Would matching the format above make sense here? I'm thinking something like this.

persistentQueue:
      enabled: false
      logs: true
      metrics: true
      storagePath: "/var/addon/splunk/persist"

# NOTE: The File Storage extension will persist state to the node's local file system.
# While using the persistent queue it is advised to increase memory limit for agent (agent.resources.limits.memory)
# to 1Gi.
persistentQueueEnabled:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to mention this feature is still alpha.

{{- end }}
{{- if (eq (include "splunk-otel-collector.persistentQueueEnabled" .) "true") }}
- name: patch-log-dirs
image: {{ template "splunk-otel-collector.image.initPatchLogDirs" . }}
Copy link
Contributor

@jvoravong jvoravong Mar 15, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • Where is this splunk-otel-collector.image.initPatchLogDir ?
  • Do we need to use an init container for this? Does something prevent us from using the otel-collector container?

…file_storage extension only when metrics persistency is enabled
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants