Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use a log collector service to capturing logs from tests #245

Open
denis-tingaikin opened this issue Mar 26, 2021 · 2 comments
Open

Use a log collector service to capturing logs from tests #245

denis-tingaikin opened this issue Mar 26, 2021 · 2 comments
Labels
enhancement New feature or request

Comments

@denis-tingaikin
Copy link
Member

denis-tingaikin commented Mar 26, 2021

Motivation

Currently, we are going to use #244 for capturing logs from containers in k8s.

This solution is not perfect because potentially this increases CI time and it is not resistant to changing tests.

Solution

Use some kind of logs collecting service as https://www.fluentd.org/architecture

@denis-tingaikin denis-tingaikin added the bug Something isn't working label Mar 26, 2021
@denis-tingaikin denis-tingaikin added enhancement New feature or request and removed bug Something isn't working labels Mar 26, 2021
@denis-tingaikin denis-tingaikin changed the title Use log collector service as a cluster logs monitor to capturing logs from tests Use a log collector service to capturing logs from tests Mar 26, 2021
@Bolodya1997
Copy link

We have multiple issues regarding to the current logs capturing strategy:

  1. We are not capturing logs for the test cleanup - if Client fails to Close the Connection for some reason, it affects subsequent tests, but there is nothing in logs for the initial failure.
  2. We are not capturing logs for the previous-previous containers - if container restarts more than 1 time during the test, we will have logs only for the current and for the previous container run.
  3. We are not capturing logs for the pods removed during the test - it affects all heal tests because we cannot get logs from the removed pod.

It doesn't look like fixing this from our side will be both working and good-looking, so +1 for using third-party tool for capturing logs.

@tiswanso
Copy link

We often use kubectl's cluster-info dump for this same purpose in CI. https://kubernetes.io/docs/reference/generated/kubectl/kubectl-commands#cluster-info

NOTE: prior to 1.19 its support of the namespace arg doesn't actually work correctly from what I've seen.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants