Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extended.deploymentconfigs with failing hook [Conformance] should get all logs from retried hooks #11630

Closed
danmcp opened this issue Oct 27, 2016 · 7 comments · Fixed by #11633
Assignees
Labels
component/apps kind/test-flake Categorizes issue or PR as related to test flakes. priority/P0

Comments

@danmcp
Copy link

danmcp commented Oct 27, 2016

https://ci.openshift.redhat.com/jenkins/job/test_pull_requests_origin_conformance/7944/

https://ci.openshift.redhat.com/jenkins/job/test_pull_requests_origin_conformance/7944/testReport/junit/(root)/Extended/deploymentconfigs_with_failing_hook__Conformance__should_get_all_logs_from_retried_hooks/

Stacktrace

/data/src/github.com/openshift/origin/test/extended/deployments/deployments.go:589
Expected
    <string>: --> pre: Running hook pod ...
    --> pre: Retrying hook pod (retry #1)
to contain substring
    <string>: no such file or directory
/data/src/github.com/openshift/origin/test/extended/deployments/deployments.go:587
@danmcp danmcp added priority/P0 component/apps kind/test-flake Categorizes issue or PR as related to test flakes. labels Oct 27, 2016
@danmcp
Copy link
Author

danmcp commented Oct 27, 2016

Note: This was with docker 1.12

Might be related to: https://bugzilla.redhat.com/show_bug.cgi?id=1389474

@ncdc
Copy link
Contributor

ncdc commented Oct 27, 2016

I don't think this is related to the bug. There is a change in what's logged between docker 1.10 and 1.12.

1.10

vagrant@f24:~ docker run --name blarg centos:centos7 blarg
exec: "blarg": executable file not found in $PATH
docker: Error response from daemon: Container command not found or does not exist..
vagrant@f24:~ docker logs blarg
exec: "blarg": executable file not found in $PATH
vagrant@f24:~

1.12

vagrant@localhost:~ docker run --name blarg centos:centos7 blarg
/usr/bin/docker-current: Error response from daemon: oci runtime error: container_linux.go:247: starting container process caused "exec: \"blarg\": executable file not found in $PATH"%0A.
vagrant@localhost:~ docker logs blarg
vagrant@localhost:~ 

As you can see, 1.12 doesn't log the failure in the container's logs like 1.10 did.

@ironcladlou
Copy link
Contributor

The offender is this deployment test fixture. I'll submit a PR which makes the test case portable across docker versions.

@liggitt
Copy link
Contributor

liggitt commented Oct 27, 2016

should we be concerned that a previously working command no longer runs?

ironcladlou added a commit to ironcladlou/origin that referenced this issue Oct 27, 2016
Use a more stable and predictable command to exercise failing pre-hooks
with retries. The former command assumed specific Docker 1.10 behavior
whereby missing commands produced error messages in the container output
stream, an assumption which no longer holds true in Docker 1.12.

The fixture and test assertions should now be portable across Docker
versions.

Fixes openshift#11630
@ncdc
Copy link
Contributor

ncdc commented Oct 27, 2016

@liggitt it never ran before...

@0xmichalis
Copy link
Contributor

As you can see, 1.12 doesn't log the failure in the container's logs like 1.10 did.

Should we be concerned about this is the correct question

@ncdc
Copy link
Contributor

ncdc commented Oct 28, 2016

If you docker inspect, you see the info under .State.Error. I'm not overly concerned, but maybe @mrunalp can weigh in if he considers this a docker regression or not.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/apps kind/test-flake Categorizes issue or PR as related to test flakes. priority/P0
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants