Skip to content

Conversation

@wchargin
Copy link
Contributor

Summary:
Due to tensorflow/tensorflow#34427.

This unblocks our CI until the upstream problem is identified and fixed.

Test Plan:
Fingers crossed.

wchargin-branch: pin-20191118-nightly

Summary:
Due to <tensorflow/tensorflow#34427>.

This unblocks our CI until the upstream problem is identified and fixed.

Test Plan:
Fingers crossed.

wchargin-branch: pin-20191118-nightly
Copy link
Contributor

@stephanwlee stephanwlee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Read your issue on TensorFlow. Thanks for the thorough investigation!

@wchargin
Copy link
Contributor Author

Well, okay, now I’m stumped. I installed the exact same pip freeze env
(with tf-nightly==2.1.0.dev20191118) into a new virtualenv on a new
Ubuntu 14.04 machine, and cannot reproduce the problem there. But Travis
is still broken. I’m going to clear the caches on Travis and re-trigger
the two problematic builds. If that doesn’t work, I’ll try pinning to
2.1.0.dev20191024 instead, as in #2834.

@wchargin
Copy link
Contributor Author

Cleared cache for #2947. There doesn’t seem to be a cache for master
for some reason. Re-running now.

wchargin-branch: pin-20191118-nightly
wchargin-source: d73a4d8cbbfacf1bf45950bab9ae73a4280dd284
@wchargin
Copy link
Contributor Author

Did not suffice. I will clear all repository-wide caches then try
2019-11-18 nightlies again. (Rolling back forward because some debugger
tests are failing in ways that may or may not be related to recent
TensorFlow changes, and I want to rule out that possibility.)

@wchargin
Copy link
Contributor Author

Okay, after deleting the caches for the release branches Travis deigned
to show me that there was indeed a cache for master, so I have now
actually deleted that. Retrying presently.

wchargin-branch: pin-20191118-nightly
wchargin-source: 939b971
@wchargin
Copy link
Contributor Author

Still SIGABRTing in smoke test…

*** Error in `python': free(): invalid pointer: 0x000000000255f3c0 ***
Aborted (core dumped)

wchargin-branch: pin-20191118-nightly
wchargin-source: 939b971
@wchargin
Copy link
Contributor Author

Closing and reopening per Travis support suggestion…

@wchargin wchargin closed this Nov 21, 2019
@wchargin wchargin reopened this Nov 21, 2019
@wchargin
Copy link
Contributor Author

Closing and reopening again per Travis support suggestion (they’ve made
changes on the backend)…

@wchargin wchargin closed this Nov 21, 2019
@wchargin wchargin reopened this Nov 21, 2019
@wchargin wchargin merged commit 1b1991e into master Nov 21, 2019
@wchargin wchargin deleted the wchargin-pin-20191118-nightly branch December 2, 2019 23:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants