Skip to content
This repository has been archived by the owner on Dec 14, 2020. It is now read-only.

Check robustness of Pkg.build when sources already present #4

Open
IainNZ opened this issue Jul 4, 2015 · 13 comments
Open

Check robustness of Pkg.build when sources already present #4

IainNZ opened this issue Jul 4, 2015 · 13 comments

Comments

@IainNZ
Copy link
Member

IainNZ commented Jul 4, 2015

PackageEvaluator.jl is a script that runs nightly. It attempts to load all Julia packages and run their tests (if available) on both the stable version of Julia (0.3) and the nightly build of the unstable version (0.4). The results of this script are used to generate a package listing enhanced with testing results.

On Julia 0.3

  • On 2015-07-02 the testing status was Tests pass.
  • On 2015-07-04 the testing status changed to Tests fail.

This issue was filed because your testing status became worse. No additional issues will be filed if your package remains in this state, and no issue will be filed if it improves. If you'd like to opt-out of these status-change messages, reply to this message saying you'd like to and @IainNZ will add an exception. If you'd like to discuss PackageEvaluator.jl please file an issue at the repository. For example, your package may be untestable on the test machine due to a dependency - an exception can be added.

Test log:

>>> 'Pkg.add("CoinOptServices")' log
INFO: Installing BinDeps v0.3.12
INFO: Installing Cbc v0.1.6
INFO: Installing Clp v0.0.9
INFO: Installing CoinOptServices v0.0.5
INFO: Installing Ipopt v0.1.15
INFO: Installing LightXML v0.1.11
INFO: Installing MathProgBase v0.3.12
INFO: Installing SHA v0.0.4
INFO: Installing URIParser v0.0.5
INFO: Building Cbc
INFO: Building Ipopt
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps/downloads
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps/downloads already created
INFO: Downloading file http://www.coin-or.org/download/source/Ipopt/Ipopt-3.12.1.tgz
INFO: Done downloading file http://www.coin-or.org/download/source/Ipopt/Ipopt-3.12.1.tgz
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps/src
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps/src already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1 already created
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas
INFO: Attempting to Create directory build
INFO: Directory build already created
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas/build
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas/build
make: *** No rule to make target `install'.  Stop.
================================[ ERROR: Ipopt ]================================

failed process: Process(`make install`, ProcessExited(2)) [2]
while loading /home/vagrant/.julia/v0.3/Ipopt/deps/build.jl, in expression starting on line 72

================================================================================
INFO: Building LightXML
INFO: Building CoinOptServices
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/downloads
INFO: Directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/downloads already created
INFO: Downloading file http://www.coin-or.org/download/source/OS/OS-2.9.2.tgz
INFO: Done downloading file http://www.coin-or.org/download/source/OS/OS-2.9.2.tgz
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/src
INFO: Directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/src already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/CoinOptServices/deps
INFO: Directory /home/vagrant/.julia/v0.3/CoinOptServices/deps already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/src/OS-2.9.2
INFO: Directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/src/OS-2.9.2 already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/src/OS-2.9.2/build
INFO: Directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/src/OS-2.9.2/build already created
INFO: Changing Directory to /home/vagrant/.julia/v0.3/CoinOptServices/deps/src/OS-2.9.2/build
patching file OS/src/OSUtils/OSParameters.h
Reversed (or previously applied) patch detected!  Assume -R? [n] 
Apply anyway? [n] 
Skipping patch.
1 out of 1 hunk ignored -- saving rejects to file OS/src/OSUtils/OSParameters.h.rej
===========================[ ERROR: CoinOptServices ]===========================

failed process: Process(`patch -p1 -d ..`, ProcessExited(1)) [1]
while loading /home/vagrant/.julia/v0.3/CoinOptServices/deps/build.jl, in expression starting on line 71

================================================================================

================================[ BUILD ERRORS ]================================

WARNING: CoinOptServices and Ipopt had build errors.

 - packages with build errors remain installed in /home/vagrant/.julia/v0.3
 - build the package(s) and all dependencies with `Pkg.build("CoinOptServices", "Ipopt")`
 - build a single package by running its `deps/build.jl` script

================================================================================
INFO: Package database updated
INFO: METADATA is out-of-date — you may not have the latest version of CoinOptServices
INFO: Use `Pkg.update()` to get the latest versions of your packages

>>> 'Pkg.test("CoinOptServices")' log
Julia Version 0.3.10
Commit c8ceeef* (2015-06-24 13:54 UTC)
Platform Info:
  System: Linux (x86_64-unknown-linux-gnu)
  CPU: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz
  WORD_SIZE: 64
  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Nehalem)
  LAPACK: libopenblas
  LIBM: libopenlibm
  LLVM: libLLVM-3.3
INFO: Computing test dependencies for CoinOptServices...
INFO: Installing ArrayViews v0.6.2
INFO: Installing Calculus v0.1.8
INFO: Installing DataStructures v0.3.10
INFO: Installing Docile v0.5.10
INFO: Installing DualNumbers v0.1.3
INFO: Installing FactCheck v0.2.8
INFO: Installing JuMP v0.9.2
INFO: Installing NaNMath v0.0.2
INFO: Installing ReverseDiffSparse v0.2.9
INFO: Testing CoinOptServices
ERROR: CoinOptServices not properly installed. Please run
Pkg.build("CoinOptServices")
 in error at error.jl:22
 in include at ./boot.jl:245
 in include_from_node1 at ./loading.jl:128
 in reload_path at loading.jl:152
 in _require at loading.jl:67
 in require at loading.jl:51
 in include at ./boot.jl:245
 in include_from_node1 at loading.jl:128
 in process_options at ./client.jl:285
 in _start at ./client.jl:354
while loading /home/vagrant/.julia/v0.3/CoinOptServices/src/CoinOptServices.jl, in expression starting on line 20
while loading /home/vagrant/.julia/v0.3/CoinOptServices/test/runtests.jl, in expression starting on line 1

===========================[ ERROR: CoinOptServices ]===========================

failed process: Process(`/home/vagrant/julia/bin/julia /home/vagrant/.julia/v0.3/CoinOptServices/test/runtests.jl`, ProcessExited(1)) [1]

================================================================================
INFO: Removing ArrayViews v0.6.2
INFO: Removing Calculus v0.1.8
INFO: Removing DataStructures v0.3.10
INFO: Removing Docile v0.5.10
INFO: Removing DualNumbers v0.1.3
INFO: Removing FactCheck v0.2.8
INFO: Removing JuMP v0.9.2
INFO: Removing NaNMath v0.0.2
INFO: Removing ReverseDiffSparse v0.2.9
ERROR: CoinOptServices had test errors
 in error at error.jl:21
 in test at pkg/entry.jl:718
 in anonymous at pkg/dir.jl:28
 in cd at ./file.jl:20
 in cd at pkg/dir.jl:28
 in test at pkg.jl:67
 in process_options at ./client.jl:213
 in _start at ./client.jl:354


>>> End of log
@tkelman
Copy link
Contributor

tkelman commented Jul 4, 2015

Part of the message looks the same as jump-dev/Ipopt.jl#41, as if configure didn't run under Ipopt's ThirdParty/Blas/build. Can we figure out which package was first responsible for installing Ipopt and/or CoinOptServices and find its full log? There's some persistence problem with a patch file.

@IainNZ
Copy link
Member Author

IainNZ commented Jul 4, 2015

AmplNLWriter I think: http://pkg.julialang.org/?pkg=AmplNLWriter&ver=release

@IainNZ
Copy link
Member Author

IainNZ commented Jul 4, 2015

(alphabetical)

@tkelman
Copy link
Contributor

tkelman commented Jul 4, 2015

Is the VM supposed to be clean before starting?

@IainNZ
Copy link
Member Author

IainNZ commented Jul 4, 2015

Yep, its clean

@IainNZ
Copy link
Member Author

IainNZ commented Jul 4, 2015

With the exception, of course, anything set up by the provisioning script

@tkelman
Copy link
Contributor

tkelman commented Jul 4, 2015

If that's the case, then what's up with this?

INFO: Computing test dependencies for AmplNLWriter...
INFO: Installing BinDeps v0.3.12
INFO: Installing Cbc v0.1.6
INFO: Installing Clp v0.0.9
INFO: Installing CoinOptServices v0.0.5
INFO: Installing FactCheck v0.2.8
INFO: Installing Ipopt v0.1.15
INFO: Installing LightXML v0.1.11
INFO: Installing SHA v0.0.4
INFO: Installing URIParser v0.0.5
INFO: Building Cbc
INFO: Building Ipopt
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps/downloads
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps/downloads already created
INFO: Downloading file http://www.coin-or.org/download/source/Ipopt/Ipopt-3.12.1.tgz
INFO: Done downloading file http://www.coin-or.org/download/source/Ipopt/Ipopt-3.12.1.tgz
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps/src
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps/src already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1 already created
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas
INFO: Attempting to Create directory build
INFO: Directory build already created
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas/build
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas/build
make: *** No rule to make target `install'.  Stop.
================================[ ERROR: Ipopt ]================================

Also note that AbstractDomains starts by uninstalling Cbc and Ipopt and a few other things. Wha?

@tkelman
Copy link
Contributor

tkelman commented Jul 4, 2015

On nightly AmplNLWriter is getting terminated, probably due to a timeout.

Maybe things aren't getting cleaned like they should be?

@IainNZ
Copy link
Member Author

IainNZ commented Jul 4, 2015

Huh. I have a hunch, I did terminate the VMs the night before last in a weird way (i.e. killall). I'm wondering if somehow Vagrant started from there, running the provisioning script but not on a fresh virtual HDD. I'll go in there and really clear it out.

@IainNZ
Copy link
Member Author

IainNZ commented Jul 4, 2015

OK everything is clean now. Could leave this open until tomorrow, or just close it - up to you.

@tkelman tkelman changed the title [PkgEval] CoinOptServices may have a testing issue on Julia 0.3 (2015-07-04) Check robustness of Pkg.build when sources already present Jul 4, 2015
@tkelman
Copy link
Contributor

tkelman commented Jul 4, 2015

If I could login to julia.mit.edu right now, I would double-check whether re-running Pkg.build when partial sources are already present can be made any more robust. I'll leave this open as a to-do, but I'm not sure whether I can do much here.

@IainNZ
Copy link
Member Author

IainNZ commented Jul 5, 2015

Seems fine today

@tkelman
Copy link
Contributor

tkelman commented Jul 5, 2015

AmplNLWriter is still failing due to a timeout though

@tkelman tkelman mentioned this issue Nov 2, 2016
Open
@lasaralanda lasaralanda mentioned this issue Nov 8, 2018
Open
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@IainNZ @tkelman