Tests fail when run through Pkg

[staticfloat]

Hey there, I'm trying to update the BinaryProvider tests to work on 0.7. I've noticed that there seems to be a difference between running runtests.jl and running ] test BinaryProvider. Looking at the sf/new_pkg branch, running julia runtests.jl passes, but running ] test BinaryProvider, it fails due to some problem with the code loading machinery:

ERROR: LoadError: ArgumentError: Module LibFoo not found in current path.
Run `Pkg.add("LibFoo")` to install the LibFoo package.
Stacktrace:
 [1] require(::Module, ::Symbol) at ./loading.jl:867
 [2] include at ./boot.jl:314 [inlined]
 [3] include_relative(::Module, ::String) at ./loading.jl:1070
 [4] include(::Module, ::String) at ./sysimg.jl:29
 [5] exec_options(::Base.JLOptions) at ./client.jl:264
 [6] _start() at ./client.jl:424
in expression starting at /home/sabae/.julia/dev/BinaryProvider/test/LibFoo.jl/test/runtests.jl:2
LibFoo.jl: Error During Test at /home/sabae/.julia/dev/BinaryProvider/test/runtests.jl:727
  Got exception ErrorException("failed process: Process(`/home/sabae/local/dist/julia-master/bin/julia -Cnative -J/home/sabae/local/dist/julia-master/lib/julia/sys.so --compile=yes --depwarn=yes --color=yes test/runtests.jl`, ProcessExited(1)) [1]") outside of a @test
  failed process: Process(`/home/sabae/local/dist/julia-master/bin/julia -Cnative -J/home/sabae/local/dist/julia-master/lib/julia/sys.so --compile=yes --depwarn=yes --color=yes test/runtests.jl`, ProcessExited(1)) [1]
  Stacktrace:
   [1] error(::String, ::Base.Process, ::String, ::Int64, ::String) at ./error.jl:42
   [2] pipeline_error at ./process.jl:712 [inlined]
   [3] #run#511(::Bool, ::Function, ::Cmd) at ./process.jl:670
   [4] run at ./process.jl:668 [inlined]
   [5] (::getfield(Main, Symbol("##71#77")))() at /home/sabae/.julia/dev/BinaryProvider/test/runtests.jl:781
   [6] cd(::getfield(Main, Symbol("##71#77")), ::String) at ./file.jl:72
   [7] macro expansion at /home/sabae/.julia/dev/BinaryProvider/test/runtests.jl:770 [inlined]
   [8] macro expansion at /src/julia-master/usr/share/julia/stdlib/v0.7/Test/src/Test.jl:1079 [inlined]
   [9] top-level scope at /home/sabae/.julia/dev/BinaryProvider/test/runtests.jl:728
   [10] include at ./boot.jl:314 [inlined]
   [11] include_relative(::Module, ::String) at ./loading.jl:1070
   [12] include(::Module, ::String) at ./sysimg.jl:29
   [13] include(::String) at ./client.jl:390
   [14] top-level scope
   [15] eval(::Module, ::Any) at ./boot.jl:316
   [16] exec_options(::Base.JLOptions) at ./client.jl:241
   [17] _start() at ./client.jl:424
Test Summary: | Pass  Error  Total
LibFoo.jl     |    4      1      5
ERROR: LoadError: Some tests did not pass: 4 passed, 0 failed, 1 errored, 0 broken.
in expression starting at /home/sabae/.julia/dev/BinaryProvider/test/runtests.jl:727
ERROR: Package BinaryProvider errored during testing