Developer-machine friendly setup script

[michbarsinai]

Part of the automated integration test suite, we need a script that a developer can run locally to setup a dataverse instance.

Assumptions:

• PSQL, GlassFish installed
• Dataverse installed on GF (e.g. by NetBeans)
• PSQL's table structure correct (e.g. by JPA).

Script will:

• Install reference data (needed for SWORD)
• Update Jhove
• Update Solr's schema
• Create initial database data (root dv, blocks, NA value, etc.)
• Anything else?

Script will not:

• Require root access
• Take too long

Post-installation, we should have an installation that's ready to support the full dataverse functionality, with the exception of functionality supported by Apache fronts (e.g. Shibboleth login). This can later serve as the starting point for automated integration testing.

[michbarsinai]

Assigning @scolapasta to route this. Also, @pdurbin, please add references to your scripts that do parts of this already.

[pdurbin]

https://github.com/IQSS/dataverse/tree/4.2/scripts/database/homebrew is where I've been putting scripts that I use on my laptop (where I use homebrew to install PostgreSQL and other software). Some highlights:

• small shell script that doesn't require root as an alternative to the installer: https://github.com/IQSS/dataverse/blob/4.2/scripts/database/homebrew/devinstall
• drop database and solr content and create fresh database: https://github.com/IQSS/dataverse/blob/4.2/scripts/database/homebrew/delete-all
• runs SQL reference data script before running "setup all": https://github.com/IQSS/dataverse/blob/4.2/scripts/database/homebrew/run-post-create-post-deploy
• runs the script above and tests: https://github.com/IQSS/dataverse/blob/4.2/scripts/database/homebrew/rebuild-and-test

[bmckinney]

first pass available here: https://github.com/bmckinney/dataverse-osx-playbook

tested on mavericks and yosemite so far

[pdurbin]

In pull request #3017 it says the installer no longer has to be run as root.

@bmckinney I'm hoping to try out your playbook real soon now on a new laptop. Thanks!

[pdurbin]

Over at #3163 we're considering adding a "dev mode" to the standard installer.

[pdurbin]

I mentioned this issue in a talk I gave last week: 2016-06-01 Setting Up Your Dataverse Development Environment - http://bl.ocks.org/pdurbin/raw/7847a0642f8bd6601a07c3619b4a35f6

[pdurbin]

@michbarsinai it's been a while since you opened this issue. What are your thoughts on it these days?

[michbarsinai]

I still think that as a developer, I won't run a setup script that requires root access on my machine. If our script still requires that, this issue should be kept open.

As part os setting up a development environment for ROS, I once managed to link my MacOS python against a different version of Python the was brought in from homebrew. This killed all the python-using programs on my laptop, including ones that were running it under the covers. We're talking about 2 workdays lost just getting the system back together without a full re-install. So for me, at least, this is a very real issue.

[pdurbin]

@michbarsinai http://guides.dataverse.org/en/4.7/installation/installation-main.html#running-the-dataverse-installer says, "NEW in Dataverse 4.3: It is no longer necessary to run the installer as root! Just make sure the user that runs the installer has the write permission in the Glassfish directory." Have you tried it? I haven't. I use https://github.com/pdurbin/dataverse-osx-playbook and scripts at https://github.com/IQSS/dataverse/tree/develop/scripts/database/homebrew .

[michbarsinai]

I haven't, but that seems to be the QA tests that needs doing to close this issue. Maybe someone on the mailing list could verify that is works.

[pdurbin]

I could imagine running vagrant up to spin up a Linux desktop machine that installs Netbeans, clones the repo, and runs the installation script as non-root. In fact, I have a proof of concept from the DVN 3 days at https://github.com/dvn/dvn-netbeans if anyone wants to run with that ball.

[djbrooke]

Hey @michbarsinai - is this something that you have interest in reviewing (and the bandwidth to do so :))?

[pdurbin]

@michbarsinai are you still interested in improvements in this area? Please see the comment I just left at #3905 (comment) . I'm moving this out of Code Review because my improvements are currently tied up with Glassfish upgrades and there's a bug or two.

[michbarsinai]

I'm interested, but currently have very little bandwidth for this. So wouldn't have been able to test it anyway at this point.

…

On 1 Nov 2017, at 18:25, Philip Durbin ***@***.***> wrote: @michbarsinai <https://github.com/michbarsinai> are you still interested in improvements in this area? Please see the comment I just left at #3905 (comment) <#3905 (comment)> . I'm moving this out of Code Review because my improvements are currently tied up with Glassfish upgrades and there's a bug or two. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#2443 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AB2UJBSwUJEFFCSY5yGl322rTjEbegtmks5syJuRgaJpZM4Fo_29>.

[pdurbin]

@michbarsinai no worries.

As discussed during standup this morning, I think I'm the only one who cares about this issue and #3905 at the moment so I'm throwing this issue into the "Inbox" at https://waffle.io/IQSS/dataverse to hang out with hundreds of friends. 😄

I pushed what I have so far:

https://github.com/IQSS/dataverse/compare/2443-3905-dev-setup

Here too in case someone deletes that branch:

https://github.com/pdurbin/dataverse/tree/2443-3905-dev-setup

[pdurbin]

@michbarsinai and I just discussed this issue and he's fine with closing it now that the installer doesn't require root.