Runs Morph scrapers from the commandline.
Actually it will run them on the Morph server identically to the real thing. That means not installing a bucket load of libraries and bits and bobs that are already installed with the Morph scraper environments.
To run a scraper in your local directory
morph
Yup, that's it.
It runs the code that's there right now. It doesn't need to be checked into git or anything.
For help
morph help
You'll need Ruby >= 1.9 and then
gem install morph-cli
It uploads your code everytime. So if it's big it might take a little while. Scrapers are not usually so I'm hoping this won't really be an issue
It doesn't yet return you the resulting sqlite database (or use the one you might have locally)
- Fork it
- Create your feature branch (
git checkout -b my-new-feature) - Commit your changes (
git commit -am 'Add some feature') - Push to the branch (
git push origin my-new-feature) - Create new Pull Request