Skip to content
/ spa Public
forked from big-data-lab-team/spa

Spark Pilot-job scheduler for HPC Applications

License

Notifications You must be signed in to change notification settings

ValHayot/spa

 
 

Repository files navigation

spa - pilot scheduler for spark applications on hpc

sample usage:

pilotspark.py example/standalone/hpc/hpc_pilot_template.sh experiments/code/conditions/hpc_scala_8n1d_pilot.json

Paper

paper.tex is the LaTeX source of a report describing experiments done with SPA. Figures contained in the paper can be generated with load_figures.sh (requires Python's matplotlib).

A pdf is uploaded for every release of the paper:

About

Spark Pilot-job scheduler for HPC Applications

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 78.7%
  • TeX 16.0%
  • Python 4.0%
  • Other 1.3%