Skip to content
/ ROCED Public
forked from fbuehrer/ROCED

ROCED cloud scheduler for virtualized ATLAS-UNI_FREIBURG Tier 2/3 environment on NEMO bwHPC

Notifications You must be signed in to change notification settings

uschnoor/ROCED

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ROCED

Responsive On-Demand Cloud-enabled Deployment is a tool which can interface with different batch systems (Torque, HTCondor) and cloud sites (Eucalyptus, OpenNebula, OpenStack, Amazon EC2, etc.). It monitors demand of computing resources in the batch system(s) and dynamically manages Virtual Machines (starting and terminating them) on different cloud sites.

Design

ROCED periodically runs a management cycle, where it performs three steps:

  • Monitor batch system's queue and determine demand for machines
  • Boot machines
  • Integrate booted machines into batch system

Visualisation of management cycle

ROCED consists of five components; everything except the core has a modular structure, in order to offer a maximum of flexibility.
Users can freely combine different adapters to fulfill their requirement or even write their own.

ROCED needs at least one of each component to be in any way useful and we advice to use Requirement Adapter and Integration Adapter for the same batch system.

  • Core
  • Requirement Adapters
    Monitor batch system(s) to determine the demand for machines.
  • Site Adapters
    Request machines at cloud site(s)
  • Integration Adapters
    (Dis-)Integrate running machines from/into batch system(s)
  • Broker
    Balance demand across different cloud sites, depending on different metrics (e.g.: cost)

Visualisation of modular components

Requirements/Installation

  • Python 2.7 or 3.3+
    • Python 2 requires the future and the configparser package
    • Various adapters have system/site dependant packages.
      We follow the PEP 8 guideline when listing module imports, so you you can easily identify the needed modules for each adapter.
  • Correctly set up batch system
  • VM image(s) which can integrate into batch system(s) as worker node(s).

Contributors

ROCED was developed at the Institut für Experimentelle Kernphysik at the Karlsruhe Institute of Technology.
Further information can be found in the doc folder.

License

ROCED is free software: you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.

ROCED is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

You should have received a copy of the GNU General Public License
along with ROCED.  If not, see <http://www.gnu.org/licenses/>.

About

ROCED cloud scheduler for virtualized ATLAS-UNI_FREIBURG Tier 2/3 environment on NEMO bwHPC

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 71.2%
  • TeX 28.3%
  • Shell 0.5%