Skip to content

Cluster Deployment Guide

darrnshn edited this page Oct 23, 2014 · 2 revisions

Stateline is designed for various cluster environments including Amazon EC2 and SGE clusters. These are general guidelines to follow for cluster deployment.

Concurrency

The Stateline server should have at least two virtual cores (one main thread and one heartbeat thread). Similarly, the workers should have at least two virtual cores (one main thread and one heartbeat thread).

Latency

It is important for the latency between the server and the workers to be low when deployed. High latency may significantly reduce the performance of the system. For example, in the case of EC2 Cluster, make sure the server and workers are deployed to the same region or the same placement group.

Suggested Setup

Deploy the server and reserve at least 2 virtual cores for it. Note it's IP address as it is needed for launching the workers. Deploy as least as many workers nodes as the total number of chains run by the server.

Clone this wiki locally