Posting to multiple servers

[theckld]

Can you please add the ability to post to more multiple servers?

[animetosho]

The functionality is there - you'll need to configure it via the config file as it's not exposed in the command-line argument interface.

If you specify multiple servers, it just randomly distributes posts across all the connections.

[theckld]

How can I specify multiple servers in the config file? I have tried adding multiple server options sections but it does not seem to work, it will only picks the last one defined.
And what about header checking? its options will be related to which server if more than one are defined?

[animetosho]

It won't work with the simple JSON based config file (which essentially uses the same interface as the command line). You'll need to use the full Javascript based config file (which means you can no longer use the JSON config file).
You can use the default config.js as a sample.

Example config file with two servers (you'll obviously need to change the details):

module.exports = {
servers: [
	// server 1 (full config displayed)
	{
		// connection options - see the following pages for full documentation
		// non-SSL: https://nodejs.org/api/net.html#net_socket_connect_options_connectlistener
		// SSL: https://nodejs.org/api/tls.html#tls_tls_connect_options_callback
		connect: { // connection options
			host: 'localhost',
			port: null, // null => if server.secure, port=563, else, port=119
			
			// SSL options
			rejectUnauthorized: true,
			
			highWaterMark: 0, // disable node's internal bufferring to improve our timings (we always send full chunks, so bufferring by node isn't needed)
		},
		secure: false, // set to true to use SSL
		user: '',
		password: '',
		// note that these times are specified in miliseconds
		timeout: 30000, // 30000ms = 30 seconds
		connTimeout: 30000, // 30 seconds
		postTimeout: 150000, // 2.5 minutes
		reconnectDelay: 15000, // 15 seconds
		connectRetries: 1,
		requestRetries: 5, // how many times to retry an interrupted request
		retryBadResp: false, // enable retrying if a bad response is received
		postRetries: 1, // how many times to retry if server returns 441 response to posted article
		postRetryDelay: 0, // delay post retries (above option) by this many milliseconds
		postFailReconnect: false, // treat post failure like a connection-level error; postRetries and postRetryDelay settings are ignored if true
		errorTeardown: false, // false = gracefully close bad connections, true = forcefully destroy them
		closeTimeout: 10000, // 10 seconds; wait period before forcefully dropping gracefully closed connections
		keepAlive: false, // always reconnect on error, even if not needed
		onPostTimeout: null, // list of actions (strings) to take if server sends no response to a post; values can be 'retry', 'strip-hdr=X' and 'ignore'; if not set (null), defaults to ['retry','retry','retry'...] where the number of elements == requestRetries
		tcpKeepAlive: false, // false to disable, otherwise set a number for probe interval (in ms)
		uploadChunkSize: 192*1024, // break up post into chunks of this size when uploading; 0 to disable chunking
		postMethod: 'POST', // command to use when posting; can be POST, IHAVE, XREPLIC or TAKETHIS
		
		postConnections: 3, // number of connections for posting
		checkConnections: 0, // number of connections used for checking

	},
	
	// server 2
	{
		// connection options - see the following pages for full documentation
		// non-SSL: https://nodejs.org/api/net.html#net_socket_connect_options_connectlistener
		// SSL: https://nodejs.org/api/tls.html#tls_tls_connect_options_callback
		connect: { // connection options
			host: 'localhost',
			port: null, // null => if server.secure, port=563, else, port=119
			
			// SSL options
			rejectUnauthorized: true,
			
			highWaterMark: 0, // disable node's internal bufferring to improve our timings (we always send full chunks, so bufferring by node isn't needed)
		},
		secure: false, // set to true to use SSL
		user: '',
		password: '',
		// note that these times are specified in miliseconds
		timeout: 30000, // 30000ms = 30 seconds
		connTimeout: 30000, // 30 seconds
		postTimeout: 150000, // 2.5 minutes
		reconnectDelay: 15000, // 15 seconds
		connectRetries: 1,
		requestRetries: 5, // how many times to retry an interrupted request
		retryBadResp: false, // enable retrying if a bad response is received
		postRetries: 1, // how many times to retry if server returns 441 response to posted article
		postRetryDelay: 0, // delay post retries (above option) by this many milliseconds
		postFailReconnect: false, // treat post failure like a connection-level error; postRetries and postRetryDelay settings are ignored if true
		errorTeardown: false, // false = gracefully close bad connections, true = forcefully destroy them
		closeTimeout: 10000, // 10 seconds; wait period before forcefully dropping gracefully closed connections
		keepAlive: false, // always reconnect on error, even if not needed
		onPostTimeout: null, // list of actions (strings) to take if server sends no response to a post; values can be 'retry', 'strip-hdr=X' and 'ignore'; if not set (null), defaults to ['retry','retry','retry'...] where the number of elements == requestRetries
		tcpKeepAlive: false, // false to disable, otherwise set a number for probe interval (in ms)
		uploadChunkSize: 192*1024, // break up post into chunks of this size when uploading; 0 to disable chunking
		postMethod: 'POST', // command to use when posting; can be POST, IHAVE, XREPLIC or TAKETHIS
		
		postConnections: 3, // number of connections for posting
		checkConnections: 0, // number of connections used for checking

	},
	
],
isFullConfig: true
};

Unfortunately, it's a bit complicated at the moment, as there's no simple interface to get it to work. I might try to come up with something to simplify configuring multiple servers eventually.

[theckld]

Nice! I managed to get it working now. Thanks.
It would also be great if you can add some failover mechanism in case one article failed to post at one server to retry posting it with another server.