WeeWX-MQTTSubscribe

A Weewx service and driver that receives data from multiple MQTT topics.

Currently MQTT payloads of json, keyword (field1=value, field2=value..), and individual (each topic contains a single observation) are supported.

Description

Driver

The driver captures the MQTT payload in a separate thread. Then in genLoopPackets, every element in the queue is turned into its own packet.

It is also possible to subscribe to a second topic. The MQTT payload from this topic is put into a separate queue. This queue is processed by the genArchiveRecords to create archive records (simulating hardware generation). With the combination of the two topics/queues, one can have a WeeWX instance gather the data and publish loop and archive data for other instances to receive.

When generating loop packets and the queue becomes empty, the option, wait_before_retry, controls how long before an attempt is made to get data from the queue.

Service

The service can bind to either new loop packets or new archive records. In both cases a separate thread captures the MQTT payload and puts it on a queue. On new packets/records events, the main thread takes the elements from the queue and accumulates them into a single dictionary of data fields. If necessary, the data is converted to the units of the packet/record. The packet/record is then updated with the data.

The elements that are processed from the queue can be controlled by various configuration options. By default, if the MQTT datetime is less than the previous packet's datetime it is ignored. This check can be ignored by setting ignore_start_time to True. It can be controlled more granularly by setting adjust_start_time to the number of seconds prior to the previous packet's datetime is allowed. Also by default, when the MQTT datetime is greater than the packet's datetime, the pocessing of the queue for this packet stops. This check can be ignored by setting ignore_end_time to True. It can be controlled more granularly by setting adjust_end_time to the number of seconds after the packet's datetime is allowed to be processed.

Installation notes

Because there are multiple methods to install WeeWX, location of files can vary. See where to find things in the WeeWX User's Guide for the definitive information. The following symbolic names are used to define the various locations:

• $DOWNLOAD_ROOT - The directory containing the downloaded MQTTSubscribe extension.
• $BIN_ROOT - The directory where WeeWX executables are located.
• $CONFIG_ROOT - The directory where the configuration (typically, weewx.conf) is located.

Prior to making any updates/changes, always make a backup.

Preqrequisites

WeeWX version	Python version
3.7.1 or greater	Python 2.7.x
4.0.0 or greater	Python 2.7.x or Python 3.5 or greater

See the current MQTTSubscribe build/test matrix for the current WeeWX and python versions being tested.

Paho MQTT python client.

```
pip install paho-mqtt
```

Installation

1. Download MQTTSubscribe

   wget -P $DOWNLOAD_ROOT https://github.com/bellrichm/WeeWX-MQTTSubscribe/archive/v.X.Y.Z.tar.gz
   

2. Install MQTTSubscribe

   • As a driver

     $BIN_ROOT/wee_extension --install=$DOWNLOAD_ROOT/v.X.Y.Z.tar.gz
     $BIN_ROOT/wee_config --reconfig
     

     Note: By default when installing, the service is installed and configured, but not enabled. To not install and configure the service (only install the file(s)), set the environment variable MQTTSubscribe_install_type to DRIVER. For example,

     MQTTSubscribe_install_type=DRIVER $BIN_ROOT/wee_extension --install=$DOWNLOAD_ROOT/v.X.Y.Z.tar.gz
     

     And then configure the driver.

     $BIN_ROOT/wee_config --reconfig
     

   • As a service

     $BIN_ROOT/wee_extension --install=$DOWNLOAD_DIR/v.X.Y.Z.tar.gz
     

     Note: By default when installing, the service is installed and configured, but not enabled. To enable, set the environment variable MQTTSubscribe_install_type to SERVICE. For example,

     MQTTSubscribe_install_type=SERVICE $BIN_ROOT/wee_extension --install=$DOWNLOAD_DIR/v.X.Y.Z.tar.gz
     

     In either case, edit the [MQTTSubscribeService] stanza as required. At the very least the [[topics]] stanza must be configured to the topics to subscribe to. Other settings such as host and port may need to be changed.

3. Restart WeeWX

   sudo /etc/init.d/weewx restart
   

   or

   sudo sudo service restart weewx
   

   or

   sudo systemctl restart weewx
   

Manual installation instructions

1. Download MQTTSubscribe

   wget -P $DOWNLOAD_ROOT https://github.com/bellrichm/WeeWX-MQTTSubscribe/archive/v.X.Y.Z.tar.gz
   

2. Unpack MQTTSubscribe

   tar xvfz v.X.Y.Z.tar.gz
   

3. Copy the file

   cp $DOWNLOAD_ROOT/v.X.Y.X/bin/user/MQTTSubscribe.py $BIN_ROOT/user
   

4. Configure

   • As a driver

     $BIN_ROOT/wee_config --reconfig
     

   • As a service
     Configure as required and add the service to WeeWX.

     [MQTTSubscribeService]
         host = localhost
         payload_type = json
         [[topics]]
             [[[topic1]]]
             [[[topic2]]]
     [Engine]
         [[Services]]
             data_services = user.MQTTSubscribe.MQTTSubscribeService
     

5. Restart WeeWX

   sudo /etc/init.d/weewx restart
   

   or

   sudo sudo service restart weewx
   

   or

   sudo systemctl restart weewx