Stability and Functionality Enhancements

Version 1.4.1 - July 31, 2024

Summary

This release includes significant bug fixes and improvements to enhance the stability and functionality of the iceicedata application. Key updates involve timestamp parsing, wind direction handling, MQTT publishing, and integration of local changes with remote updates.

Changelog

Bug Fixes

1. Timestamp Parsing Fixes:

   • Corrected the parsing logic for timestamps to handle the format 07/31/2024 12:30:04 pm.
   • Updated the database.py to ensure correct parsing and storage of timestamp values.

2. Wind Direction Handling:

   • Implemented logic to convert compass bearing wind direction values (e.g., "N", "NW") into numeric values for MQTT publishing.
   • Ensured that numeric wind direction values in string format are converted to floats before publishing.

3. MQTT Publishing Enhancements:

   • Improved the handling of wind_speed and wind_direction data for the -w option to ensure both are published as numeric values.
   • Added checks to ensure wind_direction is correctly converted and published.

Code Improvements

1. Updated data_processing.py:

   • Added missing import statements for split_value_and_unit, convert_timestamp_to_unix_ms, and convert_compass_to_degrees.
   • Modified the process_data function to return four values: data, None, station_name, and attribute_descriptions.
   • Added logging for attribute descriptions to improve debugging and data integrity.

2. General Improvements:

   • Enhanced logging and error handling across the application.

Notes

• This version focuses on improving the robustness and accuracy of data processing and publishing, particularly in handling timestamps and wind direction values.

Reporting

Can specify reporting:

Options:

-R {daily,weekly,monthly}, --report {daily,weekly,monthly}

Generate a report. Choose from: daily, weekly, or monthly.

--start-date START_DATE

Start date for the report (YYYY-MM-DD).

--end-date END_DATE

End date for the report (YYYY-MM-DD).

--output-format {pdf,html,csv}

Report output format. Choose from: pdf, html, or csv. Default: pdf.

Note that pdf option is not implemented in this release.

Multiple station IDs

Multiple station IDs can be specified in the -i / --station-id option, either comma-separated or a file containing station IDs.

Iterative ability restored

Database capability broke iterations. Fixed.

Database store option added

Now has --database [dbname] option.

Database location can be set in config.yaml.
If database doesn't exist, it gets created (sqlite). Database is integrity checked at runtime.
Weather field descriptions are kept in a table and all weather station data is stored (for each iteration (if -r is specified).)

Repeating polling

Added option to retrieve data every 'n' minutes or days (no more frequent than every 5 minutes).
Added --debug option to trace actions when needed

Initial

First working release. Not intended for general distribution or use as there are much better Tempest data tools that access the data via approved APIs.

iceicedata doesn't require APIs or accounts to grab the same data, and any station that's broadcasting data can be used by this app.