v0.8.0

This is the November 2024 release.

Highlights

• Instrument Processing
  • Improvements/additions to CoDICE processing
    • Added capability to process multiple APID from a single input L0 file
    • Updated input test L0 file and updated affected unit tests
  • Improvements to IDEX processing
    • Updated list of valid data levels to include new L2a, L2b, and L2c data levels
    • Updated input L0 test data and made corresponding changes to unit tests
  • Improvements to Ultra processing
    • Updates to L1c pset
    • Updates to annotated events
  • Improvements to GLOWS processing
    • Set up initial L2 processing pipeline
  • Improvements to MAG processing
    • Various cleanup for L1b CDFs
  • Improvements to Lo processing
    • Added support for segmentated packet DE fields that are spread across packets
    • Updated XTCE DE to group count and passing fields into the binary chunk
  • Improvements to Hi processing
    • Implemented support for L1b spin phase
    • Implemented support for L1b computation of nominal bin
    • Added calibration product coordinate to pset for L1c
  • Improvements to SWE processing
    • Implemented L1b science validation
  • Improvements to HIT processing
    • Implemented L1b housekeeping CDFs
    • Updated dependencies for L1b and L2
    • Implemented subcommutation for L0 sector rates
    • Implemented data decompression for L0
• Infrastructure
  • Designed how SPICE dependency is tracked and associated
  • Removed old database tables for spin and repointing
  • Updated upload API lambda to accept spin and repointing csv data
  • Added spin and repointing data extension to SPICE checks
  • Updated EFS write lambda's event rule according to new SDC-maintained spin and repoint files
  • Updated EFS write lambda to move ingested files to correct EFS path
  • Added rest of IMAP kernels to the SPICE directory mapping
  • Now grouping lambda code into its functional group
• Documentation updates
  • Updated all-contributors section of the README
  • Updated release procedure workflow documentation
  • Updated list of expected descriptors for CoDICE and IDEX
  • Updated 'Getting Started' documentation
  • Added documentation for Work Management Process
  • Updated CDF documentation
• Misc
  • Implemented cartesian to spherical function for SPICE
  • Now using the SAMMI library for CDF attribute management
  • Excel to XTCE now can handle hexadecimal state values
  • Added placeholder function for esa_step -> esa_energy_step
• Bug Fixes
  • Fixed bug in CoDICE L1a pipeline in which byte_count was not being used to determine length of data to decompress
  • Fixed bug in MAG decompression
  • Fixed Lo case 4 decompression table
  • Fixed psycopg error in pytests

What's Changed

• Add function for getting basis vectors from spice by @subagonsouth in #1080
• Small bug fix - MAG by @maxinelasp in #1114
• SWE: L1B validation data by @tech3371 in #1103
• 865 hi l1b spin phase by @subagonsouth in #1102
• HIT L1B - Create housekeeping dataset by @vmartinez-cu in #1118
• All Contributors cleanup by @bourque in #1120
• Add calculation of Hi L1B nominal_bin by @subagonsouth in #1116
• Add some more notes to the release workflow by @bourque in #1121
• Small update CoDICE and IDEX data product naming conventions by @bourque in #1123
• Updates to MAG L1B to scale based on compression flags by @maxinelasp in #1117
• update link on documentation by @lacoak21 in #1137
• Adding poetry installation steps to docs by @nkerman in #1138
• Switch to using SAMMI for CDF attribute management by @maxinelasp in #1122
• Documentation for Work Management Process by @sdhoyt in #879
• Fixing mag tests, removing temp fix by @maxinelasp in #1142
• Removed Lo DE segmented packet string commas by @sdhoyt in #1144
• Add placeholder function for converting from esa_step to esa_energy_step by @subagonsouth in #1146
• HIT L0 - subcommutate sector rates by @vmartinez-cu in #1160
• Update Lo XTCE for Segmented DE packets by @sdhoyt in #1079
• Update Lo DE Case Decoder for 4, 1 TOF2 by @sdhoyt in #1167
• Add Hexadecimal state handling to excel_to_xtce by @sdhoyt in #1159
• Process multiple CoDICE APIDs per input file by @bourque in #1162
• Glows L2 initial setup by @maxinelasp in #1156
• Mag l1b CDF cleanup by @maxinelasp in #1173
• Ultra: Updates to annotated events and create l1b cdf. by @laspsandoval in #1081
• Ultra l1c pset updates by @laspsandoval in #1059
• Use byte_count to determine size of CoDICE data arrays by @bourque in #1171
• CDF document updates by @tech3371 in #1179
• HIT L0 - data decompression by @vmartinez-cu in #1169
• HIT L1A - update hskp processing to use hit utils functions by @vmartinez-cu in #1176
• Update IDEX l1a and l0 tests to work with new l0 test data by @lacoak21 in #1181
• 1147 hi l1c add calibration product coordinate to pset by @subagonsouth in #1172

New Contributors

• @lacoak21 made their first contribution in #1137
• @nkerman made their first contribution in #1138

Full Changelog: v0.7.0...v0.8.0

v0.7.0

This is the October 2024 release.

Highlights

• Instrument Processing
  • Improvements/additions to Ultra processing
    • Added spatial and energy binning equations
    • Added exposure time and pointing frame
    • Updates to L1B Annotated products
    • Added PSET spacecraft frame and PSET helio frame exposure times
  • Improvements/additions to I-ALiRT processing
    • Added HIT algorithm lambda
  • Improvements/additions to GLOWS processing
    • Updates to L1 CDF dtypes for outputs
    • Added validation tests for L1A and L1B
  • Improvements/additions to MAG processing
    • L1a compression fixes
  • Improvements/additions to Lo processing
    • Updates to use new decompression tables
    • Refactored L1A direct event data class to function
    • Combined segmented direct event data
  • Improvements/additions to Hi processing
    • Added extract method for generating L1B direct event DataArrays
    • Populated L1A direct event CDF files with simulated data
    • Updated product definition esa_step
    • Added computation of coincidence_type and time deltas
    • Added computation of HAE lattitude and longitude
    • Added logical source parser
  • Improvements/additions to SWAPI processing
    • Updated tests and validation data
    • Updated L2 variable names
    • Updated L1 to store other housekeeping variables
  • Improvements/additions to SWE processing
    • Improvements to L1 for L2 processing
    • Added L1A CDF validation
    • Added conversion of counts to phase space density
  • Improvements/additions to HIT processing
    • Refactored L1A processing to use packet_file_to_datasets function
• Misc
  • Updated Poetry documentation
  • Added SPICE directory to the documentation build
  • Added epoch to J2000 seconds function for SPICE
  • Added calculations for instrument spin phase for SPICE
  • Upgraded cdflib version
  • Upgraded space_packet_parser version
• Bug Fixes
  • Fixed bug in I-ALiRT deployment
  • Fixed bug in Lo unpacking scheme definitions
  • Fixed bug in SPICE function get_spacecraft_spin_phase to avoid returning all nans

What's Changed

• calculate partical energy by @tech3371 in #888
• SWAPI new test and validation data by @tech3371 in #891
• 913 hi l1a update hi product definition esa step by @subagonsouth in #914
• Fixed Lo DE unpacking scheme by @sdhoyt in #901
• GLOWS L1 updates by @maxinelasp in #889
• 795 spice instrument pointing at specified time by @subagonsouth in #903
• Fixing histogram attrs missed in last PR by @maxinelasp in #919
• Add Ultra spatial and energy binning equations. by @laspsandoval in #875
• Ultra: Added exposure time for pointing frame by @laspsandoval in #967
• Updated New Lo Histogram Decompression Tables by @sdhoyt in #921
• Extract L1B DE function for better code modularization by @subagonsouth in #969
• SWE L1 Improvement to store acquisition time of each measurement by @tech3371 in #881
• Lo L1A Direct Event Refactor by @sdhoyt in #971
• MNT: Cdflib update by @tech3371 in #991
• 864 hi l1b compute coincidence type and time deltas by @subagonsouth in #995
• Add spice module to documentation by @subagonsouth in #1010
• 1020 bug get spacecraft spin phase always returns nans by @subagonsouth in #1021
• 1019 calculate instrument spin phase by @subagonsouth in #1022
• Update to poetry docs by @laspsandoval in #1027
• Add function to convert j2000ns to j2000s by @subagonsouth in #1025
• Poetry doc update by @maxinelasp in #1029
• MNT: space_packet_parser update by @tech3371 in #1007
• 867 hi l1b compute hae latitude and longitude by @subagonsouth in #1032
• swe l1a validation data by @tech3371 in #1038
• SWAPI: rename CDF variable names to match algorithm document by @tech3371 in #1042
• Lo DE Segmented Packets by @sdhoyt in #1016
• bugfix for apid by @laspsandoval in #1046
• Ultra PSET Spacecraft Frame + PSET Helio Frame Exposure Times by @laspsandoval in #1040
• Update Ultra l1b Annotated by @laspsandoval in #989
• 1026 logical source parser by @subagonsouth in #1044
• SWE: calculate phase space density by @tech3371 in #1041
• SWAPI: Add additional support data to SWAPI L1 and L2 by @tech3371 in #1043
• 1045 hi l1b modify processing workflow to use xarraydatasetupdate by @subagonsouth in #1054
• Mag l1a compression fixes by @maxinelasp in #1082

Full Changelog: v0.6.0...v0.7.0

v0.6.0

This is the September 2024 release.

Highlights

• Data Access API
  • Added query parameter for returning files acquired in the last 24 hours
  • Added query parameter for returning files acquired in the last N days
  • Improvements to query parameter validation and handling of 502 errors
• Instrument Processing
  • Improvements to CoDICE L1a processing:
    • Updated XTCE definitions
    • Implemented packet_file_to_datasets utility function, which simplifies the processing algorithm
    • Added support for variable length packet data
    • Updating CDF variable/attribute names to match expected nomenclature
    • Added CATDESC and FIELDNAM descriptions to housekeeping attributes
    • Refactored pipeline to allow more flexibility in configuring the 18 different CoDICE L1 data products
      *Improvements to Ultra L1 processing:
    • Created Ultra pset energy bins
    • Implemented Ultra L1b extended ssd and extended energy
    • Implemented Ultra particle velocity and SSD TOF
  • Improvements to Lo L1 processing:
    • Improved Lo L1a CDF YAML definitions
    • Updated Lo L1a dependency table
    • Refactoredpacket_file_to_datasets utility function for Lo
  • Improvements to HIT L1 processing:
    • Now using raw L0 file as a single L1a dependency
    • Implemented unpacing of L0 count rates data
    • Now grouping L0 science packets into science frames
    • Updated L0 dependency table
    • Updated sci deom to group packets and parse count rates
    • Implemented packet_file_to_datasets utility function, which simplifies the processing algorithm
  • Improvements to SWAPI processing:
    • Updated L1 quality flags to work with numpy v2.0+
    • Added quality flags for L2 algorithm
    • Added L3 levels to list of valid levels
    • Updated L2 dependency table
  • Improvements to SPICE:
    • Implemented SPICE frame transform function
    • Implemented some SPICE infrastructure and simple geometry function
    • Implemented spin phase query utils function, using spin start and spin rate data
    • Implemented spin phase calculation using spin data
  • IDEX L1 processing is now split into L1a and L1b processing/data products
  • Implemented packet_file_to_datasets utility function for SWE pipeline, which simplifies the processing algorithm
  • Implemented HIT CCSDS packet generation for I-ALiRT
  • Updated met_to_j200ns function
  • Updated Hi product definition to have int64 data instead of uint64
• Misc
  • Refactored AWS infrastructure to use Constructs instead of Stacks
  • Initial set of materials sent to web team for initial implementation of SDC website
  • Added AWS stack to handle website deployment
  • Added Parents attribute to CDF files that indicate parent data products used to create the CDF
  • Added wheel build to releases
  • Improvements to dependency management documentation
  • Now ignoring conftest.py modules in Codecov reporting
  • Updated EventBridge rule to match new SPICE path in data bucket
• Bug Fixes
  • Fixed bug in SPICE batch job
  • Fixed bug that was causing SPICE to fail loading metakernel
  • Fixed unique constraint for dependency table

Full Changelog

• Ultra l1b extended ssd by @laspsandoval in #789
• Docstring, variable name, formatting updates to IDEX L1 by @bourque in #799
• Implement packet_file_to_datasets function for CoDICE by @bourque in #804
• SPICE geometry enums and IMAP state function by @subagonsouth in #791
• SWAPI Quality Flag by @tech3371 in #805
• WIP/MNT: Update SWE to use packet_file_to_datasets by @greglucas in #802
• Create Ultra pset energy bins by @laspsandoval in #811
• Added new tof test data by @laspsandoval in #807
• Define spatial bins for pset by @laspsandoval in #819
• 689 spice update met to j2000ns by @subagonsouth in #818
• Ultra particle velocity and SSD TOF by @laspsandoval in #823
• Updated CoDICE XTCE files from imap_xtce tool by @bourque in #812
• Updated various CDF attributes/variable names to match expected nomenclature by @bourque in #813
• Added FIELDNAMs, LABLAXISs, and CATDESCs for housekeeping attributes by @bourque in #816
• I-ALiRT - Test decom for HIT CCSDS by @laspsandoval in #757
• Pointing frame updates by @laspsandoval in #814
• BUG - fix for time kernels not loading during imap_cli command by @tech3371 in #838
• Separate IDEX L1 into L1a and L1b by @bourque in #831
• ignore conftest.py files in codecov by @subagonsouth in #846
• Dependency documention by @maxinelasp in #844
• Test infrastructure for external spice kernels by @subagonsouth in #842
• Ultra l1b extended energy by @laspsandoval in #825
• Added SWAPI L3 levels to the list of valid levels by @tech3371 in #847
• Lo L1A Histogram packet_to_dataset() Refactor and CDF Creation by @sdhoyt in #788
• Spin data and Spin Phase function setup by @tech3371 in #824
• FIX: Update SWAPI quality flags to work with numpy 2+ by @greglucas in #848
• Mag l1a compression by @maxinelasp in #801
• HIT sci decom - group packets & parse count rates by @vmartinez-cu in #815
• Lo L1A CDF YAML Reorganization by @sdhoyt in #860
• ENH: Add "Parents" global attribute to datasets by @greglucas in #858
• MNT: Change default to use raw value in packet_file_to_datasets by @greglucas in #857
• Refactor hit_l1a.py to use packet_file_to_datasets function by @vmartinez-cu in #828
• CoDICE data product organization refactor by @bourque in #826
• Convert all hi instances of uint64 CDF variables to int64 by @subagonsouth in #872
• Spin phase calculation using spin data by @tech3371 in #852
• 859 spice frame transform function by @subagonsouth in #861
• Ultra l1b species + start to l1b Annotated by @laspsandoval in #851
• REL/CI: Add wheel build to release by @greglucas in #878

Full Changelog: v0.5.0...v0.6.0

v0.5.0

This is the release for August 2024.

Highlights

• Data Access API:
  • Improvements to documentation and help menus
  • Added demo/examples notebook
  • Added support for filename query parameter
  • Fixed output table formatting
• Instrument Processing:
  • Updated CDF attributes for GLOWS
  • Implemented proper unpacking and restructuring of data arrays for CoDICE-lo L1 data products
  • Updates to global CDF attribute metadata
  • Added Ultra Extended L1B lookup tables
  • Added support for bitflags
  • Added DynamoDB Streams for i-alirt packet ingest
  • Added Ultra pulse height calculations
  • Added SPICE pointing frame
  • Updated Lo and HIT XTCE files
  • Created module structure for SPICE functions
  • Added SPICE kernel furnishing decorator
  • Migrated HI L1a housekeeping to use CdfAttributeManager
  • Refactored epoch attributes
  • Initial implementation of SWAPI L2 alrgorithm
• Misc
  • Various updates to XTCE generator script and improved documentation
  • Enabled support for numpy v2.x
• Bug Fixes:
  • Fixed bug in --end-date query parameter in Data Access API
  • Fixed bug in mypy pre-commit check so now it covers entire code base

Full Changelog

• Refactor epoch attrs by @tech3371 in #718
• MNT/ENH: Add FLOAT and FILL options for spreadsheet dataType by @greglucas in #701
• MNT: Minimize the datatypes created from space_packet_parser by @greglucas in #723
• SWAPI l2 Implementation - counts to rate by @tech3371 in #721
• Bitflags by @laspsandoval in #694
• MNT: Change to a period separator for XTCE definitions by @greglucas in #726
• Ultra Extended L1b Lookup tables by @laspsandoval in #696
• Data access api by @anamanica in #720
• packet_file_to_datasets NOT in IDEX by @anamanica in #743
• Define the imap_processing spice structure by @subagonsouth in #733
• Mypy Update by @daralynnrhode in #731
• Glows cdf attrs update by @anamanica in #725
• MNT: Update global CDF attribute metadata by @greglucas in #747
• Ultra Extended L1b Front Coordinates by @laspsandoval in #730
• Calculate the path length for L1b Ultra by @laspsandoval in #749
• Various CoDICE L1 Updates by @bourque in #711
• 728 spice kernel furnishing decorator by @subagonsouth in #734
• Updated/Combined Lo XTCE by @sdhoyt in #754
• MNT: Enable numpy 2+ installs by @greglucas in #758
• DOC: Update XTCE generator documentation by @greglucas in #766
• Pointing frame code by @laspsandoval in #759
• Add Pulse Height Calculations by @laspsandoval in #750
• MNT: Add useful error message when packet to datasets fails by @greglucas in #763
• FIX: Avoid loss of precision when casting in packet loading (alternative) by @greglucas in #786
• CoDICE L1 decompression and unpacking data updates by @bourque in #762
• ENH: Add Enumeration states to XTCE parser by @greglucas in #783

Full Changelog: v0.4.0...v0.5.0

v0.4.0

This is the release for (most of) June and July 2024, and the latest release before the IMAP Science Team Meeting on Aug 1st and 2nd.

Highlights

• Added automated numpydoc and mypy checks to pre-commit hooks
• Added end-date parameter to CLI script
• Added unit tests for new CDF attribute management code
• All instrument pipelines now return xarray dataset objects instead of filepaths
• Added support for array-like time conversions
• Updated IDEX, HI, HIT, MAG, and SWAPI pipelines to use new yaml-based CDF attribute management code instead of dataclasses
• Updated citation info
• Updates to XTCE generator script to be instrument-agnostic
• Added generalized dataset creation code

Full Changelog

• FIX: CLI help needs to be strings not tuples by @greglucas in #646
• Add numpydoc Pre-Commit Hook Pt.1 by @daralynnrhode in #639
• Add numpydoc pre-commit For SWE Pt.2 by @daralynnrhode in #641
• Add numpydoc Pre-Commit For Ultra & Swapi Pt.3 by @daralynnrhode in #643
• Add numpydoc Pre-Commit For Mag & Lo Pt.4 by @daralynnrhode in #644
• Add numpydoc Pre-Commit For ialirt & idex Pt.5 by @daralynnrhode in #647
• Add numpydoc Pre-Commit for Hit & Hi Pt.6 by @daralynnrhode in #651
• Add numpydoc Pre-Commit For Codice & Glows Pt.7 Last One by @daralynnrhode in #652
• Updates to the CLI to include the end-date by @maxinelasp in #658
• Cdf attribute tests by @anamanica in #637
• Git workflow update by @anamanica in #650
• MNT: Pass around dataset objects rather than file objects by @greglucas in #657
• ENH/MNT: Allow array-like time conversion by @greglucas in #653
• CDF Updates by @anamanica in #660
• 662 migrate remaining hi products to use cdfattributemanager by @subagonsouth in #671
• Fix Hi L1b test marked xfail by @subagonsouth in #681
• Update Management of HIT CDF Attributes to use YAMLs by @vmartinez-cu in #679
• XTCE generator scripts by @anamanica in #680
• Update citation info by @vmartinez-cu in #685
• Add mypy Pre-commit Hook and Fix tools folder Pt.1 by @daralynnrhode in #659
• Add mypy Pre-Commit Hook for files Pt.2 by @daralynnrhode in #661
• Add mypy Pre-Commit For Ultra Pt.3 by @daralynnrhode in #663
• Add mypy Pre-Commit for swe Pt.4 by @daralynnrhode in #666
• Add mypy Pre-commit for swapi Pt.5 by @daralynnrhode in #667
• Add Pre-Commit For mag Pt.6 by @daralynnrhode in #668
• Add mypy Pre-Commit For Lo Pt.7 by @daralynnrhode in #669
• Add mypy Pre-Commit For idex Pt.8 by @daralynnrhode in #670
• Add mypy Pre-Commit For ialirt Pt.9 by @daralynnrhode in #673
• Add mypy Pre-Commit For hi & hit Pt.10 by @daralynnrhode in #674
• Add mypy Pre-Commit for glows Pt.11 by @daralynnrhode in #676
• Add mypy Pre-Commit for codice Pt.12 Last by @daralynnrhode in #678
• Improvement to correct numpy update issue for Ultra by @laspsandoval in #638
• CLI Type cleanup/standardization by @maxinelasp in #692
• Glows l1a cdf by @anamanica in #688
• Update IDEX by @anamanica in #695
• Xtce combined by @greglucas in #654
• ENH/MNT: Add a common initial dataset creation routine by @greglucas in #687
• 682 imap hi use imapcdfattributes instead of cdfattributemanager by @subagonsouth in #684
• Hi test data and fixture refactor by @subagonsouth in #709
• switched SWAPI CDF attrs to use YAML by @tech3371 in #704
• Move MAG L1A to CDF attribute manager by @maxinelasp in #693
• Cleanup CDF dataclass by @tech3371 in #714

Full Changelog: v0.3.0...v0.4.0

v0.3.0

This release includes updates to be used for the IMAP SDC Software Integration Test 3 (SIT-3). More information can be found in this galaxy page.

Highlights

• Updated L0 decommutation algorithms for Ultra
• Added unit tests for L0 decommutation for SWAPI
• Added support for L1 processing for several instruments (CoDICE, GLOWS, Hi, HIT, Lo, MAG, SWAPI, SWE, Ultra)
• Moved to YAML-based solution for defining CDF attributes
• Updated cli script for triggering processing for instruments; added support for all instruments; added functionality for downloading dependencies and uploading produced files; added support for descriptor field.
• Updated logging in L1 processing pipelines to use module-level logs
• Updated documentation, particularly for CDF attributes and file structure, file naming conventions, and git/GitHub workflow
• Added SPICE examples for Annotated Events
• Added codespell pre-commit check
• Updated version of space_packet_parser and cdflib
• Added citation information and DOI badge for citing the repository
• Added load_cdf helper function
• Added launch_time parameter to cdf.utils.calc_start_time to allow instruments to define their own launch time.
• Now defining repository version dynamically

Full Changelog

• FIX: Make sphinx-contrib an optional dependency only needed for doc builds by @greglucas in #333
• FIX: Make sure configurations are synced between packages by @greglucas in #336
• Fix IDEX and HIT tests by @bourque in #337
• Update ruff by @sdhoyt in #343
• HIT housekeeping data class by @sdhoyt in #342
• Limit bitstring usage by @greglucas in #344
• Mag cdf by @maxinelasp in #340
• Updated naming conventions for CoDICE by @bourque in #334
• CLI updates by @maxinelasp in #341
• MAG CDF updates by @maxinelasp in #349
• L0 Decom Ultra by @laspsandoval in #347
• Create l1a cdfs for auxiliary data packet by @laspsandoval in #352
• Update CoDICE CDFs to use datetime64 for EPOCH by @bourque in #354
• Swapi decom tests by @tech3371 in #355
• update to docker example that is used to build batch job image by @tech3371 in #351
• Update decom for APID 881 due to changes in packet definitions by @laspsandoval in #353
• SWE updates to be compliant with new cdflib releases by @tech3371 in #357
• Lo SciDE data class fix - multiple DEs in a packet by @sdhoyt in #339
• Updated naming and data product versioning conventions by @bourque in #358
• MNT: Cleanup extra file in repository by @greglucas in #361
• TST: Rely on temp directory for test file cleanup by @greglucas in #360
• MNT: Use module-level logger by @greglucas in #362
• Added l1a cdf generation for all apids by @laspsandoval in #356
• MNT: Update file naming convention via imap-data-access upgrade by @greglucas in #363
• Remove Warnings by @laspsandoval in #365
• MNT: Rename Epoch to epoch lowercased for variable names by @greglucas in #366
• hi direct event l1a processing by @tech3371 in #364
• Docs for calibration files by @maxinelasp in #367
• Initial CoDICE L1a algorithm for lo-sw-species data by @bourque in #300
• Update documentation variable names by @greglucas in #368
• Various fixes and improvements to CDF documentation by @bourque in #372
• Updating mag CDF generation to match new filenames by @maxinelasp in #370
• IMAP-Hi L1A DE after Discussion with Paul by @tech3371 in #369
• MNT: Change default display_type to be no_plot by @greglucas in #375
• MNT: Remove unused extra test file by @greglucas in #373
• TST: Move codice xfail into a separate test by @greglucas in #377
• MNT: Change IDEX packet definition to be formatted like others by @greglucas in #376
• MNT: Remove unused extra file by @greglucas in #381
• MNT: Add codespell and fix spelling mistakes found by @greglucas in #382
• Update IMAP-Hi DE CDF attrs by @tech3371 in #374
• Process IMAP-Hi Housekeeping data and create CDF file by @tech3371 in #371
• TST: Avoid xarray.dims deprecation by @greglucas in #380
• MNT: Remove directory option from write_cdf by @greglucas in #379
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #385
• Add vmartinez-cu to contributors by @allcontributors in #388
• docs: add subagonsouth as a contributor for review by @allcontributors in #389
• Added SPICE examples for Annotated Events by @laspsandoval in #386
• Update space_packet_parser version by @tech3371 in #387
• Add citation file by @vmartinez-cu in #392
• Mag l1a processing by @maxinelasp in #384
• CDF attrs bug fix by @tech3371 in #393
• CoDICE L1a for lo-sw-species-counts (and improvements to housekeeping) by @bourque in #391
• Small updates to the CDF documentation by @bryan-harter in #383
• Added SWAPI science data CDF attribute by @tech3371 in #394
• added SWAPI housekeeping processing and CDF attrs by @tech3371 in #398
• Science Direct Event Decompression Re-write by @sdhoyt in #397
• Initial Lo L1A Science DE CDF by @sdhoyt in #396
• Lo Star Sensor and Science Counts data classes with bit decompression by @sdhoyt in #319
• MAG L1A CDF by @maxinelasp in #395
• Remove individual IMAP-Hi packet definition xtce files by @subagonsouth in #401
• Updating CLI to fix MAG by @maxinelasp in #404
• CoDICE lo-sw-species-counts test data by @bourque in #402
• CoDICE L1a lo-nsw-species-counts by @bourque in #530
• updates to utils create_dateset function by @tech3371 in #532
• Updates based on SPDF feedback by @tech337...

v0.3.0rc2

Full Changelog

• Lo L1C CDF Creation for SIT-3 by @sdhoyt in #614
• Data version fixes for SWE and SWAPI by @tech3371 in #621
• Data_version updates to Lo L1C by @tech3371 in #625
• Glows l1b cdf by @maxinelasp in #618
• REL/CI: Add build job dependency to release process by @greglucas in #624
• Inital Codice L1b processing (for SIT-3) by @bourque in #622
• HIT Data_version fixes by @tech3371 in #626
• Mag L1B/L1C cdf by @maxinelasp in #623
• 609 imap hi l1c pointing set cdf by @subagonsouth in #627
• 630 final hi updates for sit 3 by @subagonsouth in #631
• Glows fixes for deployment by @maxinelasp in #629
• Add to SIT-3 data variables by @laspsandoval in #589
• Add Hi sensor name to imap_hi_l1b_hk products by @subagonsouth in #633
• Mag hotfix by @maxinelasp in #636
• Update for Sit 3 by @laspsandoval in #635
• MNT: Add optional descriptor field to the cli by @greglucas in #640

Full Changelog: v0.3.0rc1...v0.3.0rc2

v0.3.0rc1

Full Changelog

• v0.2.0 Release by @bourque in #332
• FIX: Make sphinx-contrib an optional dependency only needed for doc builds by @greglucas in #333
• FIX: Make sure configurations are synced between packages by @greglucas in #336
• Fix IDEX and HIT tests by @bourque in #337
• Update ruff by @sdhoyt in #343
• HIT housekeeping data class by @sdhoyt in #342
• Limit bitstring usage by @greglucas in #344
• Mag cdf by @maxinelasp in #340
• Updated naming conventions for CoDICE by @bourque in #334
• CLI updates by @maxinelasp in #341
• MAG CDF updates by @maxinelasp in #349
• L0 Decom Ultra by @laspsandoval in #347
• Create l1a cdfs for auxiliary data packet by @laspsandoval in #352
• Update CoDICE CDFs to use datetime64 for EPOCH by @bourque in #354
• Swapi decom tests by @tech3371 in #355
• update to docker example that is used to build batch job image by @tech3371 in #351
• Update decom for APID 881 due to changes in packet definitions by @laspsandoval in #353
• SWE updates to be compliant with new cdflib releases by @tech3371 in #357
• Lo SciDE data class fix - multiple DEs in a packet by @sdhoyt in #339
• Updated naming and data product versioning conventions by @bourque in #358
• MNT: Cleanup extra file in repository by @greglucas in #361
• TST: Rely on temp directory for test file cleanup by @greglucas in #360
• MNT: Use module-level logger by @greglucas in #362
• Added l1a cdf generation for all apids by @laspsandoval in #356
• MNT: Update file naming convention via imap-data-access upgrade by @greglucas in #363
• Remove Warnings by @laspsandoval in #365
• MNT: Rename Epoch to epoch lowercased for variable names by @greglucas in #366
• hi direct event l1a processing by @tech3371 in #364
• Docs for calibration files by @maxinelasp in #367
• Initial CoDICE L1a algorithm for lo-sw-species data by @bourque in #300
• Update documentation variable names by @greglucas in #368
• Various fixes and improvements to CDF documentation by @bourque in #372
• Updating mag CDF generation to match new filenames by @maxinelasp in #370
• IMAP-Hi L1A DE after Discussion with Paul by @tech3371 in #369
• MNT: Change default display_type to be no_plot by @greglucas in #375
• MNT: Remove unused extra test file by @greglucas in #373
• TST: Move codice xfail into a separate test by @greglucas in #377
• MNT: Change IDEX packet definition to be formatted like others by @greglucas in #376
• MNT: Remove unused extra file by @greglucas in #381
• MNT: Add codespell and fix spelling mistakes found by @greglucas in #382
• Update IMAP-Hi DE CDF attrs by @tech3371 in #374
• Process IMAP-Hi Housekeeping data and create CDF file by @tech3371 in #371
• TST: Avoid xarray.dims deprecation by @greglucas in #380
• MNT: Remove directory option from write_cdf by @greglucas in #379
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #385
• Add vmartinez-cu to contributors by @allcontributors in #388
• docs: add subagonsouth as a contributor for review by @allcontributors in #389
• Added SPICE examples for Annotated Events by @laspsandoval in #386
• Update space_packet_parser version by @tech3371 in #387
• Add citation file by @vmartinez-cu in #392
• Mag l1a processing by @maxinelasp in #384
• CDF attrs bug fix by @tech3371 in #393
• CoDICE L1a for lo-sw-species-counts (and improvements to housekeeping) by @bourque in #391
• Small updates to the CDF documentation by @bryan-harter in #383
• Added SWAPI science data CDF attribute by @tech3371 in #394
• added SWAPI housekeeping processing and CDF attrs by @tech3371 in #398
• Science Direct Event Decompression Re-write by @sdhoyt in #397
• Initial Lo L1A Science DE CDF by @sdhoyt in #396
• Lo Star Sensor and Science Counts data classes with bit decompression by @sdhoyt in #319
• MAG L1A CDF by @maxinelasp in #395
• Remove individual IMAP-Hi packet definition xtce files by @subagonsouth in #401
• Updating CLI to fix MAG by @maxinelasp in #404
• CoDICE lo-sw-species-counts test data by @bourque in #402
• CoDICE L1a lo-nsw-species-counts by @bourque in #530
• updates to utils create_dateset function by @tech3371 in #532
• Updates based on SPDF feedback by @tech3371 in #533
• IMAP Hi Histogram L1A processing by @subagonsouth in #535
• Initial Codice L1A validation tests by @bourque in #534
• docs: add subagonsouth and vmartinez-cu as a contributor for code by @allcontributors in #539
• MNT: Remove direct bitstring dependency by @greglucas in #536
• CoDICE L1a lo-sw-priority-counts by @bourque in #540
• CoDICE L1a Lo Sunward Angular Counts by @bourque in #544
• load_cdf helper function by @bourque in #537
• Cleaning up some L1A hist CDF issues found when reviewing output file by @subagonsouth in #547
• CI: Add codecov upload token by @greglu...

v0.2.0

This release includes updates to be presented at the IMAP Science Team Meeting at LASP in February 2024. More information can be found in this galaxy page.

Highlights

• Additions and Updates to project documentation, including Poetry, CDFs, PR reviews, Release Workflow, Versioning, File Naming Conventions, Issue Management, SDC Test Planning, Data Access API, and general code documentation
• Improved test coverage, including validation of CCSDS headers, processing algorithms
• Added XTCE generation code and XTCE packet definitions
• Implemented class-based CDF creation system
• Implementation of L0 processing for all instruments
• Implementation of L1 processing for IDEX, SWE, SWAPI
• Partial implementation of L1 processing for CoDICE, HIT, GLOWS, IMAP-Lo
• Added instrument processing command line utility
• Added SPICE foundational tools
• Added Docker template for access to EFS
• Added/updated pre-commit hooks
• Added support for Python 3.12

Full Changelog

• XTCE decom with CoDICE example by @GFMoraga in #72
• Poetry docs by @maxinelasp in #76
• fixed linting issues by @GFMoraga in #87
• docs: add sdhoyt as a contributor for doc by @allcontributors in #89
• docs: add GFMoraga as a contributor for maintenance by @allcontributors in #90
• DOC: Update sphinx references by @greglucas in #92
• TST: Add coverage to testing pipeline by @greglucas in #80
• Adding documenation for pull request review standards by @maxinelasp in #82
• Made tools directory and updated .toml by @GFMoraga in #84
• Issue management documentation by @sdhoyt in #85
• SDC Test Plan docs by @sdhoyt in #88
• Init commit of IDEX packet parser by @bryan-harter in #79
• Adding CoDICE Event data + Species counts packet definitions for L0 by @GFMoraga in #106
• Xtce generator by @maxinelasp in #145
• Xtce generator updates by @tech3371 in #155
• Lo pkt definitions for housekeeping, sectored, angular,and priority counts by @GFMoraga in #158
• Xtce IntegerParameterType fixes by @tech3371 in #159
• Commit for the devcontainer/dockerfile needed for Codespaces by @bryan-harter in #78
• Handle Telem Def Nans by @sdhoyt in #161
• SWE science L1A algorithm by @tech3371 in #154
• Added rest of SWE packet definitions by @tech3371 in #160
• New tools documentation by @GFMoraga in #163
• Updated xtce files with updated xtce-generator by @GFMoraga in #173
• L0 Decom for Ultra by @laspsandoval in #128
• DOC: Add autosummary templates and update docstrings for code by @greglucas in #171
• Ruff docs by @greglucas in #174
• Extracting and adding new data to the IDEX L1 by @bryan-harter in #162
• docs: add laspsandoval as a contributor for code by @allcontributors in #181
• docs: add bryan-harter as a contributor for code by @allcontributors in #182
• SIT-2 Release [dev] [v0.1.x] by @bourque in #180
• New SWE test and validation data by @tech3371 in #178
• Glows Decom work by @maxinelasp in #175
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #183
• Fixed xtce typo and updated codice xtce files by @GFMoraga in #185
• MNT: Updating settings for codecov by @greglucas in #245
• Updating GLOWS XTCE files with generator bugfix by @maxinelasp in #244
• Test CCSDS header across all instrument packet definitions by @bourque in #184
• Update release workflow to reflect use of 'version' branches by @bourque in #257
• Glows L0 changes to data class to accomodate L1A needs by @maxinelasp in #264
• Housekeeping data testing and validation for CoDICE l0 by @GFMoraga in #176
• L1 cdf creation by @bryan-harter in #179
• initial hit l1a decom by @sdhoyt in #164
• I-ALiRT: L0 parsing by @laspsandoval in #246
• CDF documentation update by @bryan-harter in #273
• Create CDF class based system by @maxinelasp in #272
• SWE L1B implementation and updates to L1A by @tech3371 in #253
• CoDICE decompression algorithms for science data by @bourque in #278
• IMAP-Hi XTCE and initial Decom work by @tech3371 in #282
• updates to IMAP-Hi and SWE's document by @tech3371 in #283
• IMAP Lo XTCE Definitions by @sdhoyt in #275
• Add CoDICE API reference docs by @bourque in #285
• CI: Update codecov to target 90% for the project by @greglucas in #284
• Doc configuration updates by @greglucas in #286
• Initial CoDICE L1A Processing Algorithm by @bourque in #288
• SWAPI XTCE and utils code by @tech3371 in #291
• Add file naming conventions documentation to style guide by @bourque in #292
• Documentation cleanup/renaming effort by @maxinelasp in #290
• Added eu analog conversion to test_decom by @GFMoraga in #274
• Instrument processing command line utility by @bourque in #266
• Foundational SPICE tools by @laspsandoval in #279
• Add ruff check for module docstrings by @bourque in #294
• Updated the pkt def xtce by @GFMoraga in #298
• Add instructions for rebasing in git workflow docs by @bourque in #299
• Include expected descriptors in filename conventions docs by @bourque in #297
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #301
• Mag L0/Decom work by @maxinelasp in #289
• Glows L1A Processing Algorithm by @maxinelasp in #287
• Setup docker template access to EFS...

v0.1.0

This release marks the successful completion of SIT-2. Further information about what was tested in SIT-2 can be found in this galaxy page and the SIT-2 GitHub Project Board.

Highlights

• Added project documentation (via Sphinx & ReadTheDocs), including Style Guide, development practices, and API reference
• Added Actions workflow to automatic documentation builds
• Added Actions workflow to automatic deployment to PyPI upon release
• Added pre-commit hooks
• Added Issue and Pull Request templates
• Added all-contributors section in README

Full Changelog

• PR template by @sdhoyt in #3
• SWE packet decom example by @tech3371 in #1
• Code of Conduct by @bourque in #4
• MNT: Adding more pre-commit hooks by @greglucas in #5
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #14
• Merge main to dev by @greglucas in #20
• Adding documentation builds by @greglucas in #15
• Add All Contributors section to README by @bourque in #25
• docs: add greglucas as a contributor for code, bug, and 5 more by @allcontributors in #27
• docs: add tech3371 as a contributor for code, bug, and 5 more by @allcontributors in #28
• docs: add sdhoyt as a contributor for code, bug, and 5 more by @allcontributors in #32
• docs: add GFMoraga as a contributor for code, bug, and 5 more by @allcontributors in #33
• docs: add bourque as a contributor for code by @allcontributors in #26
• docs: add maxinelasp as a contributor for code, and review by @allcontributors in #34
• adding templates for issues by @GFMoraga in #18
• Style Guide by @bourque in #19
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #21
• Added yaml file for read the docs by @sdhoyt in #42
• BLD: Update Poetry lock file for Poetry v1.5.0 by @greglucas in #41
• Updating documentation by @maxinelasp in #46
• adding module path in imap_processing - fixes by @tech3371 in #47
• Add no-commit-to-branch pre-commit hook by @bourque in #50
• Convert style guide from markdown to rst by @bourque in #51
• Break up style guide into multiple pages by @bourque in #53
• docs: add maxinelasp as a contributor for doc by @allcontributors in #56
• docs: add GFMoraga as a contributor for review by @allcontributors in #57
• docs: add greglucas as a contributor for review by @allcontributors in #58
• docs: add bourque as a contributor for review by @allcontributors in #59
• docs: add tech3371 as a contributor for review by @allcontributors in #60
• docs: add sdhoyt as a contributor for review by @allcontributors in #62
• docs: add laspsandoval as a contributor for review by @allcontributors in #61
• Document Versioning Schemes by @bourque in #54
• Document Release Workflow by @bourque in #55

Full Changelog: https://github.com/IMAP-Science-Operations-Center/imap_processing/commits/v0.1.0