All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
##$ What's Changed
- Divergence by @AlecThomson in #79
- Update some imager plots
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.4.0...v2.4.1
Mostly bits to help out a filesystem being sad
- Threadlock cutout writes to prevent dumb errors on Lustre (and maybe elsewhere?)
- Copy holography file to a $MEMDIR if it exists
- Allow validation plots to fail gracefully
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.11...v2.4.0
- Fix l,m calculation for tile offsets (including rotation)
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.10...v2.3.11
- Improve stability with
persist_result=True
anddirs_exist_ok=True
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.9...v2.3.10
- Switch to dynamic versioning
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.8...v2.3.9
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.7...v2.3.8
- Check ionex by @AlecThomson in #74
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.6...v2.3.7
- Add field offsets by @AlecThomson in #72
- Added field/tile seperation calculation and columns
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #65
- Added an auto-purge to temp-image files in imager
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.5...v2.3.6
- Added tarball verification
- Tweaks to petrichor config
- Retry cutout failues
- Reduce validation plot resolution
- Fail if commonbeam is NaN (i.e. whole beam will be blanked)
- Use threadpool for beamcon
- Catch the failure of Voronoi binning
- Fixes to database queries and related structuring
- Catch failure of a validation plot
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.4...v2.3.5
- Polar by @AlecThomson in #71
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.3...v2.3.4
- Reduce number of tasks by @AlecThomson in #70
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.2...v2.3.3
- Queries by @AlecThomson in #69
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.1...v2.3.2
- Validate image by @AlecThomson in #68
- Adds and improves validation plots
- Fixes LINMOS rotation parameters
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.0...v2.3.1
- Add validation stage to pipeline, including plot artifacts
- Add LINMOS rotation for rotated fields
- Fixes WSClean argument handling and clean thresholds
- Submit by @AlecThomson in #66
- Validate by @AlecThomson in #67
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.2.2...v2.3.0
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #61
- Image fewer than 36 beams by @AlecThomson in #64
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.2.1...v2.2.2
- Use sql by @AlecThomson in #63
- Allow PostgreSQL RACS database to be ingested in
spice_init
- Add helper scipt
create_mongodb.py
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.8...v2.2.1
- Allow SBID to passed as an argument
- This will enable a 'single field mode'
- Database queries / updates changes to support this
- Unified ArgParse mode
- Much easier argument parsing
- Now reused amongst modules
- Fixes to typing
- Much better use of
pathlib.Path
andpandas
- Much better use of
- SBID by @AlecThomson in #62
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.7...v2.1.8
Updated documentation.
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.6...v2.1.7
- Image docs by @AlecThomson in #60
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.5...v2.1.6
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #56
- Tempdir by @AlecThomson in #58
- Clean by @AlecThomson in #59
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.4...v2.1.5
- DR2 preparation improvements by @AlecThomson in #57
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.3...v2.1.4
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.2...v2.1.3
Hotfix updates.
- Base Python version bumped to 3.10 for docs
- Enable
-no-mf-weighting
in WSClean - Ensure FixMS skipped is used in pipeline
- Pass data in correct order to RM-Tools
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.1...v2.1.2
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #48
- Create dependabot.yml by @AlecThomson in #50
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #51
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #52
- In-memory cutouts by @AlecThomson in #53
- @pre-commit-ci made their first contribution in #48
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.0...v2.1.1
- Fix weights by @AlecThomson in #46
- described the scalability of prefect/postgres by @tjgalvin in #44
- Migrate the whole shebang to Prefect by @AlecThomson in #49
Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.0.0...v2.1.0
- Full
prefect
flows and tasks - More
prefect
documentation
- Incorrect image weighting for LINMOS
dask
delayed etc.
pre-commit
hooks for autoformatting checksimager
script for sweet imagingprefect
backbone
Corresponds with DR1 paper.
- Dev by @AlecThomson in #1
- Simplify readme by @AlecThomson in #2
- Don't need these by @AlecThomson in #3
- Clean up tests by @AlecThomson in #4
- Fix scripts and RM-synth by @AlecThomson in #5
- Merge dev by @AlecThomson in #7
- Dev by @AlecThomson in #9
- Remove RACS db by @AlecThomson in #14
- Arrakis by @AlecThomson in #16
- Fix RACS db pathing by @AlecThomson in #15
- Docs update by @AlecThomson in #18
- Dev by @AlecThomson in #23
- Dev by @AlecThomson in #24
- Dev by @AlecThomson in #25
- This changelog!
scripts/tar_cubelets.py
and CLI hookmakecat.py
: Addedflag_blended_components
to identify and flag blended components. Addsis_blended_flag
,N_blended
,blend_ratio
to the catalogue.- Proper logging module
columns_possum.py
: Add new Stokes I fit flags and UCDs (plus others) and descriptionsscripts/casda_prepare.py
: Refactor to make considated products and make CASDA happyscripts/fix_dr1_cat.py
: Added extra columns that needed to be fixed in DR1 e.g. sbid, start_time- Typing in various places
- Renamed
scripts/helloworld.py
toscripts/hellow_mpi_world.py
makecat.py
: Addedcompute_local_rm_flag
functionrmsynth_oncuts.py
Added new Stokes I fit flagsutils.py
: Refactored Stokes I fitting to use dicts to track values- Use local installs of customised packages
submit/casda_pre_prep.sh
submit/casda_prep_test.sh
- ASKAP RACS database as a submodule (changes how
init_databse.py
ingests data)
The before times...