GCRCatalogs v1.0.4

This release will be the first version to appear on conda-forge.

Changelog

• Dependencies clean up

GCRCatalogs v1.0.3

GCRCatalogs v1.0.3 includes:

• one new catalog: dc2_object_run2.2i_dr6_wfd_matched (thanks to @fjaviersanchez)
• minor edits on the listing of truth catalogs (thanks to @JoanneBogart)

This version will soon be available on all DESC environments (thanks to @heather999). Use desc-python-bleed for immediate use.

GCRCatalogs v1.0.2

GCRCatalogs v1.0.2 is bug fix release.

Bugs fixed

Mismatched tracts specified in dc2_object_run2.2i_dr6_wfd_with_metacal are now fixed (thanks to @fjaviersanchez @heather999)

GCRCatalogs v1.0.1

GCRCatalogs v1.0.1 is bug fix release.

Bugs fixed

• Path of dc2_object_run2.2i_dr6_wfd_v1_with_metacal fixed. Note: general users should use dc2_object_run2.2i_dr6_wfd_v1_with_metacal. (Thanks to @combet @boutigny @heather999.)

GCRCatalogs v1.0.0

We are happy to announce the v1.0.0 release of GCRCatalogs. This release includes the (first) complete data set of the DC2 (Run 2.2i) DR6 WFD, and several other new catalogs.

New Catalogs for DC2 (Run 2.2i) DR6 WFD

• dc2_object_run2.2i_dr6_wfd: Object catalog of DC2 (Run 2.2i) DR6 WFD
• dc2_object_run2.2i_dr6_wfd_with_metacal: Object catalog + metacal of DC2 (Run 2.2i) DR6 WFD

Thanks to the whole DC2 team for delivering these data products! Photo-z and matched catalogs for dc2_object_run2.2i_dr6_wfd will be made available soon.

Additional new catalogs

• dc2_object_run2.2i_dr6c_matched_addon: CosmoDC2-matched object catalog for the DR6c (a preview of DR6 WFD). Thanks to @fjaviersanchez.
• photoz_SKRF_v1_for_cosmoDC2_v1.1.4_small: Random-forest PZ for cosmoDC2 small, generated by Olivia/Markus. Thanks to @sschmidt23 for adding this.

This release will be installed on DESC environments on NERSC shortly (thanks to @heather999). Note that you can also use desc-python-bleed to access the master branch (build every Monday).

Please report any issues/bugs by opening an issue. You can ask questions in the #desc-dc2-users channel of the LSSTC slack team.

GCRCatalogs v0.19.0

This release (v0.19.0) of GCRCatalogs includes several new catalogs, including new ML-based photo-z for cosmoDC2, a pre release of Run 2.2i DR6 catalogs, and truth catalogs for Run 2.2i.

New Catalogs

Photo-z catalogs for cosmoDC2

A ML-based photo-z (using flexzboost) has been added (listed below), thanks to @sschmidt23. In addition, the performance of the photoz composite catalogs has been improved.

• cosmoDC2_v1.1.4_image_with_photozs_flexzboost_v1
• cosmoDC2_v1.1.4_small_with_photozs_flexzboost_v1

Run 2.2i DR6

Thanks to @johannct and the whole DC2 team. Note: DR6 corresponds to the first 5 years of data.

Run 2.2i DR6c: the latest pre-release of DR6

• dc2_object_run2.2i_dr6c: 165 tracts (in WFD region) of DR6 object catalog
• dc2_object_run2.2i_dr6c_with_metacal: 159 tracts (in WFD region) of DR6 object+metacal catalog

Run 2.2i DR6a: an earlier pre-release of DR6

• dc2_object_run2.2i_dr6a: 78 tracts (in WFD region) of DR6 object catalog
• dc2_object_run2.2i_dr6a_with_metacal: 63 tracts (in WFD region) of DR6 object+metacal catalog
• dc2_object_run2.2i_dr6a_with_photoz: 78 tracts (in WFD region) of DR6 object catalog with photo-z
• dc2_object_run2.2i_dr6a_matched_addon: 78 tracts (in WFD region) of DR6 object catalog with matched truth info

*Note: dc2_object_run2.2i_dr6 has been temporarily removed to avoid confusion. It will be added back when the full DR6 data set is ready. For now, use _dr6a or Use _dr6c based on your need.

Parquet-based truth catalogs for Run 2.2

@JoanneBogart has made most of the truth catalogs for Run 2.2 available via GCRCatalogs. These truth catalogs can also be accessed via PostgreSQL.

• dc2_truth_run2.2i_galaxy_truth_summary
• dc2_truth_run2.2i_sn_truth_summary
• dc2_truth_run2.2i_sn_variability_truth
• dc2_truth_run2.2i_star_lc_stats
• dc2_truth_run2.2i_star_truth_summary
• dc2_truth_run2.2i_star_variability_truth

This release will be installed on DESC environments on NERSC shortly (thanks to @heather999). Note that you can also use desc-python-bleed to access the master branch (build every Monday).

Please report any issues/bugs by opening an issue. You can ask questions in the #desc-dc2-users channel of the LSSTC slack team.

GCRCatalogs v0.18.1

This release contains a bug fix to correct the definition of psf_fwhm_{band} in object catalogs (thanks to @wmwv).

GCRCatalogs v0.18.0

This release (v0.18.0) contains an important new feature (deprecation warning), and the addition of several new catalogs, including the Run 2.2i DR6 Object Catalog.

New Feature

We start to add deprecation warnings to some older catalogs that we recommend users to stop using and switch to newer alternatives. The deprecated catalogs can still be loaded and used, but a deprecation warning will show up at load time. If you find your analysis relies on a specific version of catalog that have been deprecated, please open an issue.

New Catalogs

• dc2_object_run2.2i_dr6: 78 tracts of Run 2.2i DR6 is now available. (Thanks to @johannct and the DC2 Team!)
• cosmoDC2_v1.1.4_redmapper_v0.5.7: An updated RedMapper catalog for cosmoDC2. (Thanks to @erykoff)

Catalog Changes

• Several photo-z catalogs have been renamed for a consistent naming scheme. See this Confluence page for the list of the new set of photo-z catalog names. We preserve backward compatibility for several frequently used photo-z catalogs (i.e., the old catalog names can still be used, but users will see a deprecation warning). (Thanks to @sschmidt23)

This release will be installed on DESC environments on NERSC shortly (thanks to @heather999). Please report any issues/bugs by opening an issue.

GCRCatalogs v0.17.0

This release (v0.17.0) contains many under-the-hood changes, in particular, the physical location of all catalog files have been updated (thanks for the help from @JoanneBogart @heather999).

New feature

• New options name_startswith and name_contains in GCRCatalogs.get_available_catalogs. For example, one can now run:

  GCRCatalogs.get_available_catalogs(names_only=True, name_contains="object")

  to get all the catalog names that contain "object".

New Catalogs

• buzzard_v2.0.0_4 : another realization of Buzzard 2.0 (thanks to @j-dr)

Catalog changes (breaking backward compatibility):

• baseDC2_5000 has been renamed to base5000
• hsc-pdr1-xmm has been removed.

This release will be installed on DESC environments on NERSC shortly (thanks for @heather999). Please report any issues/bugs by opening an issue here.

GCRCatalogs v0.16.1

New catalogs were added in this release (v0.16.1):

• dc2_object_run2.2i_dr3_with_photoz: A composite static object catalog that includes the photo-z add-on (thanks to @sschmidt23; see documentation here (link for DESC members only)).
• baseDC2_5000_v1.1.1: (not intended for general use) base catalog for the upcoming sky catalog 5000 (thanks to @evevkovacs)