Skip to content

Latest commit

 

History

History
972 lines (790 loc) · 51 KB

NEWS.md

File metadata and controls

972 lines (790 loc) · 51 KB

DQAstats NEWS

Unreleased (2024-06-04)

New features

  • moving pdf-creation to quarto (5391f1b)

Bug fixes

  • fixed issue with copying of final pdf-report (008dc28)
  • specifing min required version for quarto (9cc7a55)
  • updated code; moved template rmd to qmd (b9a7530)
  • rmd file (ae4f067)
  • no more filter error (34a9bc4)
  • fixed dplyr residual stuff (8f390a5)
  • fixed error in time_compare (83ba875)
  • fixed utils::head declaration (c0febd0)
  • convert Date to character, update Readme (3789f66)

Tests

CI

Other changes

  • reverted rv_list to rv again (f44a854)
  • removed as.list(rv) again (017bb49)
  • changed report-generation (ac07d40)
  • merged both branches (7aa766f)
  • fixed errors (8702985)
  • re-introduced missing pdf-copying (4f6a7d5)
  • fixed all changes that have not been merged before (d370e06)
  • added latest enhancements from dev-branch (55b011b)
  • updated dev-stuffs (50f0b51)
  • updated tests (546ad57)
  • merged latest developments into colored_diff_summary (41da740)
  • moved vignette engine to quarto (87defba)
  • renamed create_markdown to create_pdf_report (dd26b08)
  • updated automated generation of readme (9b286bc)
  • added dqa-dqastats.wiki to ignore (3a80262)
  • updated desc and news.md (e0678bb)
  • merged fixed ci into tc branch (090cd16)
  • merged latest changes into time_compare (1e57f52)
  • get_timestamp_items to separate function (f59557a)
  • started with review (57a201a)
  • prep new dev-version (d1f2610)

Full set of changes: v0.3.4...008dc28

v0.3.4 (2024-04-04)

Bug fixes

  • fixed issues in vignette (f67cb85)
  • fixed vignette also for windows (76b45d5)
  • using last working version of dataquier datasets (b30f7b0)

CI

  • updated checkout tags for github actions (3470aeb)

Other changes

  • updated news.md (3fa8fc4)
  • updated cran-comments (e7faf98)
  • updated rocker image tag to rocker/verse:4.3.2 (f7cdf21)
  • updated to latest changes (19a048c)
  • merged latest changes (1580fd1)

Full set of changes: v0.3.3...v0.3.4

v0.3.3 (2023-07-20)

Bug fixes

  • set eval=FALSE for vignette on windows (502dcfb)
  • solving cran issues (b1344f3)
  • hot-fix to resolve cran errors (482ea46)
  • checking of empty restricting_date_format (a847ba2)
  • fixed typo (5490bf4)
  • working on getting dates fixed for oracle (e3345cc)
  • date-formatting for oracle (4398f89)
  • replace as also for no time filtering (d5a2444)

Docs

  • switched to building man pages with markdown (fc16321)

Other changes

Full set of changes: v0.3.2...v0.3.3

v0.3.2 (2023-01-23)

New features

  • do not read sqls from file if loaded elsewhere (e3e799b)

Refactorings

  • sql date restrictions now use between (5d492c1)
  • namespace imports to zzz.r (8d8354f)

CI

Other changes

  • updated cran errors url (763a983)
  • updated description and news.md (567fce8)
  • updated news.md (9c1fde0)
  • updated news.md (b44da32)
  • better logging messages to understand origin of sql statements (fa8c4e2)
  • updated rbuildignore (77a1e9c)
  • updated news.md (7bb425d)
  • news.md now with autonewsmd package (025d3b9)
  • updated descr (4130add)

Full set of changes: v0.3.1...v0.3.2

v0.3.1 (2022-06-27)

Bug fixes

  • fixed wrong calculation of target-completness; closes #50 (60830d5)
  • fixed checking if plausibility checks are possible with subset of data elements (e7c9320)
  • json-object to character for storing in pl-list (683a355)

Refactorings

  • failing if info from mdr is lacking for plausibilities (fc1d40c)

Build

  • dizutils dependency to 0.1.1 (bb20c6d)

Tests

  • new unit tests for datetime-restriction (876a026)
  • added missing lintr dependency to suggests (ee98ebc)
  • added linting tests (89df2c7)

CI

Other changes

  • updated lintr (f95d2de)
  • preparing next cran-release (ae09c62)
  • added demo sitename.json (69a9706)
  • replaced “data system” with “database” (60655cd)
  • updated description (d85e4f6)
  • making json prettier (0498fee)
  • updating description and news.md (3fa87cb)

Full set of changes: v0.3.0...v0.3.1

v0.3.0 (2022-05-19)

New features

  • added logo (fb697c1)
  • ‘no data available’ now available for conformance checks (94279d7)
  • added creation of temporal view to sql display (58f8775)
  • more flexibility to use read_mdr (c96a30c)
  • now returning modified sql statements for pdf / gui-button (152bd52)
  • added new constraints functionality for datetime variables (04f8cf3)
  • adding functionality for datetime constraints (wip) (9752969)

Bug fixes

  • fixed rendering of report when datetime future checks present (a427c4a)
  • error with diztools::is.empty (867d659)
  • fixed displaying of conformance results, when no data available to perform conformance checks (73eae27)
  • fixed recognition of empty data for datetime variables (e8f6c4f)
  • fixed missing of view creation / deletion in displayed sqls (895d9b0)
  • fixed issues when source_table_name included where-clause (e4dc982)
  • only the first sql showed the view-creation sql. This is now fixed. (b69c716)
  • added all view creations to display-sql where only the last one was (0310356)
  • corrected hierarchy of outlist list to transform variables 2 (22b5c16)
  • corrected hierarchy of outlist list to transform variables (090e7e4)
  • replaced wrong argument to future::plan: ‘worker’ to ‘workers’ (b8a4e32)
  • fixed errors in vignette (74c8e0c)
  • better error handling for parallel backend (94727be)
  • added on.exit for future plan (5b4113b)
  • parallel=FALSE by default (d11943b)
  • sql statements to target system, if source=target (9f71b7f)

Refactorings

  • formating value conformance results for reuse in dqagui (a1e0f97)
  • improved detection of missing datetime data (b6d78ad)
  • added ‘no data available’ category for etl checks (23c6632)
  • enhanced formatting of displayed sqls (6b10231)

Tests

Docs

  • replace missing definition with informatino (ffa1e7b)
  • removed dataquier as soft dependency; now loading datasets directly from url in vignette (bad2da4)
  • added wiki-page for gui to vignette (f4339c8)
  • fixed wrong paths in vignette (4c18db2)
  • update vignette (767a677)
  • adding vignette that analyzes dataquier ship-dataset (b92d55a)

Other changes

  • preparing new cran release v0.3.0 (288a429)
  • updated description / news.md (b097bcb)
  • removed unnecessary paste (85c3866)
  • updated version, news.md, etc. (603897e)
  • added linebreake after sql-where (15921fc)
  • function create_markdown to extra file (4e565f0)
  • updated news.md (c8dae31)
  • updated news.md (1e17de9)
  • added diztools version to logging (6d94f8e)
  • updated package metadata and news.md (3402dc7)
  • updated news.md (f76c07c)
  • updated news.md; fixed git config to work with auto-changelog again (e9bbed7)
  • update debugging.info (90d2f32)
  • updated debugging info (6b4917c)
  • removed comments from display sql (ce0dd47)
  • merged development (fc09efc)
  • extened SQL hints in display message (23d8d9d)
  • updated news.md (8c24f8a)
  • updated news.md (8ebda0a)
  • updated news (d7bbbe6)
  • added feedback msg to error (ba13828)
  • updated cran comments (e179ddd)
  • added unname after ncores (9b9ab35)
  • outscourced dqagui deployment to dqagui (1aa545b)
  • added dqastats and dqagui docker-compse files (4215868)
  • added dqagui image deployment (ef5c249)
  • fixed typo in vignette (1f00aa1)
  • updated news.md (4098434)
  • fixed localhost url in vignette (55c9210)
  • removed unnecessary columns from example mdr (3579cd6)

Full set of changes: v0.2.6...v0.3.0

v0.2.6 (2022-03-02)

Bug fixes

  • renaming data.table columns when modified by sql (708fd4c)

Other changes

  • updated news.md (de0b617)
  • updated version; news.md (156c08a)
  • added error message to agrepl command (60f8c8a)
  • updated readme to comply with diztools/dizutils (948c5d1)
  • updated readme to comply with diztools (aa85f3c)
  • removed gitlab badges from readme (384b017)

Full set of changes: v0.2.5...v0.2.6

v0.2.5 (2022-02-21)

Refactorings

  • switch to diztools dependency (9a6794c)

Other changes

  • updated dizutils version (1ab17f1)

Full set of changes: v0.2.4...v0.2.5

v0.2.4 (2022-02-11)

Other changes

  • preparing cran update (269ad14)
  • updated news.md, adaptions to new diztools/dizutils (c038c44)
  • updated news.md and description (f6b315f)
  • some revisions to file path handling to avoid warnings (6b57449)
  • updated news.md (90725c2)

Full set of changes: v0.2.3...v0.2.4

v0.2.3 (2022-02-04)

New features

  • added datamap variables; updated tests accordingly; added unique plausi check irregularity (cf384a6)
  • updated docker image (15c18a8)
  • added demo email.yml file (907cd24)
  • removed e1071 dependency; expect value_set to be array (ebfa59b)

Bug fixes

  • fallback in csv path extraction to handed over variable (5dee04e)

Tests

  • deleting logfiles after each test (123c172)
  • adapt checks to MDR columns (31562c8)

Docs

Other changes

  • wrap examples into dont-test due to long runtime on cran (a588fa3)
  • updated rbuildignore, gitignore, news.md (2f478eb)
  • updated description and news.md (cf545bb)
  • updated version for cran submission (9b19b3e)
  • updated news.md; .rbuildignore (a3e9060)
  • updated date range in license statements (b10d53b)
  • added env var content to logging msg (936c5b4)
  • re-added roxygennote (50b616f)
  • updated url in readme (535df53)
  • removed print-statement from datetime_restrictions (e48d477)
  • updated MDR and example data (6c8a4f4)
  • repair codecov badge (a9ad523)
  • fixed wrong formatting of markdown in readme.md badges section (80afe85)
  • removed html comments (2e36321)
  • reactivated cran-badges in readme.md (5055a0a)

Full set of changes: v0.2.2...v0.2.3

v0.2.2 (2022-01-12)

Bug fixes

  • merging origin/development (bd79108)

Refactorings

  • updated K8s manifest and docs (0026dfc)

Tests

  • fix failing cran checks due to failing unit tests in rdevel (676bfcb)

Docs

  • added @chgl / @christian.gulden to thanks (4c1dddf)
  • updated k8s docs (947c0a6)

Other changes

Full set of changes: v0.2.1...v0.2.2

v0.2.1 (2022-01-04)

New features

  • added script to run testdata (9a347df)
  • added kubernetes manifest (f0ca10a)

Bug fixes

  • will not fail when tinytex is missing (7d6748d)
  • removed tinytex-installation from report.r due to cran policy violation (79c7a87)

Docs

  • cran-installation to readme (05785d0)

Other changes

  • updated news.md (a38d63b)
  • fixed typo in rbuildignore (fd782e8)
  • updated news.md (8931b2c)
  • detailed error message for tinytex (b956b76)
  • updated news.md (5d78080)
  • allow news.md in .gitignore and add to .Rbuildignore (e469966)
  • added creation of news.md to devstuffs.R (6f551b8)

Full set of changes: v0.2.0...v0.2.1

v0.2.0 (2022-01-03)

New features

  • new possibility for time constraints using sql modifications (933bcf3)
  • added build script and docker images (21bbe79)
  • switched to rocker-verse with included latex (b4abb96)
  • added demo-dockerfile and dc (97f2f85)
  • added run_once function for container runs (f762009)
  • added run_once.R file for one-shot-container-runs (7c7ac8c)

Bug fixes

  • added xcolor to latex deps to avoid latex crashing in the image (961958a)
  • build script image tagging fixed (8dabd0d)
  • moved run_once file to the right folder (1f6b5a1)

Docs

  • added hints for rocker/verse to readme (fcc95c2)
  • updated readme (8f09194)

Other changes

  • updated image and added renovate (b8463b1)
  • added printing of current versions to dqa function (206f39c)
  • added tinitex dependency (f85cf43)
  • switched to dev version of miracumdqa (d465cae)
  • fixed intendation in readme (cf23a26)
  • added miracumdqa and docs (bdc42b0)
  • added tinytex packages to dockerfile (88f78d4)
  • switched to variables in docker compose (0352144)
  • catched fromjson error (0a96b58)
  • added logmessages (1bed01a)
  • removed run_once() function (8bfe9e5)

Full set of changes: v0.1.7...v0.2.0

v0.1.7 (2021-07-01)

New features

  • new release (b60d779)
  • added uniqueness and atemporal plausibility checks (ff37132)
  • integrated support for non-timestamp columns for time-filtering (2608a86)
  • integrated temporal filtering (3692da9)
  • added time filtering function for databases (2da4a6f)
  • added time-filtering for csv files (591c720)

Bug fixes

  • report display if no datamap variable was analysed (2c4283e)
  • if analysis was performed without elements from the datamap no error is displayed now (b3681bf)
  • improved error handling with missing constraints (337d0a0)
  • removing undefined from mdr filtering (94e76ba)
  • renamed format_POSIXct to lowercase (9306751)
  • formatting error (1a551d8)
  • made demo files working (26c864c)
  • added support for datetime_format in conformance checks (bde1f22)
  • changed default format for date constraint (57fcc54)
  • fixed bug where empty filter-cols crashed the script (1a1e7c4)
  • adapted to new version of DIZutils::db_connection (73ce62b)
  • fixed date format in db-import (8b29f2b)

Refactorings

  • fixed gh action warnings (8f7d207)
  • improved style of the report (61d9725)
  • updated restricting date calls (38b54db)

CI

Docs

  • added key docu in function apply_time_restriciton() (cf83793)
  • fixed optionality of parameter in apply_time_restriciton (a49a8db)

Other changes

  • updated desc (52b97b1)
  • removed uncommented code (8126666)
  • version increment to 0.1.6.9013 (91aba4b)
  • version increment (1ea4875)
  • added findme in multicore functions (78cbcf5)
  • added support for custom format for time filtering csv files (85ac59a)
  • added check_date_restriction_requirements as external function (55ecb07)
  • fixed potential use of uncommented code (02f6250)
  • moving forwards to temporal restrictions (43f946a)

Full set of changes: v0.1.6...v0.1.7

v0.1.6 (2021-02-18)

Bug fixes

  • updated dizutils version (f4a6182)
  • fixed error with missing date_format (31e60a4)
  • custom setting inputs (from the ui) are now used as db-connection parameters (5fbd23f)

Refactorings

  • reverted changes in example mdr (2c65a18)
  • preparation for new release v0.1.6 (854d3b5)

CI

  • run ci also for new tags (bc338b2)
  • xied ci (94bcf25)
  • update (d917729)
  • excluded building a new base_image for all dev-commits (e4cbc09)
  • fixed ci pipeline (816dc34)
  • fix (84ef752)
  • updated ci for updateing the base_image in ci-run (c6cc1ee)
  • updated ci (55b7631)
  • fixed ci (980ac31)
  • removed apk (98cd55b)
  • updated harbor url (5af0465)
  • docker login (53348bb)
  • fixed docker login (f9b977b)
  • ci fixes for harbor login (9b79009)
  • updated ci (d5040c1)
  • added dqa_base_image as ci-source (7f595fd)
  • switched from install.packages() to install2.r due to speed improvements (0ea737e)
  • switched from install.packages() to install2.r due to speed improvements (a619a59)
  • switched from install.packages() to install2.r due to speed improvements (be5666c)
  • switched from install.packages() to install2.r due to speed improvements (8dfcffd)
  • switched from install.packages() to install2.r due to speed improvements (dfe9f70)
  • switched from install.packages() to install2.r due to speed improvements (6ca1dd8)

Full set of changes: v0.1.5...v0.1.6

v0.1.5 (2020-05-07)

Full set of changes: v0.1.4...v0.1.5

v0.1.4 (2020-04-28)

Full set of changes: v0.1.3...v0.1.4

v0.1.3 (2020-04-20)

Full set of changes: v0.1.2...v0.1.3

v0.1.2 (2020-03-20)

Full set of changes: v0.1.1...v0.1.2

v0.1.1 (2020-03-18)

Full set of changes: v0.1.0...v0.1.1

v0.1.0 (2020-03-16)

Full set of changes: v0.0.7...v0.1.0

v0.0.7 (2020-02-25)

Full set of changes: v0.0.6...v0.0.7

v0.0.6 (2020-01-29)

Full set of changes: v0.0.5...v0.0.6

v0.0.5 (2019-12-02)

Full set of changes: v0.0.4...v0.0.5

v0.0.4 (2019-11-15)

Full set of changes: v0.0.3...v0.0.4

v0.0.3 (2019-11-12)

Full set of changes: v0.0.2...v0.0.3

v0.0.2 (2019-09-27)

Full set of changes: v0.0.2.9000...v0.0.2

v0.0.2.9000 (2019-08-30)

Full set of changes: v0.0.1.9000...v0.0.2.9000

v0.0.1.9000 (2019-08-20)

Full set of changes: v0.0.0.9003...v0.0.1.9000

v0.0.0.9003 (2019-08-14)

Full set of changes: v0.0.0.9002...v0.0.0.9003

v0.0.0.9002 (2019-08-08)

Full set of changes: 0567007...v0.0.0.9002