Code

do some duplicate check adjustments#119

Code

Merged

ludwiglierhammer merged 40 commits intoglamod:mainglamod/cdm_reader_mapper:mainfrom ludwiglierhammer:dups_againludwiglierhammer/cdm_reader_mapper:dups_againCopy head branch name to clipboardOct 21, 2024

+722-219

Commits

Commits on Oct 11, 2024

• optionally, ignore block_on values

  ludwiglierhammer

  committed
  eea6118

  Copy full SHA for eea6118

• adjust tests

  ludwiglierhammer

  committed
  e08e80c

  Copy full SHA for e08e80c

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 28d2bb4
  pre-commit-ci[bot]

  committed
  28d2bb4

  Copy full SHA for 28d2bb4

• uncomment usesd lines

  ludwiglierhammer

  committed
  6a8fd4e

  Copy full SHA for 6a8fd4e

• delete unused function

  ludwiglierhammer

  committed
  505edfb

  Copy full SHA for 505edfb

• adjust expected values

  ludwiglierhammer

  committed
  9e27304

  Copy full SHA for 9e27304

• do not loop over ignore_columns

  ludwiglierhammer

  committed
  7098c8d

  Copy full SHA for 7098c8d

• new class for using recordlinkage Comparer

  ludwiglierhammer

  committed
  ff3ff5e

  Copy full SHA for ff3ff5e

• reduce indentation

  ludwiglierhammer

  committed
  bb2fb36

  Copy full SHA for bb2fb36

• optionally, set new offsets

  ludwiglierhammer

  committed
  e600c4e

  Copy full SHA for e600c4e

• add some more tests

  ludwiglierhammer

  committed
  a6ac1ff

  Copy full SHA for a6ac1ff

Commits on Oct 14, 2024

• Merge branch 'main' into dups_again

  ludwiglierhammer

  authored
  614f733

  Copy full SHA for 614f733

• outsourcing expected values etc

  ludwiglierhammer

  committed
  d8b2722

  Copy full SHA for d8b2722

• outsourcing settings

  ludwiglierhammer

  committed
  c4752d4

  Copy full SHA for c4752d4

• make copy of method and compare kwargs

  ludwiglierhammer

  committed
  b24f466

  Copy full SHA for b24f466

Commits on Oct 15, 2024

• Merge branch 'main' into dups_again

  ludwiglierhammer

  authored
  4affd2d

  Copy full SHA for 4affd2d

• add_duplicates: use pandas apply funciton instad of for loop

  ludwiglierhammer

  committed
  8349651

  Copy full SHA for 8349651

• flag_duplicates: use pandas.apply instead of for loop

  ludwiglierhammer

  committed
  5be0c3d

  Copy full SHA for 5be0c3d

• add_history: get rid of apply function

  ludwiglierhammer

  committed
  c6ba1fe

  Copy full SHA for c6ba1fe

• adjust expected values

  ludwiglierhammer

  committed
  3fb3010

  Copy full SHA for 3fb3010

• do not use for loops

  ludwiglierhammer

  committed
  4f2d8a3

  Copy full SHA for 4f2d8a3

Commits on Oct 16, 2024

• update expected and manipulated values

  ludwiglierhammer

  committed
  543e857

  Copy full SHA for 543e857

• remove_duplicates: use MultiIndex function instead of for loop

  ludwiglierhammer

  committed
  b793aa1

  Copy full SHA for b793aa1

• pass include_groups=False to DataFrameGroupBy.apply

  ludwiglierhammer

  committed
  15b1cee

  Copy full SHA for 15b1cee

• add changes

  ludwiglierhammer

  committed
  7b2a711

  Copy full SHA for 7b2a711

• set method to step or latitude and longitude check

  ludwiglierhammer

  committed
  97d9fa2

  Copy full SHA for 97d9fa2

• set null to 9999.

  ludwiglierhammer

  committed
  9d39252

  Copy full SHA for 9d39252

• add check for station_spped and station_course

  ludwiglierhammer

  committed
  e9243c1

  Copy full SHA for e9243c1

• add more changes

  ludwiglierhammer

  committed
  26c32da

  Copy full SHA for 26c32da

• set new offsets

  ludwiglierhammer

  committed
  7c196c5

  Copy full SHA for 7c196c5

• add more tests

  ludwiglierhammer

  committed
  9acede8

  Copy full SHA for 9acede8

• cdm_reader_mapper/cdm_mapper/duplicates.py

  Show description for 2b273d1
  ludwiglierhammer

  committed
  2b273d1

  Copy full SHA for 2b273d1

• optionally, re-index data in ascending order according to the number of nulls in each row

  ludwiglierhammer

  committed
  c81a96f

  Copy full SHA for c81a96f

Commits on Oct 17, 2024

• reset index for input data

  ludwiglierhammer

  committed
  c535165

  Copy full SHA for c535165

• flatten list

  ludwiglierhammer

  committed
  85f019f

  Copy full SHA for 85f019f

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 4ad3e89
  pre-commit-ci[bot]

  committed
  4ad3e89

  Copy full SHA for 4ad3e89

Commits on Oct 18, 2024

• reply replacing until keeps and drops differ

  ludwiglierhammer

  committed
  80c8fa4

  Copy full SHA for 80c8fa4

• Merge branch 'main' into dups_again

  ludwiglierhammer

  authored
  2cdc894

  Copy full SHA for 2cdc894

• Merge branch 'main' into dups_again

  ludwiglierhammer

  authored
  76d48ba

  Copy full SHA for 76d48ba

• Update CHANGES.rst

  ludwiglierhammer

  authored
  01ddb73

  Copy full SHA for 01ddb73