Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(data-security): create sensitive columns with case insensitive same column and table names #175

Merged

Conversation

smallsheeeep
Copy link
Contributor

What type of PR is this?

type-bug
module-Data security

What this PR does / why we need it:

The ODC metaDB is case insensitive when calculating unique key. So, if there are two columns with the case insensitive same table name and column name, and add both of them to sensitive columns, exception will be throw.

Solution: Make sensitive columns case insensitive. if there are two columns with the case insensitive same table name and column name, then they cannot be both add to sensitive columns.

Which issue(s) this PR fixes:

Fixes #161

@smallsheeeep smallsheeeep added type-bug Something isn't working priority-medium module-Data security Parent module of data-masking, sensitive rule, masking algorithm, etc. labels Sep 6, 2023
@smallsheeeep smallsheeeep added this to the ODC 4.2.1 milestone Sep 6, 2023
@smallsheeeep smallsheeeep self-assigned this Sep 6, 2023
Copy link
Contributor

@yizhouxw yizhouxw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

unit testing missed

@smallsheeeep
Copy link
Contributor Author

unit testing missed

Done!

Copy link
Contributor

@yhilmare yhilmare left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@smallsheeeep smallsheeeep merged commit 045ff92 into dev/4.2.1 Sep 6, 2023
11 checks passed
@smallsheeeep smallsheeeep deleted the bugfix/gaoda_421_fix_case_insensitive_columns branch September 22, 2023 05:56
yhilmare pushed a commit that referenced this pull request Jan 15, 2024
…me column and table names (#175)

* fix: create duplicated sensitive columns

* fix: import sort

* fix: scan duplicated sensitive columns

* add: unit test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
module-Data security Parent module of data-masking, sensitive rule, masking algorithm, etc. priority-medium type-bug Something isn't working
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

[Bug]: "*.*.*"The path recognition rules are abnormal when scanning desensitized columns
3 participants