Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

adding indexed created_at column to lineage events table #2299

Merged
merged 5 commits into from
Dec 12, 2022
Merged

adding indexed created_at column to lineage events table #2299

Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
24e07eb
adding indexed created_at column to lineage events table
prachim-collab Dec 8, 2022
67e76d2
populate default values in lineage_events.created_at column
prachim-collab Dec 9, 2022
60ede8c
removing backfill step
prachim-collab Dec 9, 2022
692b8aa
altering type to TIMESTAMP WITH TIME ZONE
prachim-collab Dec 10, 2022
dc70917
adding NULLS LAST in desc index on lineage_events.created_at
prachim-collab Dec 12, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions api/src/main/resources/marquez/db/migration/V54__lineage_events_created_at_indexed.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
-- new column will be created with 'null' filled for existing rows
ALTER TABLE lineage_events ADD created_at TIMESTAMP WITH TIME ZONE;

create index lineage_events_created_at_index on lineage_events (created_at desc NULLS LAST);

-- The new default set to UTC now() will only apply in subsequent INSERT or UPDATE commands; it does not cause rows already in the table to change.
ALTER TABLE lineage_events ALTER COLUMN created_at SET DEFAULT (now() AT TIME ZONE 'UTC')::timestamptz;