Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Cleanup Stream events #23

Merged
merged 1 commit into from
Nov 19, 2024
Merged

Conversation

jachym-tousek-keboola
Copy link
Contributor

@jachym-tousek-keboola jachym-tousek-keboola commented Nov 5, 2024

Cleaning up the event schema. IDs are in params, statistics and err in results for all events.

It could be argued that fileImport and sliceUpload could have everything in results as they're background operations but for telemetry team convenience I think it's better to have the ids consistently in params.

Don't merge yet, we need to wait for telemetry team to update things first. I just want to validate it with you first.

Copy link
Contributor

@Matovidlo Matovidlo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are we sure that we never purge anything? In case we purge something due to not having infinite storage, this event would be added so the telemetry is complete. I understand that we do not need it now, but in couple if years some cleanup has to be performed.

@jachym-tousek-keboola jachym-tousek-keboola force-pushed the jt-cleanup-stream-events branch 2 times, most recently from a03d99a to 93dfe1c Compare November 6, 2024 08:48
@jachym-tousek-keboola
Copy link
Contributor Author

okay, added the purge event back

Copy link
Contributor

@tomasfejfar tomasfejfar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Kromě toho required results pokud tam mají být statistiky mi to přijde OK. Ale jak chceš...

schema/ext.keboola.stream.fileImport.json Outdated Show resolved Hide resolved
schema/ext.keboola.stream.sourceCreate.json Show resolved Hide resolved
@jachym-tousek-keboola jachym-tousek-keboola merged commit 1a09c1c into main Nov 19, 2024
1 check passed
@jachym-tousek-keboola jachym-tousek-keboola deleted the jt-cleanup-stream-events branch November 19, 2024 08:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants