Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sanketika-obsrv/issue-tracker#180 feat: API changes to support hudi changes in obsrv #160

Merged
merged 12 commits into from
May 24, 2024

Conversation

GayathriSrividya
Copy link

This PR includes:

Changes in the obsrv APIs to support the Hudi schema.
Updated Datasource CRUD APIs
Updated Query APIs
Added a sample request to the Postman collection of OBSRV APIs.

Type of change

  • Breaking change (fix or feature that would cause existing functionality to not work as expected)

How Has This Been Tested?

  • Tested in local
  • Tested in dev cluster, aws cluster
  • Unittest

Checklist:

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • New and existing unit tests pass locally with my changes
  • Any dependent changes have been merged and published in downstream modules

Copy link
Collaborator

@anandp504 anandp504 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved 👍

@anandp504 anandp504 merged commit 0d63308 into develop May 24, 2024
3 checks passed
@anandp504 anandp504 deleted the api-changes-hudi branch May 24, 2024 08:42
manjudr added a commit that referenced this pull request May 27, 2024
* default config for dataset_config (#99)

* Sanketika-Obsrv/issue-tracker#14: feat: validate sql query (#100)

* Issue #304 datasource configuration changes to support Hudi schema. (#111)

* Sanketika-obsrv/issue-tracker#304: modified mandatory fields for datasource create request (#112)

* Configure the vuln scan for obsrv-api-service (#117)

* Revert "Sanketika-obsrv/issue-tracker#304: modified mandatory fields for data…" (#121)

This reverts commit 0789f3f.

* Revert "Issue #304 datasource configuration changes to support Hudi schema. (…" (#122)

This reverts commit ef918f6.

* Sanketika-Obsrv/issue-tracker#182: added event validation service against schema for particular dataset

* Sanketika-Obsrv/issue-tracker#182: added table name from config

* Sanketika-Obsrv/issue-tracker#182: added validation status in response handler

* Sanketika-Obsrv/issue-tracker#180 feat: API changes to support hudi changes in obsrv (#160)

* Sanketika-obsrv/issue-tracker#304: modified name for lakehouse spec

* #0000 feat: added type column

* #273 feat: API changes to support lakehouse queries

* Sanketika-obsrv/issue-tracker#273 feat: modified datasource apis to default type column and fixed sql query api

* Sanketika-obsrv/issue-tracker#273 feat: updated postman collection and swagger doc

* Sanketika-obsrv/issue-tracker#273 feat: updated testcases for latest changes

* Sanketika-obsrv/issue-tracker#273 feat: removed unnecessary log statements

* Sanketika-obsrv/issue-tracker#273 feat: removed unnecessary flatmapping and await

* Sanketika-obsrv/issue-tracker#273 feat: replaced special characters with underscore in table name

* Sanketika-Obsrv/issue-tracker#180 fix: removed unused constants and table checks in hudi schema

* Sanketika-Obsrv/issue-tracker#180 fix: removed unused constants and table checks in hudi schema

* Release  1.0.6-GA merge fix (#164)

* Release 1.0.4-GA (#105)

* default config for dataset_config (#99)

* Sanketika-Obsrv/issue-tracker#14: feat: validate sql query (#100)

---------

Co-authored-by: harishkumar gangula <harish@sanketika.in>
Co-authored-by: Shreyas Bhaktharam <121869503+shreyasb22@users.noreply.github.com>

* Release 1.0.5-GA (#147)

---------

Co-authored-by: Manjunath Davanam <manjunath@sanketika.in>
Co-authored-by: Shreyas Bhaktharam <121869503+shreyasb22@users.noreply.github.com>
Co-authored-by: Ravi Mula <ravismula@users.noreply.github.com>

---------

Co-authored-by: harishkumar gangula <harish@sanketika.in>
Co-authored-by: Shreyas Bhaktharam <121869503+shreyasb22@users.noreply.github.com>
Co-authored-by: GayathriSrividya <gayathrirajavarapu7@gmail.com>
Co-authored-by: divyagovindaiah <110388603+divyagovindaiah@users.noreply.github.com>
Co-authored-by: yashashk <yashashk@sanketika.in>
Co-authored-by: Manjunath Davanam <manjunath@sanketika.in>
manjudr added a commit that referenced this pull request May 27, 2024
* default config for dataset_config (#99)

* Sanketika-Obsrv/issue-tracker#14: feat: validate sql query (#100)

* Issue #304 datasource configuration changes to support Hudi schema. (#111)

* Sanketika-obsrv/issue-tracker#304: modified mandatory fields for datasource create request (#112)

* Configure the vuln scan for obsrv-api-service (#117)

* Revert "Sanketika-obsrv/issue-tracker#304: modified mandatory fields for data…" (#121)

This reverts commit 0789f3f.

* Revert "Issue #304 datasource configuration changes to support Hudi schema. (…" (#122)

This reverts commit ef918f6.

* Sanketika-Obsrv/issue-tracker#182: added event validation service against schema for particular dataset

* Sanketika-Obsrv/issue-tracker#182: added table name from config

* Sanketika-Obsrv/issue-tracker#182: added validation status in response handler

* Sanketika-Obsrv/issue-tracker#180 feat: API changes to support hudi changes in obsrv (#160)

* Sanketika-obsrv/issue-tracker#304: modified name for lakehouse spec

* #0000 feat: added type column

* #273 feat: API changes to support lakehouse queries

* Sanketika-obsrv/issue-tracker#273 feat: modified datasource apis to default type column and fixed sql query api

* Sanketika-obsrv/issue-tracker#273 feat: updated postman collection and swagger doc

* Sanketika-obsrv/issue-tracker#273 feat: updated testcases for latest changes

* Sanketika-obsrv/issue-tracker#273 feat: removed unnecessary log statements

* Sanketika-obsrv/issue-tracker#273 feat: removed unnecessary flatmapping and await

* Sanketika-obsrv/issue-tracker#273 feat: replaced special characters with underscore in table name

* Sanketika-Obsrv/issue-tracker#180 fix: removed unused constants and table checks in hudi schema

* Sanketika-Obsrv/issue-tracker#180 fix: removed unused constants and table checks in hudi schema

* Release  1.0.6-GA merge fix (#164)

* Release 1.0.4-GA (#105)

* default config for dataset_config (#99)

* Sanketika-Obsrv/issue-tracker#14: feat: validate sql query (#100)

---------

Co-authored-by: harishkumar gangula <harish@sanketika.in>
Co-authored-by: Shreyas Bhaktharam <121869503+shreyasb22@users.noreply.github.com>

* Release 1.0.5-GA (#147)

---------

Co-authored-by: Manjunath Davanam <manjunath@sanketika.in>
Co-authored-by: Shreyas Bhaktharam <121869503+shreyasb22@users.noreply.github.com>
Co-authored-by: Ravi Mula <ravismula@users.noreply.github.com>

* Sanketika-Obsrv/issue-tracker#224: updated the alpine package versions (#165)

---------

Co-authored-by: harishkumar gangula <harish@sanketika.in>
Co-authored-by: Shreyas Bhaktharam <121869503+shreyasb22@users.noreply.github.com>
Co-authored-by: GayathriSrividya <gayathrirajavarapu7@gmail.com>
Co-authored-by: divyagovindaiah <110388603+divyagovindaiah@users.noreply.github.com>
Co-authored-by: yashashk <yashashk@sanketika.in>
Co-authored-by: Ravi Mula <ravismula@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants