Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Backport 2.x][Feature] Support SQL direct query in Observability (#988) #1072

Merged
merged 2 commits into from
Oct 4, 2023

Conversation

joshuali925
Copy link
Member

Description

backport #988 to 2.x

Issues Resolved

[List any issues this PR will resolve]

Check List

  • New functionality includes testing.
    • All tests pass, including unit test, integration test and doctest
  • New functionality has been documented.
    • New functionality has javadoc added
    • New functionality has user manual doc added
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

…ct#988)

* remove unused files

Signed-off-by: Eric Wei <menwe@amazon.com>

* missing snapshots

Signed-off-by: Eric Wei <menwe@amazon.com>

* remove unused files

Signed-off-by: Eric Wei <menwe@amazon.com>

* missing snapshots

Signed-off-by: Eric Wei <menwe@amazon.com>

* create generic use polling hook

Signed-off-by: Eric <menwe@amazon.com>

* add unit tests

Signed-off-by: Eric <menwe@amazon.com>

* remove logging

Signed-off-by: Eric <menwe@amazon.com>

* datasource registeration for observability

Signed-off-by: Eric <menwe@amazon.com>

* Manage datasources (opensearch-project#967)

* fix name change bug and modify test to test behavior

Signed-off-by: Derek Ho <dxho@amazon.com>

* get rid of lint

Signed-off-by: Derek Ho <dxho@amazon.com>

* test for flyout

Signed-off-by: Derek Ho <dxho@amazon.com>

* flyout to medium size

Signed-off-by: Derek Ho <dxho@amazon.com>

* make accelerate extensible

Signed-off-by: Derek Ho <dxho@amazon.com>

* get datasources and hook up to pplservice

Signed-off-by: Derek Ho <dxho@amazon.com>

* get flint working

Signed-off-by: Derek Ho <dxho@amazon.com>

* add datasource page with steps and buttons on bottom bar

Signed-off-by: Derek Ho <dxho@amazon.com>

* datasources as a new plugin and mostly working

Signed-off-by: Derek Ho <dxho@amazon.com>

* hook up manage to show datasources call

Signed-off-by: Derek Ho <dxho@amazon.com>

* update two tables with descriptions

Signed-off-by: Derek Ho <dxho@amazon.com>

* make some updates to the page

Signed-off-by: Derek Ho <dxho@amazon.com>

* cleanup unused files for data connections

Signed-off-by: Derek Ho <dxho@amazon.com>

* cleanup and add overview panel columns

Signed-off-by: Derek Ho <dxho@amazon.com>

* render tabs

Signed-off-by: Derek Ho <dxho@amazon.com>

* add unit tests

Signed-off-by: Derek Ho <dxho@amazon.com>

* update data test subj and snapshot

Signed-off-by: Derek Ho <dxho@amazon.com>

* Add datasources to management overview

Signed-off-by: Derek Ho <dxho@amazon.com>

* remove spark logo and update snapshot

Signed-off-by: Derek Ho <dxho@amazon.com>

* refactor routes out

Signed-off-by: Derek Ho <dxho@amazon.com>

* separate out the roles

Signed-off-by: Derek Ho <dxho@amazon.com>

* bump version back to 3.0

Signed-off-by: Derek Ho <dxho@amazon.com>

---------

Signed-off-by: Derek Ho <dxho@amazon.com>

* Add acceleration management UI  (opensearch-project#989)

* add acceleration management UI skeleton

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

* Create new documentation link for acc

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

* fix typos and minor bugs

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

* update snapshot

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

* update window location to hash

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

* remove unused headers

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

---------

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

* dummy data redirection for datasource selector and language selector

Signed-off-by: Eric <menwe@amazon.com>

* flint datasource registration

Signed-off-by: Eric <menwe@amazon.com>

* tempararily passing down setup deps for datasource

Signed-off-by: Eric <menwe@amazon.com>

* add node server endpoints for direct query and job status

Signed-off-by: Eric <menwe@amazon.com>

* add server side endpoints for direct query

Signed-off-by: Eric <menwe@amazon.com>

* add s3 datasource class

Signed-off-by: Eric <menwe@amazon.com>

* s3 datasource registeration

Signed-off-by: Eric <menwe@amazon.com>

* changes to use new endpoints

Signed-off-by: Eric <menwe@amazon.com>

* remove unused files

Signed-off-by: Eric Wei <menwe@amazon.com>

* missing snapshots

Signed-off-by: Eric Wei <menwe@amazon.com>

* initial direct query support in explorer

Signed-off-by: Eric <menwe@amazon.com>

* add datasource pluggable

Signed-off-by: Eric <menwe@amazon.com>

* remove unused files

Signed-off-by: Eric Wei <menwe@amazon.com>

* missing snapshots

Signed-off-by: Eric Wei <menwe@amazon.com>

* remove unused dependency as well as passing down pluggable

Signed-off-by: Eric <menwe@amazon.com>

* changes for adopting new endpoints

Signed-off-by: Eric <menwe@amazon.com>

* add initial commits for context swithing

Signed-off-by: Eric <menwe@amazon.com>

* add query running page

Signed-off-by: Eric <menwe@amazon.com>

* relayout as an effort of match look and feel

Signed-off-by: Eric <menwe@amazon.com>

* add changes for index pattern to work with context switch

Signed-off-by: Eric <menwe@amazon.com>

* remove search section from explorer home

Signed-off-by: Eric <menwe@amazon.com>

* visualization page for direct query

Signed-off-by: Eric <menwe@amazon.com>

* add direct query visualization page

Signed-off-by: Eric <menwe@amazon.com>

* merge main

Signed-off-by: Eric <menwe@amazon.com>

* add discover redirection

Signed-off-by: Eric <menwe@amazon.com>

* merge main and resolve conflicts

Signed-off-by: Eric <menwe@amazon.com>

* s3 datasource and layout changes

Signed-off-by: Eric <menwe@amazon.com>

* use newly changed handler name

Signed-off-by: Eric <menwe@amazon.com>

* fixes for sidebar and datasource

Signed-off-by: Eric <menwe@amazon.com>

* add fix for redirection issue

Signed-off-by: Eric <menwe@amazon.com>

* console/comments cleanup

Signed-off-by: Eric <menwe@amazon.com>

* remove outdated polling tests

Signed-off-by: Eric <menwe@amazon.com>

* delete few outdated tests to resolve testing issues and skipped search tests for now

Signed-off-by: Eric <menwe@amazon.com>

* adopt empty prompt

Signed-off-by: Eric <menwe@amazon.com>

* remove unused oui/eui component

Signed-off-by: Eric <menwe@amazon.com>

* adopt new endpoint cchanges

Signed-off-by: Eric <menwe@amazon.com>

* fix data grid issue

Signed-off-by: Eric <menwe@amazon.com>

* disable autosuggest for sql

Signed-off-by: Eric <menwe@amazon.com>

* remove manual link for SQL

Signed-off-by: Eric <menwe@amazon.com>

* query cancelling

Signed-off-by: Eric <menwe@amazon.com>

---------

Signed-off-by: Eric Wei <menwe@amazon.com>
Signed-off-by: Eric <menwe@amazon.com>
Signed-off-by: Derek Ho <dxho@amazon.com>
Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>
Co-authored-by: Derek Ho <dxho@amazon.com>
Co-authored-by: Shenoy Pratik <sgguruda@amazon.com>
(cherry picked from commit e21dcf2)
@joshuali925
Copy link
Member Author

attempt to resolve all conflicts for backport, still need to test if it runs

Signed-off-by: Joshua Li <joshuali925@gmail.com>
@joshuali925 joshuali925 changed the title [Feature] Support SQL direct query in Observability (#988) [Backport 2.x][Feature] Support SQL direct query in Observability (#988) Oct 4, 2023
@mengweieric mengweieric merged commit cefd57f into opensearch-project:2.x Oct 4, 2023
3 of 6 checks passed
Swiddis added a commit to Swiddis/dashboards-observability that referenced this pull request Oct 5, 2023
amsiglan pushed a commit to amsiglan/dashboards-observability that referenced this pull request Jun 7, 2024
…ensearch-project#988) (opensearch-project#1072)

* [Feature] Support SQL direct query in Observability (opensearch-project#988)

* remove unused files

Signed-off-by: Eric Wei <menwe@amazon.com>

* missing snapshots

Signed-off-by: Eric Wei <menwe@amazon.com>

* remove unused files

Signed-off-by: Eric Wei <menwe@amazon.com>

* missing snapshots

Signed-off-by: Eric Wei <menwe@amazon.com>

* create generic use polling hook

Signed-off-by: Eric <menwe@amazon.com>

* add unit tests

Signed-off-by: Eric <menwe@amazon.com>

* remove logging

Signed-off-by: Eric <menwe@amazon.com>

* datasource registeration for observability

Signed-off-by: Eric <menwe@amazon.com>

* Manage datasources (opensearch-project#967)

* fix name change bug and modify test to test behavior

Signed-off-by: Derek Ho <dxho@amazon.com>

* get rid of lint

Signed-off-by: Derek Ho <dxho@amazon.com>

* test for flyout

Signed-off-by: Derek Ho <dxho@amazon.com>

* flyout to medium size

Signed-off-by: Derek Ho <dxho@amazon.com>

* make accelerate extensible

Signed-off-by: Derek Ho <dxho@amazon.com>

* get datasources and hook up to pplservice

Signed-off-by: Derek Ho <dxho@amazon.com>

* get flint working

Signed-off-by: Derek Ho <dxho@amazon.com>

* add datasource page with steps and buttons on bottom bar

Signed-off-by: Derek Ho <dxho@amazon.com>

* datasources as a new plugin and mostly working

Signed-off-by: Derek Ho <dxho@amazon.com>

* hook up manage to show datasources call

Signed-off-by: Derek Ho <dxho@amazon.com>

* update two tables with descriptions

Signed-off-by: Derek Ho <dxho@amazon.com>

* make some updates to the page

Signed-off-by: Derek Ho <dxho@amazon.com>

* cleanup unused files for data connections

Signed-off-by: Derek Ho <dxho@amazon.com>

* cleanup and add overview panel columns

Signed-off-by: Derek Ho <dxho@amazon.com>

* render tabs

Signed-off-by: Derek Ho <dxho@amazon.com>

* add unit tests

Signed-off-by: Derek Ho <dxho@amazon.com>

* update data test subj and snapshot

Signed-off-by: Derek Ho <dxho@amazon.com>

* Add datasources to management overview

Signed-off-by: Derek Ho <dxho@amazon.com>

* remove spark logo and update snapshot

Signed-off-by: Derek Ho <dxho@amazon.com>

* refactor routes out

Signed-off-by: Derek Ho <dxho@amazon.com>

* separate out the roles

Signed-off-by: Derek Ho <dxho@amazon.com>

* bump version back to 3.0

Signed-off-by: Derek Ho <dxho@amazon.com>

---------

Signed-off-by: Derek Ho <dxho@amazon.com>

* Add acceleration management UI  (opensearch-project#989)

* add acceleration management UI skeleton

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

* Create new documentation link for acc

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

* fix typos and minor bugs

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

* update snapshot

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

* update window location to hash

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

* remove unused headers

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

---------

Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>

* dummy data redirection for datasource selector and language selector

Signed-off-by: Eric <menwe@amazon.com>

* flint datasource registration

Signed-off-by: Eric <menwe@amazon.com>

* tempararily passing down setup deps for datasource

Signed-off-by: Eric <menwe@amazon.com>

* add node server endpoints for direct query and job status

Signed-off-by: Eric <menwe@amazon.com>

* add server side endpoints for direct query

Signed-off-by: Eric <menwe@amazon.com>

* add s3 datasource class

Signed-off-by: Eric <menwe@amazon.com>

* s3 datasource registeration

Signed-off-by: Eric <menwe@amazon.com>

* changes to use new endpoints

Signed-off-by: Eric <menwe@amazon.com>

* remove unused files

Signed-off-by: Eric Wei <menwe@amazon.com>

* missing snapshots

Signed-off-by: Eric Wei <menwe@amazon.com>

* initial direct query support in explorer

Signed-off-by: Eric <menwe@amazon.com>

* add datasource pluggable

Signed-off-by: Eric <menwe@amazon.com>

* remove unused files

Signed-off-by: Eric Wei <menwe@amazon.com>

* missing snapshots

Signed-off-by: Eric Wei <menwe@amazon.com>

* remove unused dependency as well as passing down pluggable

Signed-off-by: Eric <menwe@amazon.com>

* changes for adopting new endpoints

Signed-off-by: Eric <menwe@amazon.com>

* add initial commits for context swithing

Signed-off-by: Eric <menwe@amazon.com>

* add query running page

Signed-off-by: Eric <menwe@amazon.com>

* relayout as an effort of match look and feel

Signed-off-by: Eric <menwe@amazon.com>

* add changes for index pattern to work with context switch

Signed-off-by: Eric <menwe@amazon.com>

* remove search section from explorer home

Signed-off-by: Eric <menwe@amazon.com>

* visualization page for direct query

Signed-off-by: Eric <menwe@amazon.com>

* add direct query visualization page

Signed-off-by: Eric <menwe@amazon.com>

* merge main

Signed-off-by: Eric <menwe@amazon.com>

* add discover redirection

Signed-off-by: Eric <menwe@amazon.com>

* merge main and resolve conflicts

Signed-off-by: Eric <menwe@amazon.com>

* s3 datasource and layout changes

Signed-off-by: Eric <menwe@amazon.com>

* use newly changed handler name

Signed-off-by: Eric <menwe@amazon.com>

* fixes for sidebar and datasource

Signed-off-by: Eric <menwe@amazon.com>

* add fix for redirection issue

Signed-off-by: Eric <menwe@amazon.com>

* console/comments cleanup

Signed-off-by: Eric <menwe@amazon.com>

* remove outdated polling tests

Signed-off-by: Eric <menwe@amazon.com>

* delete few outdated tests to resolve testing issues and skipped search tests for now

Signed-off-by: Eric <menwe@amazon.com>

* adopt empty prompt

Signed-off-by: Eric <menwe@amazon.com>

* remove unused oui/eui component

Signed-off-by: Eric <menwe@amazon.com>

* adopt new endpoint cchanges

Signed-off-by: Eric <menwe@amazon.com>

* fix data grid issue

Signed-off-by: Eric <menwe@amazon.com>

* disable autosuggest for sql

Signed-off-by: Eric <menwe@amazon.com>

* remove manual link for SQL

Signed-off-by: Eric <menwe@amazon.com>

* query cancelling

Signed-off-by: Eric <menwe@amazon.com>

---------

Signed-off-by: Eric Wei <menwe@amazon.com>
Signed-off-by: Eric <menwe@amazon.com>
Signed-off-by: Derek Ho <dxho@amazon.com>
Signed-off-by: Shenoy Pratik <sgguruda@amazon.com>
Co-authored-by: Derek Ho <dxho@amazon.com>
Co-authored-by: Shenoy Pratik <sgguruda@amazon.com>
(cherry picked from commit e21dcf2)

* remove datasource routers

Signed-off-by: Joshua Li <joshuali925@gmail.com>

---------

Signed-off-by: Joshua Li <joshuali925@gmail.com>
Co-authored-by: Eric Wei <menwe@amazon.com>
(cherry picked from commit cefd57f)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants