Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[File upload][Maps] Add possibility to use/configure ingest pipeline for geoJSON import feature #37990

Closed
Tracked by #154870
radoondas opened this issue Jun 4, 2019 · 9 comments
Labels
enhancement New value added to drive a business result Feature:File Upload Feature:Maps impact:medium Addressing this issue will have a medium level of impact on the quality/strength of our product. loe:large Large Level of Effort Team:Presentation Presentation Team for Dashboard, Input Controls, and Canvas

Comments

@radoondas
Copy link
Member

Describe the feature:
I would like to add possibility to configure ingest pipeline for GeoJson import.

Describe a specific use case for the feature:
This will become handy for data enrichment or any other field/value manipulation at ingest time.
Right now, I would need to perform reindex in order to manipulate data or use normal indexing with pipeline instead of KIbana import.

cc: @aaronjcaldwell

Thanks

@nreese nreese added [Deprecated-Use Team:Presentation]Team:Geo Former Team Label for Geo Team. Now use Team:Presentation enhancement New value added to drive a business result labels Jun 4, 2019
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-gis

@kindsun kindsun changed the title Add possibility to use/configure ingest pipeline for geoJSON import feature [File upload][Maps] Add possibility to use/configure ingest pipeline for geoJSON import feature Jun 4, 2019
@jb1b84 jb1b84 added Feature:Maps Team:Presentation Presentation Team for Dashboard, Input Controls, and Canvas labels Nov 3, 2022
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-presentation (Team:Presentation)

@jb1b84 jb1b84 removed the [Deprecated-Use Team:Presentation]Team:Geo Former Team Label for Geo Team. Now use Team:Presentation label Nov 3, 2022
@geekpete
Copy link
Member

Being able to specify any pipeline you wanted during the upload step will make this feature more flexible and useful.
The alternative is to reindex through a pipeline after you've updated or do an update by query,etc, which requires a second step that could be handled at the same time as the data is imported.

@geekpete
Copy link
Member

Ah it seems you can at least modify the autocreated ingest pipeline in the last step before import runs within the Advanced tab, which is the step after the mapping step:

2023-02-27_13-55

@nreese nreese added loe:large Large Level of Effort impact:medium Addressing this issue will have a medium level of impact on the quality/strength of our product. labels Mar 9, 2023
@jsanz
Copy link
Member

jsanz commented Mar 9, 2023

@geekpete, in your original request, where you referring to the Maps application file uploader or the Kibana file uploader for JSON and CSV?

Your last comment points to the more generic (and featured-rich) Kibana File Uploader, but here you are sharing a screenshot with a CSV.

In any case, I agree that the Maps App could have a selector to provide an ingest pipeline already present in ES, so power users can be explicit about mappings and other custom logic as you mentioned without having to do a post-processing step.

@jsanz
Copy link
Member

jsanz commented Mar 9, 2023

Ops sorry, @radoondas posted the issue back in 2019 and @geekpete commented just recently 😅

Yet the issue is legit, in my opinion.

@geekpete
Copy link
Member

geekpete commented Mar 9, 2023

My comment might be a bit off topic then, specific to the original issue here?

@jsanz
Copy link
Member

jsanz commented Mar 9, 2023

Yeah, maybe @geekpete, but still worth noting that there's that option through the Kibana File Upload interface. Also, worth noting for any future visitors that the UI offers a way to download the settings to be used with filebeat, which can be pretty convenient for anyone willing to automate the procedure.

@nreese
Copy link
Contributor

nreese commented Apr 12, 2023

In order to provide better transparency of priorities, issues that will not be prioritized within the next 24 months are being closed.

Tracking request in Maps ice box #154870

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New value added to drive a business result Feature:File Upload Feature:Maps impact:medium Addressing this issue will have a medium level of impact on the quality/strength of our product. loe:large Large Level of Effort Team:Presentation Presentation Team for Dashboard, Input Controls, and Canvas
Projects
None yet
Development

No branches or pull requests

7 participants