Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Param with special formatting in the Data-View are not displayed correctly.(URL Param Decode) #162633

Open
soupedog opened this issue Jul 27, 2023 · 2 comments
Labels
bug Fixes for quality problems that affect the customer experience Feature:FieldFormatters impact:low Addressing this issue will have a low level of impact on the quality/strength of our product. loe:needs-research This issue requires some research before it can be worked on or estimated Team:DataDiscovery Discover, search (e.g. data plugin and KQL), data views, saved searches. For ES|QL, use Team:ES|QL.

Comments

@soupedog
Copy link

Kibana version: both 8.8.2 and 8.9.0

Elasticsearch version: both 8.8.2 and 8.9.0

Server OS version: Docker For Windows

Browser version: 114.0.5735.91

Browser OS version: Google Chrome

Original install method (e.g. download page, yum, from source, etc.): Official Docker images

Describe the bug: With the URL Param Decode setting configured for the parameters of the data view, it works fine.
However, if the data is filtered with e.g. msg:* ControllerLog —— KQL , the data view is not displayed as expected!

Steps to reproduce:

  1. init environment, here is my docker-compose.yml
version: '2.2'
services:
  elasticsearch_single:
    image: docker.elastic.co/elasticsearch/elasticsearch:8.8.2
    container_name: elasticsearch_single
    restart: always
    environment:
      - discovery.type=single-node
      - xpack.security.enabled=false
      - bootstrap.memory_lock=true
      - "ES_JAVA_OPTS=-Xms512m -Xmx768m"
    volumes:
      - /home/elk/elasticsearch_single/plugins:/usr/share/elasticsearch/plugins
    ports:
      - 9200:9200
  kibana:
    image: docker.elastic.co/kibana/kibana:8.8.2
    container_name: my_kibana
    environment:
      ELASTICSEARCH_HOSTS: http://elasticsearch:9200
    ports:
      - 5601:5601
    links:
      - "elasticsearch_single:elasticsearch"
    depends_on:
      - elasticsearch_single
  filebeat:
    image: docker.elastic.co/beats/filebeat:8.8.2
    container_name: my_filebeat
    links:
      - "elasticsearch_single:elasticsearch"
    depends_on:
      - elasticsearch_single
    volumes:
      - /home/elk/filebeat/filebeat.yml:/usr/share/filebeat/filebeat.yml
      - /home/log:/logFile
  1. use file-beat upload json log to elasticserch

content of test.log

{"level":"INFO","type":"hygge","projectName":"MyProject","appName":"web-application-example","version":"1.0.0","host":"My-PC","pid":"772","thread":"http-nio-8080-exec-1","classPath":"h.w.u.log.base.BaseControllerLogHandler","ts":"1688459315743","msg":"ControllerLog:{%22type%22:%22GET%22,%22path%22:%22/replace/customResponse%22,%22output%22:{%22uid%22:%22customResponse%22,%22userName%22:%22customResponse%22,%22pw%22:%22customResponse%22},%22cost%22:8}","thrown":""}


filebeat configuration

filebeat.inputs:
  - type: log
    paths:
      - "/logFile/*.log"
    tags: [ "custom-log" ]
    json:
      keys_under_root: true
      
output:
  elasticsearch:
    hosts: [ "elasticsearch:9200" ]
    index: "web-log-%{+yyyy.MM.dd}"
    escape_html: false


setup:
  template:
    enabled: false
    name: "web-log-template"
    pattern: "web-log-*"
setup.ilm.enabled: false
  1. create data-view by web-log-*, add format to data-view

config dataView

works fine

it works fine.

unexpected

However, if the data is filtered with e.g. msg:* ControllerLog —— KQL , the data view is not displayed as expected!

Expected behavior: URL Param Decode works even after using a data filter such as msg:* ControllerLog.

Screenshots (if relevant):

Errors in browser console (if relevant):

Provide logs and/or server output (if relevant):

Any additional context:

@soupedog soupedog added the bug Fixes for quality problems that affect the customer experience label Jul 27, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Jul 27, 2023
@soupedog soupedog changed the title Parameters with special formatting in the Data-View are not displayed correctly.(URL Param Decode) Param with special formatting in the Data-View are not displayed correctly.(URL Param Decode) Jul 27, 2023
@dej611 dej611 added the Team:DataDiscovery Discover, search (e.g. data plugin and KQL), data views, saved searches. For ES|QL, use Team:ES|QL. label Jul 28, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-data-discovery (Team:DataDiscovery)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Jul 28, 2023
@jughosta
Copy link
Contributor

Linking to #3735

@kertal kertal added Feature:FieldFormatters impact:low Addressing this issue will have a low level of impact on the quality/strength of our product. labels Aug 1, 2023
@davismcphee davismcphee added the loe:needs-research This issue requires some research before it can be worked on or estimated label Sep 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Fixes for quality problems that affect the customer experience Feature:FieldFormatters impact:low Addressing this issue will have a low level of impact on the quality/strength of our product. loe:needs-research This issue requires some research before it can be worked on or estimated Team:DataDiscovery Discover, search (e.g. data plugin and KQL), data views, saved searches. For ES|QL, use Team:ES|QL.
Projects
None yet
Development

No branches or pull requests

6 participants