help request: How to filter HEAD requests when using file-logger?

[kamly]

Description

many head request ， i want to filter it

Environment

• APISIX version (run apisix version): 3.3.0
• Operating system (run uname -a):
• OpenResty / Nginx version (run openresty -V or nginx -V):
• etcd version, if relevant (run curl http://127.0.0.1:9090/v1/server_info):
• APISIX Dashboard version, if relevant:
• Plugin runner version, for issues related to plugin runners:
• LuaRocks version, for installation issues (run luarocks --version):

[An-DJ]

https://apisix.apache.org/docs/apisix/plugins/file-logger/

You may need include_resp_body_expr?

[kamly]

https://apisix.apache.org/docs/apisix/plugins/file-logger/

You may need include_resp_body_expr?

i think include_resp_body_expr records the conditions of the body

"include_resp_body": true,
"include_resp_body_expr": [
    [
      "arg_foo",
      "==",
      "bar"
    ]
]

is arg foo is bar , can log the response body

but what I want is that if the method is a head request, the log is not recorded

[An-DJ]

but what I want is that if the method is a head request, the log is not recorded

FYI it is not supported in APISIX yet.

IMHO, filtering, aggregation, count and other analysis operation can be further done based on the raw log data. If we do more restriction conditions on logging, it may lose the control of observability.

Recommend you filter and aggregate logs with other tools and OLAP system. : )

[kamly]

in nginx, we can

map $request_method $ignore_head_request {
    HEAD 0;
    default 1;
}
access_log /data/logs/nginx/nginx_access.log json if=$ignore_head_request;

[shreemaan-abhishek]

I think you will have to patch apisix for this use case.

[kamly]

I want to push mr to apisix, but where should I start to solve this problem? Can you provide some ideas?

[kamly]

@shreemaan-abhishek want help~

[kamly]

@spacewander hi , can file-logger support filter_expr

example:

{
    "file-logger": {
        "filter_expr": [
            [
                "http_method",
                "!=",
                "HEAD"
            ]
        ]
    }
}

only filter_expr is true , can log

[tao12345666333]

@monkeyDluffy6017 PTAL, thanks

[kamly]

@monkeyDluffy6017 hi, please look look, thanks~

[monkeyDluffy6017]

LGTM