improve reliability of req logging under high load

[ryandawsonuk]

Noted that under high load elastic can give transport errors. Could add more elastic nodes but this reduces requests to elastic and makes it more likely that docs will be indexed. On my testing all docs were being indexed that hit the logger, both request and response. When pointing to the logger directly that was simply all docs (when going via knative broker I found processing was much faster but the in-memory broker seemed to lose about a response per thousand).

[seldondev]

Mon Feb 17 12:09:16 UTC 2020
The logs for [lint] [2] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1457/2.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1457 --build=2

[seldondev]

Mon Feb 17 12:09:32 UTC 2020
The logs for [pr-build] [1] will show after the pipeline context has finished.
https://github.com/SeldonIO/seldon-core/blob/gh-pages/jenkins-x/logs/SeldonIO/seldon-core/PR-1457/1.log

impatient try
jx get build logs SeldonIO/seldon-core/PR-1457 --build=1

[ryandawsonuk]

/lgtm
/approve

[seldondev]

@ryandawsonuk: you cannot LGTM your own PR.

In response to this:

/lgtm
/approve

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[seldondev]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ryandawsonuk

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [ryandawsonuk]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment