Add changes that eliminate mistakes spotted while initial e2e tests

[PawelPeczek-Roboflow]

Description

• added config cache such that lambda inference can be faster
• added AL to new InferencePipeline() interface and to Stream Management API as parameter of pipeline init
• added dropping mechanism for queuing of AL collection requests on stream processing (as when config makes AL to collect to much - then backend is to slow for on-line registration, so we must drop datapoints not to impair performance)

Type of change

Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• This change requires a documentation update

How has this change been tested, please provide a testcase or example of how you tested the change?

• fixed tests
• CI still green
• tested locally

Any specific deployment considerations

For example, documentation changes, usability, usage/costs, secrets, etc.

Docs

• Docs updated? What were the changes:

[paulguerrie]

Looks great!!