Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[8.x] Add base FTR test coverage for inference APIs (#198000) #202916

Merged
merged 5 commits into from
Dec 5, 2024

Conversation

pgayvallet
Copy link
Contributor

Backport

This will backport the following commits from main to 8.x:

Questions ?

Please refer to the Backport tool documentation

## Summary

Part of elastic/kibana-team#1271

This PR introduces the first set of end to end integration test for the
inference APIs, and the tooling required to do so (see issue for more
context)

- Add a dedicated pipeline for ai-infra GenAI tests. pipeline is
triggered when:
  - genAI stack connectors, or ai-infra owned code is changed
  - when the `ci:all-gen-ai-suites` label is present on a PR
  - on merge
- adapt the `ftr_configs.sh` script to load GenAI connector
configuration from vault when a specific var env is set
- create the `@kbn/gen-ai-functional-testing` package, which for now
only contains utilities to load the GenAI connector configuration in FTR
tests
- Add FTR integration tests for the `chatComplete` API of the
`inference` plugin

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
(cherry picked from commit 14ad13b)

# Conflicts:
#	.buildkite/pipelines/on_merge.yml
#	.github/CODEOWNERS
@pgayvallet pgayvallet merged commit 4ffcaed into elastic:8.x Dec 5, 2024
8 checks passed
@elasticmachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id before after diff
@kbn/gen-ai-functional-testing - 8 +8
@kbn/sse-utils-server 2 3 +1
total +9
Unknown metric groups

API count

id before after diff
@kbn/gen-ai-functional-testing - 10 +10
@kbn/sse-utils-server 2 4 +2
total +12

ESLint disabled line counts

id before after diff
@kbn/gen-ai-functional-testing - 2 +2
@kbn/test-suites-xpack 727 729 +2
total +4

Total ESLint disabled count

id before after diff
@kbn/gen-ai-functional-testing - 2 +2
@kbn/test-suites-xpack 752 754 +2
total +4

History

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants