[BUG] Search Pipeline API Errors in OpenSearch 2.7.0 and 2.8.0

[saimedhi]

Describe the bug

Search Pipeline APIs were recently added to opensearch-py. While running the REST API Spec tests here, I'm encountering failures in OpenSearch 2.7.0 and 2.8.0

Failures: 1, 2

Even after connecting to the server directly, I still received the same error for OpenSearch 2.7.0 and 2.8.0 The API works fine for other OpenSearch versions.

PUT https://localhost:9200/_search/pipeline/my_pipeline

body = {
            "description": "_descrninpnvtion",
            "request_processors": [
            ]
          }

{
    "error": "no handler found for uri [/_search/pipeline/my_pipeline] and method [PUT]"
}

• If this is expected behavior, the rest-api-spec test should skip these versions.

Related component

Search

To Reproduce

Go to 'https://github.com/opensearch-project/opensearch-py/actions/runs/8757559757/job/24036460997?pr=726'

Expected behavior

• Fix the errors or skip the tests for this versions here.

Additional Details

No response

[msfroh]

Search pipelines went GA in OpenSearch 2.9.0, didn't they?

They were announced for 2.9: https://opensearch.org/blog/introducing-opensearch-2.9.0/

Prior to that, they were gated behind a feature flag -- the integ tests were enabling the feature flag. I guess we can update the integ tests to pretend that search pipelines didn't exist at all prior to 2.9.