Fix matching of leaf fields for objects

[jsoriano]

Validation of objects was happening only depending of the format. If there were no subobjects, the validation was happening, and if there were objects with subfields, the validation was not happening for the subfields. This leads to different results with different mapping settings for the same data. For example depending if synthetics source or subobjects: false is used.

Additionally, for subfields that should match the definition of the parent object, there were cases where this match was not happening, so the test could unexpectedly fail.

Even if usually it is recommended to add explicit wildcards in dynamic mappings, definitions like the following one are expected to match subfields, but currently they aren't.

    - name: user
      type: group
      fields:
        - name: names
          type: object
          object_type: keyword
          description: Array of user identification documents.

The definition above would not match for user.names.db.

Seen for several packages in https://buildkite.com/elastic/integrations/builds/15135 (elastic/integrations#10919).

[jsoriano]

Pending to confirm if this is actually needed or a regression in latest main, because this was not failing before in dailies.

[jsoriano]

test integrations

[elastic-vault-github-plugin-prod]

Created or updated PR in integrations repository to test this version. Check elastic/integrations#10922

[jsoriano]

test integrations

[elastic-vault-github-plugin-prod]

Created or updated PR in integrations repository to test this version. Check elastic/integrations#10922

[jsoriano]

test integrations

[elastic-vault-github-plugin-prod]

Created or updated PR in integrations repository to test this version. Check elastic/integrations#10922

[jsoriano]

test integrations

[elastic-vault-github-plugin-prod]

Created or updated PR in integrations repository to test this version. Check elastic/integrations#10922

[jsoriano]

Changes related to unexpected types moved to #2065 and elastic/package-spec#791.

[jsoriano]

test integrations

[elastic-vault-github-plugin-prod]

Created or updated PR in integrations repository to test this version. Check elastic/integrations#10922

[mrodm]

LGTM!

[mrodm]

Suggested change

	// Legacy mapping, abiguous definition not allowed by recent versions of the spec, ignore it.
	// Legacy mapping, ambiguous definition not allowed by recent versions of the spec, ignore it.

[elasticmachine]

💚 Build Succeeded

• Buildkite Build
• Commit: 0d1db04

History

• 💚 Build #3878 succeeded fe15ae8
• 💚 Build #3871 succeeded 18ffb90
• 💚 Build #3868 succeeded 6f7ac5a
• 💚 Build #3862 succeeded de4ed36
• 💔 Build #3858 failed 40bdac2
• 💚 Build #3841 succeeded 0d0c33d

cc @jsoriano