elasticsearch: add index mode and codec dashboards

[JohannesMahne]

Summary

Consolidates #19520, #19522, and #19635 into a single PR.

• Add index mode and codec fields to the elasticsearch integration (ingest pipeline, transform, field definitions)
• Surface adoption on the consumption and Index & Shard View dashboards
• Fix Index & Shard View and consumption codec panels for Kibana 8.10+ compatibility
• Document the Metricbeat 8.19+ dependency for index mode and codec fields

Supersedes #19520, #19522, #19635.

Test plan

• elastic-package check passes for packages/elasticsearch
• Dashboards install and render on Kibana 8.10+
• Index mode and codec values appear when Metricbeat 8.19+ is collecting monitoring indices data

Made with Cursor

[github-actions]

✅ Elastic Docs Style Checker (Vale)

No issues found on modified lines!

---

The Vale linter checks documentation changes against the Elastic Docs style guide. To use Vale locally or report issues, refer to Elastic style guide for Vale.

[github-actions]

TL;DR

The changelog check is failing because the new packages/elasticsearch/changelog.yml entry links to the Beats PR instead of this integrations PR. The Check integrations elasticsearch pre-fetched log only contains teardown/final failure lines, so its specific subcheck failure is not present in the available data.

Remediation

• Change packages/elasticsearch/changelog.yml for version 1.22.0 from https://github.com/elastic/beats/pull/49237 to https://github.com/elastic/integrations/pull/19654. If the Beats PR is still useful context, keep it in the description as plain text, as it already is with beats#49237.
• Re-run the failed Buildkite build. If Check integrations elasticsearch still fails, attach or expose the full log for job 019edea5-520f-47aa-8387-644b799bc883 because the available log does not include the underlying elastic-package error.

Investigation details

Root Cause

packages/elasticsearch/changelog.yml:2-6 adds the 1.22.0 changelog entry, but line 6 uses https://github.com/elastic/beats/pull/49237. The changelog PR-link check requires changed changelog entries to link to the current integrations PR, https://github.com/elastic/integrations/pull/19654.

For Check integrations elasticsearch, the pre-fetched log at /tmp/gh-aw/buildkite-logs/integrations-check-integrations-elasticsearch.txt starts at stack teardown and only shows --- [elasticsearch] failed plus exit status 1 at lines 95-100. It does not include the earlier elastic-package check, install, or test-suite output from .buildkite/scripts/common.sh:1009-1044, so there is not enough evidence to identify a separate package root cause from the supplied logs.

Evidence

• Build: https://buildkite.com/elastic/integrations/builds/44756
• Job/step: :scroll: Check changelog PR links
• Key log excerpt:

ERROR: unexpected link: 'https://github.com/elastic/beats/pull/49237'
       expected:         'https://github.com/elastic/integrations/pull/19654'
--- 1 changelog link(s) do not match this PR

• Job/step: Check integrations elasticsearch
• Available log excerpt:

--- [elasticsearch] failed
🚨 Error: The command exited with status 1
user command error: exit status 1

Verification

Not run locally: the workspace checkout is main, the PR commit is not present locally, and the available environment does not include elastic-package.

Follow-up

If the package job remains red after the changelog fix, use the full Buildkite job log or uploaded test result artifacts to identify which elastic-package subcommand failed.

---

What is this? | From workflow: PR Buildkite Detective

Give us feedback! React with 🚀 if perfect, 👍 if helpful, 👎 if not.

[elastic-vault-github-plugin-prod]

✅ All changelog entries have the correct PR link.

[elastic-vault-github-plugin-prod]

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

[elasticmachine]

💚 Build Succeeded

• Buildkite Build
• Commit: 2667648

History

• 💔 Build #44760 failed 6b71123
• 💔 Build #44756 failed 9802e93