Kafka MirrorMaker 2 Geo-Replication CLI: Observability, OpenTelemetry & Metrics Export

Execute `kafka --version` or `kafka status` in your terminal to inspect the active binary version, runtime dependencies, and configuration health.

Run `kafka --help` or `man kafka` to view all available subcommands, argument flags, environment variables, and usage examples.

Use the official package manager for your OS (e.g. Homebrew, apt, pacman, npm, pip, or direct static binary releases from GitHub) and verify the SHA-256 checksum.

Generate completion scripts using `kafka completion zsh > ~/.zfunc/_kafka` and add `fpath+=~/.zfunc; autoload -Uz compinit && compinit` to your `.zshrc`.

Set concise 2-to-3 character aliases in your shell profile (such as `alias ka='kafka'`) to reduce keystrokes during frequent workflows.

Pass the `--non-interactive`, `--batch`, or `--yes` flags and export `CI=true` in your pipeline environment to suppress interactive confirmation prompts.

Append `--output json` or `--format json` to your command and pipe into `jq` (e.g. `kafka list --output json | jq '.items[].name'`).

Standard exit codes are `0` for success, `1` for general runtime error, `2` for invalid CLI syntax/flags, and `130` for user termination via SIGINT (Ctrl+C).

Use the `--dry-run`, `--simulate`, or `--plan` flag to preview proposed modifications without writing state changes to disk or remote servers.

Redirect output streams using `> output.log 2>&1` or pipe into `tee -a process.log` to view console output while preserving full audit logs.

Environment variables prefixed with the tool name (e.g. `KAFKA_CONFIG` or `KAFKA_TOKEN`) take precedence over local YAML/JSON config files.

Inject secrets from password vaults (HashiCorp Vault, AWS Secrets Manager, 1Password CLI) or environment variables rather than passing raw keys in plain-text CLI flags.

On Linux/macOS, configs reside in `~/.config/kafka/` and caches in `~/.cache/kafka/` following the XDG Base Directory Specification.

Pass the `--profile <name>` or `--context <name>` flag, or export `KAFKA_PROFILE=production` to switch clusters or credential sets instantly.

Execute `kafka config validate -f ./config.yaml` or `kafka --check` to catch syntax and schema errors before startup.

Configure memory limits via flags (e.g. `--memory-limit 2G`) or execute within Linux cgroups / Docker memory constraints (`docker run --memory=2g`).

Pass the `--concurrency <N>` or `--jobs $(nproc)` flag to utilize all available CPU cores for batch processing operations.

Prefix commands with `time` or pass `--trace` / `--profile` to generate execution breakdowns covering network latency, disk I/O, and CPU runtime.

Configure `--timeout 30s` and `--connect-timeout 5s` to prevent hung TCP sockets during intermittent network degradation.

Increase read/write buffer allocations (e.g. `--buffer-size 64MB`) to minimize context switching and system call overhead during bulk data transfers.

Export `HTTP_PROXY=http://proxy.internal:8080` and `HTTPS_PROXY=http://proxy.internal:8080` or specify `--proxy http://proxy.internal:8080` in command flags.

Pass `--cacert /path/to/custom-ca.crt` or set `SSL_CERT_FILE=/path/to/custom-ca.crt` to trust internal corporate PKI certificate authorities.

Pass `--insecure` or `-k` for local self-signed certificate testing, but never enable this flag in production environments.

Provide the client certificate and private key using `--cert client.crt --key client.key` to authenticate against zero-trust API endpoints.

Run `dig +trace <hostname>` or pass `--verbose` to inspect the exact IP address and DNS response times during socket establishment.

Pass `-v`, `-vv`, `--verbose`, or set `LOG_LEVEL=debug` to print raw wire frames, internal function calls, and HTTP headers.

Use the `-q`, `--quiet`, or `--silent` flag to suppress informational logs and output only fatal errors to stderr.

It indicates that the target port is not listening, the remote daemon has crashed, or firewall rules (iptables/ufw) are dropping connection packets.

Check file ownership and POSIX permissions (`ls -la`), avoid running as root unless necessary, and grant specific read/write access via `chmod` or `chown`.

Use `lsof -p <PID>` or inspect `/proc/<PID>/fd/` to verify that file descriptors and TCP sockets are being closed properly without leaks.

Execute `kafka backup create --destination ./backups/` or copy persistent volume data while ensuring writes are temporarily quiesced.

Stop active worker processes, execute `kafka restore --source ./backups/snapshot.tar.gz`, verify checksums, and restart the service.

Run `kafka clean --all` or `kafka prune --older-than 7d` to reclaim local disk storage.

Execute `kafka verify --deep` or `kafka check-integrity` to compute block-level checksums against metadata.

Use `kafka export --format yaml > config.yaml` to extract running state into declarative manifests suitable for GitOps.

Use Alpine Linux or Google Distroless minimal images to minimize image attack surface and keep image sizes below 50MB.

Mount persistent storage directories using named volumes (e.g. `volumes: - data_volume:/var/lib/kafka`) and set `:ro` on config files.

Set `httpGet` probes to `/healthz` or `exec` probes running `kafka ping` with initial delay of 10s and timeout of 3s.

Set conservative CPU/memory requests (e.g. 500m CPU, 1Gi RAM) and set memory limits to prevent runaway memory leaks from evicting adjacent pods.

Ensure the container process catches SIGTERM, flushes in-flight buffers, finishes current requests, and terminates within `terminationGracePeriodSeconds` (default 30s).

Create dedicated non-root service accounts with read-only permissions on resources unless write access is explicitly required for specific operations.

Pass arguments as structured arrays (e.g. `subprocess.run(['kafka', 'arg1'])`) rather than concatenating user input into shell strings (`shell=True`).

Run vulnerability scanners (Trivy, Grype, Snyk) in CI to catch CVEs in underlying OS packages and shared libraries before deploying to production.

Configure regex redaction filters at the logging agent (Vector, FluentBit, Logstash) to mask authorization headers, passwords, and user identifiers.

Set strict POSIX permissions `chmod 600 private.key` so only the owning process user can read sensitive cryptographic material.

Calculate retry sleep intervals as `t = min(max_interval, base * 2^attempt) + rand(0, jitter)` to prevent thundering herd problems against upstream services.

Enable Prometheus exporter endpoints (typically `:9090/metrics`) and scrape metrics into Prometheus to track request rates, latencies, and error counters.

Upgrade nodes one at a time: drain inbound traffic from node 1, apply binary upgrade, verify health checks, re-enable traffic, and repeat across remaining nodes.

Inspect `/sys/fs/cgroup/cpu.stat` for `nr_throttled` counts and check host CPU steal percentage with `top` or `mpstat`.

Always maintain declarative version-controlled configuration, automated rollback mechanisms, and comprehensive alerting on p99 latency and error budgets.