[BUG][2.0.0]PA not running in RPM distribution

[peterzhuamazon]

The error log:

ERROR StatusLogger Reconfiguration failed: No configuration found for '659e0bfd' at 'null' in 'null'
01:21:06.820 [main] ERROR org.opensearch.performanceanalyzer.config.PluginSettings - Loading config file /usr/share/opensearch/config/opensearch-performance-analyzer/performance-analyzer.properties failed with error: org.opensearch.performanceanalyzer.config.ConfigFileException: java.io.FileNotFoundException: /usr/share/opensearch/config/opensearch-performance-analyzer/performance-analyzer.properties (No such file or directory). Disabling plugin.
01:21:06.823 [main] ERROR org.opensearch.performanceanalyzer.PerformanceAnalyzerApp - Performance analyzer app stopped due to invalid config status.

This error is caused by the change of config directory in RPM.
Not in $OPENSEARCH_HOME/config anymore, but in /etc/opensearch.

How to resolve:

1. We can have bin/opensearch-performance-analyzer/performance-analyzer-agent-cli to point to $OPENSEARCH_PATH_CONF instead of $OPENSEARCH_HOME/config.
2. We can also create a config symlink in the rpm pointed to /etc/opensearch, the problem with this approach is security demo cert installation script is checking whether $OPENSEARCH_HOME/config exists. If so, install as tar; if not, install as rpm.

I prefer to have 1 as that is the minimum changes as well as changes in scripts/legacy/tar/linux/opensearch-tar-install.sh to add OPENSEARCH_PATH_CONF values and exports.

Thanks.

[peterzhuamazon]

@sruti1312 @sgup432 @CEHENKLE @bbarani

[bbarani]

@peterzhuamazon Can we also add automated validation for PA to capture these issues for RPM, TAR and Docker bundle once we align on a solution?

[dblock]

Is the fix in this repo or PA? Can we please move this issue to the right repo and assign to an engineer in PA?

[sruti1312]

@peterzhuamazon I am also more inclined towards option 1. We can have performance-analyzer-agent-cli script pointing to OPENSEARCH_PATH_CONF.

PA references these configuration files in code as well, which needs to be fixed.

https://github.com/opensearch-project/performance-analyzer/blob/main/packaging/rpm/postinst
https://github.com/opensearch-project/performance-analyzer-rca/blob/main/src/main/java/org/opensearch/performanceanalyzer/config/PluginSettings.java#L219

[sruti1312]

Created an issue in PA: opensearch-project/performance-analyzer#197

[peterzhuamazon]

opensearch-project/performance-analyzer-rca#172
opensearch-project/performance-analyzer#200