AMBARI-26000: Make Ambari supports Python3 environment #3751

wenwj0 · 2023-09-04T01:41:14Z

What changes were proposed in this pull request?

Upgrade ambari from python2 to python3 on trunk branch.
More changes details can be found in Ambari-support-python3.md in AMBARI-26000

How was this patch tested?

All unit tests
Manual deploy tests on centos7

Please review Ambari Contributing Guide before opening a pull request.

Co-authored-by: jialiang <2510095164@qq.com>

wenwj0 · 2023-09-04T02:10:31Z

Python3 rely on distro module and it is not installed on the current machine, thus continuous-integration test failed.

Phenomenon: ModuleNotFoundError: No module named 'distro'
UT command: mvn -Dmaven.test.failure.ignore=true -am test -pl ambari-agent -Dmaven.artifact.threads=10 -Drat.skip

Please install distro module by using command: pip3 install distro

@brahmareddybattula @virajjasani

2.fix sudo encoding error 3.remove redunant get_encoded_string

JiaLiangC · 2023-09-15T06:44:43Z

@brahmareddybattula @virajjasani
Could you please help check CI/CD environment about the python3 dependency problem?

virajjasani · 2023-09-19T17:32:08Z

Sorry I couldn't take a look. @arshadmohammad you think you can take a look at CI pipeline for python 3 installation?

arshadmohammad · 2023-09-22T05:25:16Z

Sorry I couldn't take a look. @arshadmohammad you think you can take a look at CI pipeline for python 3 installation?

no idea how to access the CI Vms, but let me run distro installation as part of the test execution script itself. lets see whether it works

JiaLiangC · 2023-09-22T05:35:00Z

Sorry I couldn't take a look. @arshadmohammad you think you can take a look at CI pipeline for python 3 installation?

no idea how to access the CI Vms, but let me run distro installation as part of the test execution script itself. lets see whether it works

thanks man

arshadmohammad · 2023-09-22T06:21:15Z

installing distro package, as part of the test execution script, does not work. https://ci-hadoop.apache.org/blue/organizations/jenkins/Ambari%2FAmbari-PreCommit-GitHub-PR/detail/PR-3754/1/pipeline

JiaLiangC · 2023-09-22T06:32:05Z

@arshadmohammad it seems your change in jenkinsfile not working fine ,maybe you can try this
stage('Some Stage') {
steps {
// Other steps here
sh 'pip3 install distro'
// Other steps here
}
}

arshadmohammad · 2023-09-22T07:37:40Z

Thanks @JiaLiangC, it worked.
https://ci-hadoop.apache.org/blue/organizations/jenkins/Ambari%2FAmbari-PreCommit-GitHub-PR/detail/PR-3754/2/pipeline/

JiaLiangC · 2023-09-22T07:41:29Z

Thanks @JiaLiangC, it worked. https://ci-hadoop.apache.org/blue/organizations/jenkins/Ambari%2FAmbari-PreCommit-GitHub-PR/detail/PR-3754/2/pipeline/

Thank you very much for your assistance！

JiaLiangC · 2023-09-22T08:19:31Z

@arshadmohammad Could you help trigger the CI/CD process of this PR again?

arshadmohammad · 2023-09-22T09:47:48Z

@arshadmohammad Could you help trigger the CI/CD process of this PR again?
CI got triggered with the new commit by @wenwj0. CI is passed for this PR.

JiaLiangC · 2023-09-22T09:54:33Z

@virajjasani @arshadmohammad @brahmareddybattula
Can you help review and push the merge of this PR? Detailed explanations for all the changes in the PR are available in the documentation within the issue.

I've already reviewed this PR and tested multiple times. Once this PR is merged, it will greatly simplify support for multiple operating systems and different architectures.

MacChen01 · 2023-09-27T02:54:40Z

@guyuqi please help to review the code, thanks.

eubnara · 2023-09-28T20:33:00Z

ambari-agent/src/main/python/ambari_agent/hostname.py

-  print server_hostname()
+  print(hostname())
+  print(public_hostname())
+  print(server_hostname())


server_hostname => server_hostnames

thanks for finding this, I will fix it later.

eubnara · 2023-09-28T20:48:09Z

There are some import rpm lines. But rpm module is not preinstalled in python3.

e.g. yum_manager.py

def rpm_check_package_available(self, name):
  import rpm # this is faster then calling 'rpm'-binary externally.

eubnara · 2023-09-28T20:53:12Z

ambari-agent/src/main/python/ambari_agent/alerts/web_alert.py

+from urllib.error import HTTPError

 from tempfile import gettempdir
 from alerts.base_alert import BaseAlert


alerts.base_alert => ambari_agent.alerts.base_alert
Maybe it should be also changed?

both these two way are work.

wenwj0 · 2023-09-30T16:47:18Z

There are some import rpm lines. But rpm module is not preinstalled in python3.

e.g. yum_manager.py
def rpm_check_package_available(self, name):
  import rpm # this is faster then calling 'rpm'-binary externally.

Yes, rpm module is needed and that isn't preinstalled. We install python36-rpm in centos 7 and it works.

arshadmohammad · 2023-10-21T09:37:04Z

I will review this PR.

arshadmohammad · 2023-10-21T09:44:38Z

I was trying to build this PR(also applied #3758 changes) on rocky linux 8.8 but build failed with following error
[INFO] error: Bad exit status from /var/tmp/rpm-tmp.HcNglV (%install) [INFO] Bad exit status from /var/tmp/rpm-tmp.HcNglV (%install) [INFO] [INFO] [INFO] RPM build errors: [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary for Ambari Server 3.0.0.0-SNAPSHOT: [INFO] [INFO] Ambari Server ...................................... FAILURE [02:10 min] [INFO] Ambari Functional Tests ............................ SKIPPED [INFO] Ambari Agent ....................................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:10 min [INFO] Finished at: 2023-10-21T15:03:07+05:30 [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.codehaus.mojo:rpm-maven-plugin:2.1.4:rpm (default-cli) on project ambari-server: RPM build execution returned: '1' executing '/bin/sh -c cd '/home/code/non-forked/ambari/ambari-server/target/rpm/ambari-server/SPECS' && 'rpmbuild' '-bb' '--target' 'x86_64-redhat-linux' '--buildroot' '/home/code/non-forked/ambari/ambari-server/target/rpm/ambari-server/buildroot' '--define' '_topdir /home/code/non-forked/ambari/ambari-server/target/rpm/ambari-server' '--define' '_build_name_fmt %%{ARCH}/%%{NAME}-%%{VERSION}-%%{RELEASE}.%%{ARCH}.rpm' '--define' '_builddir %{_topdir}/BUILD' '--define' '_rpmdir %{_topdir}/RPMS' '--define' '_sourcedir %{_topdir}/SOURCES' '--define' '_specdir %{_topdir}/SPECS' '--define' '_srcrpmdir %{_topdir}/SRPMS' 'ambari-server.spec'' -> [Help 1]
@wenwj0 any idea what changes to be done to make it build on rocky linux 8 also. It will be easy for me to review this PR if this can be build and tested on rocky linux 8 also.

JiaLiangC · 2023-10-22T01:09:25Z

@arshadmohammad

I was trying to build this PR(also applied #3758 changes) on rocky linux 8.8 but build failed with following error [INFO] error: Bad exit status from /var/tmp/rpm-tmp.HcNglV (%install) [INFO] Bad exit status from /var/tmp/rpm-tmp.HcNglV (%install) [INFO] [INFO] [INFO] RPM build errors: [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary for Ambari Server 3.0.0.0-SNAPSHOT: [INFO] [INFO] Ambari Server ...................................... FAILURE [02:10 min] [INFO] Ambari Functional Tests ............................ SKIPPED [INFO] Ambari Agent ....................................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:10 min [INFO] Finished at: 2023-10-21T15:03:07+05:30 [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.codehaus.mojo:rpm-maven-plugin:2.1.4:rpm (default-cli) on project ambari-server: RPM build execution returned: '1' executing '/bin/sh -c cd '/home/code/non-forked/ambari/ambari-server/target/rpm/ambari-server/SPECS' && 'rpmbuild' '-bb' '--target' 'x86_64-redhat-linux' '--buildroot' '/home/code/non-forked/ambari/ambari-server/target/rpm/ambari-server/buildroot' '--define' '_topdir /home/code/non-forked/ambari/ambari-server/target/rpm/ambari-server' '--define' '_build_name_fmt %%{ARCH}/%%{NAME}-%%{VERSION}-%%{RELEASE}.%%{ARCH}.rpm' '--define' '_builddir %{_topdir}/BUILD' '--define' '_rpmdir %{_topdir}/RPMS' '--define' '_sourcedir %{_topdir}/SOURCES' '--define' '_specdir %{_topdir}/SPECS' '--define' '_srcrpmdir %{_topdir}/SRPMS' 'ambari-server.spec'' -> [Help 1] @wenwj0 any idea what changes to be done to make it build on rocky linux 8 also. It will be easy for me to review this PR if this can be build and tested on rocky linux 8 also.

Things to note when compiling on Rocky8:
The maven-rpm-plugin used for rpm compilation will, by default, perform python compilation, and it uses /usr/bin/python for the compilation, which cannot be configured to use python3.
Therefore, on Rocky8, the old python2 soft link needs to be deleted, and create a new one using ln -s /usr/bin/python3 /usr/bin/python.

Jetiaime · 2024-01-30T08:37:38Z

ambari-agent/src/main/python/ambari_agent/main.py

seems like it should be 'w' rather than 'wb' in line 278，it's work when I using ambari-agent setup x, but if 'wb', it will clean the .ini file and raise error like: "a bytes-like object is required, not 'str'"

arshadmohammad · 2024-02-02T17:06:53Z

@wenwj0 @JiaLiangC any idea why CI is failing?

wenwj0 · 2024-02-03T17:12:54Z

@wenwj0 @JiaLiangC any idea why CI is failing?

The log shows that there is an error in org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (ambari-web unit tests) on project ambari-web. In the ambari-web unit tests part, I see that it executed command npm run.

The only error I found in this part is ERROR [launcher]: No binary for ChromeHeadless browser on your platform. Please, set "CHROME_BIN" env variable.

JiaLiangC · 2024-02-06T01:55:11Z

@arshadmohammad
Conclusion: This CI error is not related to PR AMBARI-26000; it's an issue with the trunk branch.

The error can be reproduced in the trunk branch code due to PR #3760.

Cause:
PR #3760 introduced chromium-browser, which caused the error during test execution because of the chromium-browser settings in our CI environment. This needs to be fixed in CI.

How to reproduce:
Operating System: Rocky Linux 8

Install chromium:
yum install -y chromium
Change directory to ambari:
cd ambari
Start compilation:
mvn -X -T 2C -am test -pl ambari-web -Dmaven.artifact.threads=10 -Drat.skip

As shown above, the error message is the same as in CI, confirming the reproduction of the issue!

Below is the error from CI:

How to solve:

The error message indicates that CHROME_BIN is not set, so let's set it:

export CHROME_BIN=/usr/bin/chromium-browser

Continue execution:
mvn -X -T 2C -am test -pl ambari-web -Dmaven.artifact.threads=10 -Drat.skip

Error message:
ERROR:zygote_host_impl_linux.cc(100)] Running as root without --no-sandbox is not supported. See https://crbug.com/638180.

How to solve:
Edit /usr/bin/chromium-browser:

vim /usr/bin/chromium-browser

Add --no-sandbox at the end of the file.

Then the compilation succeeds.

arshadmohammad · 2024-02-09T02:21:40Z

Thanks @JiaLiangC for detailed information on CI. We will address CI issue separate PR.

arshadmohammad · 2024-02-09T02:24:19Z

As discussed in mailing thread https://lists.apache.org/thread/htsfrt0zh89ql9covz721j696tskwqx3, I am going to merge this PR.

arshadmohammad

LGTM +1

wenwj0 · 2024-02-10T10:53:58Z

Thank @arshadmohammad very much for reviewing and merging the code, and also thank @Jetiaime and @eubnara for reviewing the code.

JiaLiangC · 2024-02-18T01:04:35Z

@vanshuhassija

@arshadmohammad Conclusion: This CI error is not related to PR AMBARI-26000; it's an issue with the trunk branch.

The error can be reproduced in the trunk branch code due to PR #3760.

Cause: PR #3760 introduced chromium-browser, which caused the error during test execution because of the chromium-browser settings in our CI environment. This needs to be fixed in CI.

How to reproduce: Operating System: Rocky Linux 8

Install chromium:
yum install -y chromium

Change directory to ambari:
cd ambari

Start compilation:
mvn -X -T 2C -am test -pl ambari-web -Dmaven.artifact.threads=10 -Drat.skip

As shown above, the error message is the same as in CI, confirming the reproduction of the issue!

Below is the error from CI:

How to solve:

The error message indicates that CHROME_BIN is not set, so let's set it:

export CHROME_BIN=/usr/bin/chromium-browser

Continue execution: mvn -X -T 2C -am test -pl ambari-web -Dmaven.artifact.threads=10 -Drat.skip

Error message:
ERROR:zygote_host_impl_linux.cc(100)] Running as root without --no-sandbox is not supported. See https://crbug.com/638180.

How to solve: Edit /usr/bin/chromium-browser:

vim /usr/bin/chromium-browser

Add --no-sandbox at the end of the file.

Then the compilation succeeds.

as mentioned above, the CI failed because your PR #3760
Could you help check and solve the problem? it blocked all other PR.

JiaLiangC · 2024-02-18T02:02:36Z

@arshadmohammad
#3760
It looks like this PR is causing disruption to the CI. Can we revert it first until this PR resolves the CI issue?

MacChen01 · 2024-02-18T02:49:02Z

Thank @arshadmohammad very much for reviewing and merging the code, and also thank @Jetiaime and @eubnara for reviewing the code.

Thank @arshadmohammad @Jetiaime @eubnara @JiaLiangC @wenwj0

Jati-Jostar · 2025-03-07T03:59:03Z

hello i got this error how to fix it

minixar · 2025-03-09T18:54:58Z

hello i got this error how to fix it

Hi!
I've the same issue using: rocky linux 9 + java 17 + python3.
I was able to work around the issue avoiding the rpm build.
mvn -B clean install package -DskipRpm -Drat.skip=true -DskipTests -Dmaven.test.skip=true
Then just use the .tar.gz in the target dir.
I suggest avoiding the trunk branch. I used the merge [5262967] with rockylinux 8 + java 1.8 + python3 and worked great.
Hope this help.

JiaLiangC · 2025-03-10T02:15:04Z

@Jati-Jostar @minixar Apologies for the lack of community manpower and missing relevant documentation. The 3.0 version is set to be released this month, which will include detailed compilation, deployment, and installation documentation, supporting both rocky8 and rocky9.

minixar · 2025-03-10T03:11:41Z

Thank @JiaLiangC for sharing the news about the release of the 3.0 version.
Is there a jira issue or epic for this task?

Jati-Jostar · 2025-03-10T03:20:59Z

ohh ok,thanks for the information sir

JiaLiangC · 2025-03-10T07:00:17Z

@Jati-Jostar @minixar The issue with the RPM packaging failure was caused by the system's handling of the shebang, and it has been resolved. The relevant fixes and compilation commands are in this PR: #3952

simonj217 · 2025-03-12T12:27:11Z

hi @JiaLiangC

Hello,
I was able to successfully build Ambari on RHEL 8 without any issues but i can not install ambari server .
log ---------------------------
/usr/jdk64/bin/java -version
openjdk version "17.0.14" 2025-01-21 LTS
OpenJDK Runtime Environment (Red_Hat-17.0.14.0.7-1) (build 17.0.14+7-LTS)
OpenJDK 64-Bit Server VM (Red_Hat-17.0.14.0.7-1) (build 17.0.14+7-LTS, mixed mode, sharing)
[root@m1 ~]# ambari-server setup ^C
[root@m1 ~]# ambari-server setup
bash: /usr/sbin/ambari-server: No such file or directory
[root@m1 ~]# yum install ambari-server
Last metadata expiration check: 1:32:51 ago on Wed 12 Mar 2025 01:47:47 PM +0330.
Dependencies resolved.

Package Architecture Version Repository Size

Installing:
ambari-server x86_64 3.0.0.0-SNAPSHOT ambari 134 M
Installing dependencies:
libpq x86_64 13.20-1.el8_10 appstream 198 k
postgresql x86_64 10.23-4.module+el8.9.0+1734+74bd286c appstream 1.5 M
postgresql-server x86_64 10.23-4.module+el8.9.0+1734+74bd286c appstream 5.1 M

Transaction Summary

Install 4 Packages

Total download size: 141 M
Installed size: 207 M
Is this ok [y/N]: y
Downloading Packages:
(1/4): libpq-13.20-1.el8_10.x86_64.rpm 53 kB/s | 198 kB 00:03
(2/4): postgresql-server-10.23-4.module+el8.9.0+1734+74bd286c.x86_64.rpm 1.3 MB/s | 5.1 MB 00:03
(3/4): postgresql-10.23-4.module+el8.9.0+1734+74bd286c.x86_64.rpm 404 kB/s | 1.5 MB 00:03
(4/4): ambari-server-3.0.0.0-SNAPSHOT.x86_64.rpm 346 MB/s | 134 MB 00:00

Total 33 MB/s | 141 MB 00:04
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Preparing : 1/1
Installing : libpq-13.20-1.el8_10.x86_64 1/4
Installing : postgresql-10.23-4.module+el8.9.0+1734+74bd286c.x86_64 2/4
Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+1734+74bd286c.x86_64 3/4
Installing : postgresql-server-10.23-4.module+el8.9.0+1734+74bd286c.x86_64 3/4
Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+1734+74bd286c.x86_64 3/4
Running scriptlet: ambari-server-3.0.0.0-SNAPSHOT.x86_64 4/4
Backing up configs: /etc/ambari-server/conf.save -> /etc/ambari-server/conf_12_03_25_15_20.save

Installing : ambari-server-3.0.0.0-SNAPSHOT.x86_64 4/4
Running scriptlet: ambari-server-3.0.0.0-SNAPSHOT.x86_64 4/4
Verifying : libpq-13.20-1.el8_10.x86_64 1/4
Verifying : postgresql-10.23-4.module+el8.9.0+1734+74bd286c.x86_64 2/4
Verifying : postgresql-server-10.23-4.module+el8.9.0+1734+74bd286c.x86_64 3/4
Verifying : ambari-server-3.0.0.0-SNAPSHOT.x86_64 4/4

Installed:
ambari-server-3.0.0.0-SNAPSHOT.x86_64 libpq-13.20-1.el8_10.x86_64 postgresql-10.23-4.module+el8.9.0+1734+74bd286c.x86_64
postgresql-server-10.23-4.module+el8.9.0+1734+74bd286c.x86_64

Complete!
[root@m1 ~]# ambari-server setup
Using python /usr/bin/python3
Setup ambari-server
Checking SELinux...
SELinux status is 'disabled'
Customize user account for ambari-server daemon [y/n] (n)?
Adjusting ambari-server permissions and ownership...
Checking firewall status...
Checking JDK...
[1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8
[2] Custom JDK

Enter choice (1): 2
WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts.
WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts.
Path to JAVA_HOME: /usr/jdk64/
Validating JDK on Ambari Server...done.
Checking GPL software agreement...
GPL License for LZO: https://www.gnu.org/licenses/old-licenses/gpl-2.0.en.html
Enable Ambari Server to download and install GPL Licensed LZO packages [y/n] (n)?
Completing setup...
Configuring database...
Enter advanced database configuration [y/n] (n)? n
Configuring database...
Default properties detected. Using built-in database.
Configuring ambari database...
Checking PostgreSQL...
Running initdb: This may take up to a minute.
About to start PostgreSQL
Configuring local database...
Configuring PostgreSQL...
Backup for pg_hba found, reconfiguration not required
Creating schema and user...
done.
Creating tables...
done.
Extracting system views...
INFO: Looking for available JDKs at /usr/jdk64
ERROR: No JDK found, please run the "setup" command to install a JDK automatically or install any JDK manually to /usr/jdk64
ERROR: Exiting with exit code 1.
REASON: Error while extracting system views. Exiting

aghazeh · 2025-03-12T21:07:19Z

hi @arshadmohammad @JiaLiangC
vi ambari-server-command.log

INFO 2025-03-12 14:02:52,509 ambari-server.py:1804 - loglevel=logging.INFO
INFO 2025-03-12 14:02:52,509 serverSetup.py:1391 - Setup ambari-server.
ERROR 2025-03-12 14:03:27,753 ambari-server.py:1921 - 'Fatal exception: Error while extracting system views. Exiting, exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 1902, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 131, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/ambari-server/lib/ambari_server/serverSetup.py", line 1455, in setup
raise FatalException(retcode, err)
ambari_commons.exceptions.FatalException: 'Fatal exception: Error while extracting system views. Exiting, exit code 1'
INFO 2025-03-12 14:05:11,710 ambari-server.py:1804 - loglevel=logging.INFO
INFO 2025-03-12 14:05:11,710 serverSetup.py:1391 - Setup ambari-server.
ERROR 2025-03-12 14:05:39,730 ambari-server.py:1921 - 'Fatal exception: Error while extracting system views. Exiting, exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 1902, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 131, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/ambari-server/lib/ambari_server/serverSetup.py", line 1455, in setup
raise FatalException(retcode, err)
ambari_commons.exceptions.FatalException: 'Fatal exception: Error while extracting system views. Exiting, exit code 1'
INFO 2025-03-12 14:08:37,834 ambari-server.py:1804 - loglevel=logging.INFO
INFO 2025-03-12 14:08:37,835 serverSetup.py:1391 - Setup ambari-server.
ERROR 2025-03-12 14:09:01,036 ambari-server.py:1921 - 'Fatal exception: Error while extracting system views. Exiting, exit code 1'
Traceback (most recent call last):
File "/usr/sbin/ambari-server.py", line 1902, in main
action_obj.execute()
File "/usr/sbin/ambari-server.py", line 131, in execute
self.fn(*self.args, **self.kwargs)
File "/usr/lib/ambari-server/lib/ambari_server/serverSetup.py", line 1455, in setup
raise FatalException(retcode, err)
ambari_commons.exceptions.FatalException: 'Fatal exception: Error while extracting system views. Exiting, exit code 1'
INFO 2025-03-12 14:09:31,253 ambari-server.py:1804 - loglevel=logging.INFO
INFO 2025-03-12 14:09:31,253 serverSetup.py:1391 - Setup ambari-server.
ERROR 2025-03-12 14:09:41,388 ambari-server.py:1921 - "Fatal exception: Downloading or installing JDK failed: 'Fatal exception: Failed to download JDK: <urlopen error [Errno -2] Name or service not known>. Please check that the JDK is available at http://public-repo-1.hortonworks.com/ARTIFACTS/jdk-8u112-linux-x64.tar.gz. Also you may specify JDK file location in local filesystem using --jdk-location command line argument., exit code 1'. Exiting., exit code 1"
Traceback (most recent call last):
File "/usr/lib64/python3.6/urllib/request.py", line 1349, in do_open
encode_chunked=req.has_header('Transfer-encoding'))
File "/usr/lib64/python3.6/http/client.py", line 1273, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/usr/lib64/python3.6/http/client.py", line 1319, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/usr/lib64/python3.6/http/client.py", line 1268, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/lib64/python3.6/http/client.py", line 1044, in _send_output
self.send(msg)

Jati-Jostar · 2025-03-14T04:28:37Z

im sorry but im still got the same error, i think its about os architecture mine is x86_64 rocky9 , and on the log is showing that 2 file is not recognizeable because the format of the file is ppc64le

simonj217 · 2025-05-03T13:39:38Z

Hello,

I was able to build Apache Ambari successfully. Now, I want to install BigTop 3.3 services using Ambari.

I have two questions for you:

1 - Do I need to build BigTop from scratch so that its packages are like zookeeper_3_3_3 instead of just zookeeper? Because I use the -PpkgSuffix option during the build process. Can Ambari use the packages that were built by you and published on the Apache website directly, or do I need to build them myself?

2 - And my last question is that bigtop-select uses Python 2, but the version of Ambari I have uses Python 3, and most of the time this causes problems. What is your solution for installing BigTop 3.3 with Ambari that is running on Python 3?

minixar · 2025-05-05T16:15:13Z

Hi @simonj217
I think you can find here: https://ambari.apache.org/docs/3.0.0/ambari-dev/bigtop-guide/ the answer to your questions.
Bye

AMBARI-26000 support python3 on trunk

24b36ab

Co-authored-by: jialiang <2510095164@qq.com>

wenwj0 mentioned this pull request Sep 4, 2023

AMBARI-25854: Adapt Ambari 2.7.5 from python2 to python3.9 #3681

Open

wenwj0 and others added 2 commits September 6, 2023 21:22

remove yum since it's not supported in py3

35aeae3

1.fix shell decode error

4029ee8

2.fix sudo encoding error 3.remove redunant get_encoded_string

arshadmohammad mentioned this pull request Sep 22, 2023

AMBARI-26004: Support Ambari agent test case execution on Python3 environment #3754

Closed

wenwj0 changed the title ~~AMBARI-26000: Ambari supports Python3 environment~~ AMBARI-26000: Ambari supports Python3 environment. Sep 22, 2023

wenwj0 changed the title ~~AMBARI-26000: Ambari supports Python3 environment.~~ Ambari supports Python3 environment Sep 22, 2023

wenwj0 changed the title ~~Ambari supports Python3 environment~~ AMBARI-26000: Ambari supports python3 environment Sep 22, 2023

wenwj0 changed the title ~~AMBARI-26000: Ambari supports python3 environment~~ AMBARI-26000: Make Ambari supports Python3 environment Sep 22, 2023

remove duplicate import

2950027

eubnara reviewed Sep 28, 2023

View reviewed changes

wenwj0 force-pushed the AMBARI-26000-trunk branch from f06a089 to 25f64c2 Compare January 28, 2024 11:38

fix review comment

3d7e900

wenwj0 force-pushed the AMBARI-26000-trunk branch from 25f64c2 to 3d7e900 Compare January 28, 2024 12:43

Jetiaime reviewed Jan 30, 2024

View reviewed changes

arshadmohammad approved these changes Feb 9, 2024

View reviewed changes

arshadmohammad merged commit 5f95ec6 into apache:trunk Feb 9, 2024

JiaLiangC mentioned this pull request Feb 23, 2024

AMBARI-26009: Add Rocky8 operating system support #3758

Merged

timyuer mentioned this pull request Feb 24, 2024

BIGTOP-4063: Adapt bigtop-select to Python 3 apache/bigtop#1236

Merged

2 tasks

JiaLiangC mentioned this pull request Mar 7, 2024

AMBARI-26056: Add ranger kms support #3775

Merged

zRains mentioned this pull request Aug 2, 2024

AMBARI-26100: Fix all python script file to python3 #3799

Merged

AMBARI-26000: Make Ambari supports Python3 environment #3751

AMBARI-26000: Make Ambari supports Python3 environment #3751

Uh oh!

Conversation

wenwj0 commented Sep 4, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What changes were proposed in this pull request?

How was this patch tested?

Uh oh!

wenwj0 commented Sep 4, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

JiaLiangC commented Sep 15, 2023

Uh oh!

virajjasani commented Sep 19, 2023

Uh oh!

arshadmohammad commented Sep 22, 2023

Uh oh!

JiaLiangC commented Sep 22, 2023

Uh oh!

arshadmohammad commented Sep 22, 2023

Uh oh!

JiaLiangC commented Sep 22, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

arshadmohammad commented Sep 22, 2023

Uh oh!

JiaLiangC commented Sep 22, 2023

Uh oh!

JiaLiangC commented Sep 22, 2023

Uh oh!

arshadmohammad commented Sep 22, 2023

Uh oh!

JiaLiangC commented Sep 22, 2023

Uh oh!

MacChen01 commented Sep 27, 2023

Uh oh!

eubnara Sep 28, 2023

Choose a reason for hiding this comment

Uh oh!

wenwj0 Sep 30, 2023

Choose a reason for hiding this comment

Uh oh!

eubnara commented Sep 28, 2023

Uh oh!

eubnara Sep 28, 2023

Choose a reason for hiding this comment

Uh oh!

wenwj0 Sep 30, 2023

Choose a reason for hiding this comment

Uh oh!

wenwj0 commented Sep 30, 2023

Uh oh!

arshadmohammad commented Oct 21, 2023

Uh oh!

arshadmohammad commented Oct 21, 2023

Uh oh!

JiaLiangC commented Oct 22, 2023

Uh oh!

Jetiaime Jan 30, 2024

Choose a reason for hiding this comment

Uh oh!

arshadmohammad commented Feb 2, 2024

Uh oh!

wenwj0 commented Feb 3, 2024

Uh oh!

JiaLiangC commented Feb 6, 2024

Uh oh!

arshadmohammad commented Feb 9, 2024

Uh oh!

arshadmohammad commented Feb 9, 2024

Uh oh!

arshadmohammad left a comment

Choose a reason for hiding this comment

Uh oh!

wenwj0 commented Feb 10, 2024

Uh oh!

JiaLiangC commented Feb 18, 2024

Uh oh!

JiaLiangC commented Feb 18, 2024

wenwj0 commented Sep 4, 2023 •

edited

Loading

wenwj0 commented Sep 4, 2023 •

edited

Loading

JiaLiangC commented Sep 22, 2023 •

edited

Loading

MacChen01 commented Feb 18, 2024 •

edited

Loading

hi @arshadmohammad @JiaLiangC
vi ambari-server-command.log