Add pip install bigdl

[shanyu-sys]

Add empty bigdl packages with all bigdl packages (bigdl-orca, bigdl-nano, bigdl-chronos, bigdl-friesian, bigdl-serving) as install_requires. Note that I didn't explicitly added bigdl-dllib, bigdl-math, bigdl-tf, since they are already included in bigdl-orca install_requires

[shanyu-sys]

Related issue #3195

[jason-dai]

description is not correct

[jason-dai]

Need to update jenkins job to include it in the release job

[jason-dai]

LGTM

[shanyu-sys]

Need to update jenkins job to include it in the release job

Sure.

Besides, I have tested in local and it failed since bigdl-nano might not be included in our nightly release.

Shall we also add bigdl-nano to our combined release scripts (e.g release_default_linux_spark246)?

[jason-dai]

Need to update jenkins job to include it in the release job

Sure.

Besides, I have tested in local and it failed since bigdl-nano might not be included in our nightly release.

Shall we also add bigdl-nano to our combined release scripts (e.g release_default_linux_spark246)?

Yes

[shanyu-sys]

Need to update jenkins job to include it in the release job

Sure.
Besides, I have tested in local and it failed since bigdl-nano might not be included in our nightly release.
Shall we also add bigdl-nano to our combined release scripts (e.g release_default_linux_spark246)?

Yes

@leonardozcm is working on it. I will test again after bigdl-nano released.

[shanyu-sys]

Local test has passed. I will merge this PR first for public release, and test on Jenkins with released bigdl.

Below tasks will be done after release:

• Create NB Jenkins jobs including example tests of chronos, orca, freisian, nano and serving, dllib, and test with pip install bigdl. https://github.com/intel-analytics/arda-docker/issues/421
• Add release bigdl in combined release scripts and support nightly release to pypi. Add bigdl release to combined release script #3287
• Verify pip install --pre bigdl: Jenkins passed

[hkvision]

One main issue remaining is how to uninstall? For install we can install everything by dependency, but when uninstall, it uninstalls nothing right?

[shanyu-sys]

One main issue remaining is how to uninstall? For install we can install everything by dependency, but when uninstall, it uninstalls nothing right?

I haven't come up with a good idea. We could first provide a one-line command in the document for users
e.g.

pip uninstall bigdl-dllib bigdl-orca bigdl-chronos ...

The issue for pip for supporting pip uninstall dependencies is still open: pypa/pip#5823
An extra tool like pip3-autoremove could uninstall all the dependencies.
Or do you have better suggestions? It will also benefit uninstall for bigdl-orca

[shanyu-sys]

Update:

1. NB Jenkins job has been enabled with pip install --pre --upgrade bigdl, below jobs have been added and passed.

• Dllib: http://10.112.231.51:18888/job/BigDL-NB-Dllib-Python-ExampleTests-py36/3/
• Orca: http://10.112.231.51:18888/job/BigDL-NB-Orca-Python-ExampleTests-py36-ray/6/
• Chronos: http://10.112.231.51:18888/job/BigDL-NB-chronos-Example-py36-ray/1/
• Friesian: http://10.112.231.51:18888/job/BigDL-NB-Python-Friesian-ExampleTest-Spark-2.4-feature+tf1-pip/8/console

2. bigdl whl has been released on pypi
3. pip uninstall command has been added on user guide Change Analytics Zoo to BigDL in python user guide #3255