build: optimize docker build by better utilizing build cache

[pwang2]

SUMMARY

Using common docker build practice to use docker build cache better.
New docker image build

1. 394.79 MB -> 348.48 MB
2. 3-5 minutes saving for initial build by not copying/deleting unneeded file, especial node_modules.
3. merged the first stage to the lean image. still being able to cache the pip requirements installation.
4. fix the random error when delete node_modules folder.

BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

TESTING INSTRUCTIONS

podman build -t superset  --no-cache --target lean -f ./Dockerfile

ADDITIONAL INFORMATION

• Has associated issue:
• Required feature flags:
• Changes UI
• Includes DB Migration (follow approval process in SIP-59)
  • Migration is atomic, supports rollback & is backwards-compatible
  • Confirm DB migration upgrade and downgrade tested
  • Runtime estimates and downtime expectations provided
• Introduces new feature or API
• Removes existing feature or API

[github-actions]

Congrats on making your first PR and thank you for contributing to Superset! 🎉 ❤️
We hope to see you in our Slack community too!

[EugeneTorap]

@pwang2 Thank you so much for this PR!
The changes should be speeds up docker build CI by 3-5 minutes.

[pwang2]

Receiving a lot of GitHub Actions failure which I believe should nothing to do with the change here. Can anyone help me figure out if anything missing from my side.

[zhaoyongjie]

LGTM, leave one question for the py_ver argument in Node section.

[zhaoyongjie]

IMO setup.py to read package.json isn't a good idea but exists a long time in Superset, might change this logic in the separated PR.