[SPARK-49495][DOCS] Document and Feature Preview on the master branc…

…h via Live GitHub Pages Updates

    ### What changes were proposed in this pull request?

    This pull request introduces functionalities that enable 'Document and Feature Preview on the master branch via Live GitHub Pa
ges Updates'.

    ### Why are the changes needed?

    - Instead of limited 72-hour voting phases, it provides the developer community with more opportunities to preview and verify
the documentation contents.
    - Instead of waiting for the final announcement of an official spark feature release, users can now preview some of the ongoin
g documented features, increasing the willingness to upgrade, sensing breaking changes in advance, and reducing the burden during
the final upgrades.

    ### Does this PR introduce _any_ user-facing change?

    No

    ### How was this patch tested?

    An [example](https://yaooqinn.github.io/spark-gh-pages/) has been established by this repo - https://github.com/yaooqinn/spark
-gh-pages

    - Broken logo links are fixed at apache#47966

    ### Was this patch authored or co-authored using generative AI tooling?
    no

.asf.yaml

@@ -32,7 +32,7 @@ github:
     squash: true
     rebase: true
   ghp_branch: master
-  ghp_path: /docs/_site
+  ghp_path: /docs
 
 notifications:
   pullrequests: reviews@spark.apache.org

.github/workflows/pages.yml

@@ -26,7 +26,7 @@ on:
 
 concurrency:
   group: 'docs preview'
-  cancel-in-progress: true
+  cancel-in-progress: false
 
 jobs:
   docs:
@@ -35,6 +35,8 @@ jobs:
     permissions:
       id-token: write
       pages: write
+    environment:
+      name: github-pages # https://github.com/actions/deploy-pages/issues/271
     env:
       SPARK_TESTING: 1 # Reduce some noise in the logs
       RELEASE_VERSION: 'In-Progress'