Update docs to include SparkStreamingDataSet and ManagedTableDataSet (#…

…2679)

* Update kedro_datasets.rst

* test branch

* Re-trigger CI

* Re-trigger CI pt 2

* Re-trigger CI pt 3

* Re-trigger CI pt N

* Update setup.py

* Update setup.py

* Update setup.py

* Update setup.py

* Update .readthedocs.yml

* Update kedro_datasets.rst

I hope htis is right!

* Modify setup.py

Signed-off-by: Jannic Holzer <jannic.holzer@quantumblack.com>

* Modify setup.py

Signed-off-by: Jannic Holzer <jannic.holzer@quantumblack.com>

* Empty commit

Signed-off-by: Jannic Holzer <jannic.holzer@quantumblack.com>

* Trigger build

Signed-off-by: Jannic Holzer <jannic.holzer@quantumblack.com>

* Remove spurious whitespace

Signed-off-by: Jannic Holzer <jannic.holzer@quantumblack.com>

* Change pip list -> pip freeze to ease debugging

* Update setup.py

---------

Signed-off-by: Jannic Holzer <jannic.holzer@quantumblack.com>
Co-authored-by: Ahdra Merali <90615669+AhdraMeraliQB@users.noreply.github.com>
Co-authored-by: Jo Stichbury <jo_stichbury@mckinsey.com>
Co-authored-by: Jannic Holzer <jannic.holzer@quantumblack.com>
Co-authored-by: Juan Luis Cano Rodríguez <juan_luis_cano@mckinsey.com>

.readthedocs.yml

@@ -16,6 +16,7 @@ build:
     post_create_environment:
       - npm install -g @mermaid-js/mermaid-cli
     pre_build:
+      - pip freeze
       - python -m sphinx -WETan -j auto -D language=en -b linkcheck -d _build/doctrees docs/source _build/linkcheck
 
 # Build documentation in the docs/ directory with Sphinx

docs/source/kedro_datasets.rst

@@ -14,6 +14,7 @@ kedro_datasets
    kedro_datasets.api.APIDataSet
    kedro_datasets.biosequence.BioSequenceDataSet
    kedro_datasets.dask.ParquetDataSet
+   kedro_datasets.databricks.ManagedTableDataSet
    kedro_datasets.email.EmailMessageDataSet
    kedro_datasets.geopandas.GeoJSONDataSet
    kedro_datasets.holoviews.HoloviewsWriter
@@ -45,6 +46,7 @@ kedro_datasets
    kedro_datasets.spark.SparkDataSet
    kedro_datasets.spark.SparkHiveDataSet
    kedro_datasets.spark.SparkJDBCDataSet
+   kedro_datasets.spark.SparkStreamingDataSet
    kedro_datasets.svmlight.SVMLightDataSet
    kedro_datasets.tensorflow.TensorFlowModelDataSet
    kedro_datasets.text.TextDataSet

setup.py

@@ -104,7 +104,7 @@ def _collect_requirements(requires):
         "sphinxcontrib-mermaid~=0.7.1",
         "myst-parser~=1.0.0",
         "Jinja2<3.1.0",
-        "kedro-datasets[all]~=1.4.0",
+        "kedro-datasets[all]~=1.4.2",
     ],
     "geopandas": _collect_requirements(geopandas_require),
     "matplotlib": _collect_requirements(matplotlib_require),