Releases: red-hat-data-services/ods-ci
Releases · red-hat-data-services/ods-ci
2.15.0
What's Changed
New Tests
- Adds a new tests to check the notebook controllers deployments by @jstourac in #1957
- Added Tensorflow model REST protocol test on triton for Modelmesh by @Raghul-M in #1840
- Add pre/post upgrade test for Model Registry by @lugi0 in #1970
Enhancements
- Only upload the openshift CA cert if the cluster is self-managed in MR test by @lugi0 in #1936
- Fix: new start and stop wb buttons by @FedeAlonso in #1953
- RHOAIENG-14857 Update the test to implement data-testids by @ConorOM1 in #1954
Other Changes
- Increase timeout for Iris Pipeline by @diegolovison in #1935
- Automated test to verify AMD GPU's can be used in Data Science Pipelines by @diegolovison in #1932
- Add GPU specific Tags by @bdattoma in #1938
- fix for single serving test by @ConorOM1 in #1934
- Updating Python Client to 0.2.8a1 by @tonyxrmdavidson in #1949
- Update latest Codeflare-SDK release tag by @Srihari1192 in #1950
- Remove generation validation from Pipelines Test by @diegolovison in #1955
- enhancement: adding trustyai coverage for it to be GA in 2.15 by @CFSNM in #1956
- Update images for 2.15 release by @ChughShilpa in #1958
- Automation tests for tensorflow model gRPC RHOAIENG-9052 for triton by @rpancham in #1844
- RHOAIENG-14416 - Implement check for missing tests by @jiripetrlik in #1951
- Add AutomationBug tag to drift tests by @adolfo-ab in #1946
- Update 0110__service_mesh.robot by @asanzgom in #1961
- Update codeflare-sdk python env use by @Srihari1192 in #1960
- fix: minor fix in deployment command to find replicas by @CFSNM in #1962
- [DW] - Update test name by @ChughShilpa in #1966
- Smoke Test for Model-Registry Deploment without UI by @tonyxrmdavidson in #1969
Full Changelog: 2.14.0...2.15.0
2.14.0
What's Changed
New Tests
- RHOAIENG-12725 - Trusted CA Bundle Namespace Exclusion by @mattmahoneyrh in #1797
- Add test for CVE-2024-7557 by @lugi0 in #1816
- Enhance kfp client keywords and add basic DSP acceptance test suite by @jgarciao in #1828
- Added onnx model gRPC protocol test on triton by @Raghul-M in #1790
- Automate Validate ServiceMeshControlPlaneAlreadyCreated Test Case by @asanzgom in #1762
- Add dsp-gpu-nvidia testsuite by @jgarciao in #1842
- Add initial upgrade testing for Data Science Pipelines by @jgarciao in #1869
Enhancements
- fix: DSProjects view wrong xpath by @FedeAlonso in #1801
- Add support for provisioning GPUs from GCP by @bdattoma in #1794
- Remove two Model Serving tests from Smoke by @lugi0 in #1793
- RHOAIENG-12833 - Validate Image Pull Path Is From registry.redhat.io by @mattmahoneyrh in #1809
- Increase cluster provisioning timeout by @bdattoma in #1820
- Update button xpath to work with latest ODH by @lugi0 in #1837
- Updating Model Registry E2E Test to Use the Latest Python Client by @tonyxrmdavidson in #1838
- Set DSCInitialization timeout to 3 minutes if TEST_ENV is CRC by @manosnoam in #1845
- Fix for the Elyra pipeline execution by @jstourac in #1858
- Fix: xpath=//input[@data-testid="resource-manage-project-modal-name"] failure by @ConorOM1 in #1857
- Introduce support for the Jupyter/Elyra 4. by @jstourac in #1859
- RHOAIENG-12022 - Enable DSC Modelregistry Tests To Run On RHOAI by @mattmahoneyrh in #1831
- fix: ODS-2206, wrong pipelines xpath by @FedeAlonso in #1868
- Add ModelRegistry Namespace Check by @mattmahoneyrh in #1862
- Fix check for nvidia-device-plugin-daemonset when deploying NVIDIA operator stack by @bdattoma in #1871
- Shorten the name of a project resource name to pass the check by @jstourac in #1881
- Model Registry e2e UI test + breaking ui changes by @lugi0 in #1879
- Enable Model Registry test in Smoke by @lugi0 in #1883
- Status for the starting workbench doesn't contain three dots anymore by @jstourac in #1884
- Add 2.14 tgis runtime image by @tarukumar in #1889
- Remove kube-rbac-proxy container due to RHOAIENG-13837 by @lugi0 in #1893
- Add new runtime image for vllm by @tarukumar in #1894
- Update the Python version and other requirements for the 2024b OOTB images by @jstourac in #1870
- Increase timeout when saving permissions in Dashboard by @jgarciao in #1897
- Fix the workbench start for the Jupyter 4 (images 2024.2) by @jstourac in #1899
- Dynamically change python target version for MR dependencies by @lugi0 in #1898
- fix: increase logo's timeout by @FedeAlonso in #1904
- fix: ODS-1813 wrong span by @FedeAlonso in #1903
- [Fix] partially reverts #1901 as we should keep using the library keyword by @jstourac in #1905
- Reorganize sample pipelines in "cache-enabled" and "cache-disabled" folders by @jgarciao in #1891
- [Fix] the Jupyter tests for working with git repository by @jstourac in #1909
- Fix user permission tests by @jstourac in #1913
- [Fix] test that checks that Notebook resource has expected size by @jstourac in #1916
- Fix suite
0401__ods_dashboard
Tests and Keywords by @manosnoam in #1912 - [Fix] the tests for custom image import by @jstourac in #1920
- [Fix] expected version in the 2024.2 images by @jstourac in #1919
- Fix: Dashboard UI tests by @FedeAlonso in #1922
- [Fix] the test for the package versions on images by @jstourac in #1923
- [Fix] the project selector on the pipelines page by @jstourac in #1929
- [Fix] the tests for the minimal image by @jstourac in #1930
- [Fix] this fixes the negative test for the Anaconda app integration by @jstourac in #1931
- Remove Deprovision on failure from OCP provisioning task by @bdattoma in #1924
Enhancements in scripts and CI/CD
- Fix
pip install
s in GitHub Actions by @jiridanek in #1926
Other Changes
- Update RHODS to RHOAI on README.md by @asanzgom in #1805
- Added support env variables to run Codeflare and Codeflare-SDK tests … by @abhijeet-dhumal in #1657
- Update to reflect changes in model-registry-operator config files. by @tonyxrmdavidson in #1804
- Bump kfp to 2.9.0 and kfp-kubernetes to 1.3.0 by @diegolovison in #1795
- Added File for triton REST Input by @Raghul-M in #1812
- Automation tests for pytorch model RHOAIENG-9071 for triton by @rpancham in #1814
- Automation tests for pytorch model RHOAIENG-9066 for triton Kserve by @rpancham in #1811
- Fix
Verify User Can Validate Scale To Zero
test case by @hdefazio in #1788 - Apply workaround for FIPS installation by @apodhrad in #1826
- RHOAIENG-12880 - Split Distributed Workloads test suites by @jiripetrlik in #1818
- Adjusted distributed workloads UI metrics test keyword for post upgra… by @abhijeet-dhumal in #1792
- RHOAIENG-13014 - Rewrite Verify RHODS Operator Logs test by @MarianMacik in #1822
- fix typo in create_project_btn by @lugi0 in #1839
- Add customRayImage test by @ChughShilpa in #1836
- add pre/during/post upgrade tags to be able to use it more efficiently by @kobihk in #1832
- fix: include modelregistry in the dsc template by @CFSNM in #1823
- Add QLoRA sanity test for training operator by @abhijeet-dhumal in #1852
- fix: include model registry condition to wait for ready by @CFSNM in #1855
- Fix
Verify User Can Set Requests And Limits For A Model
test case in ods-ci by @hdefazio in #1810 - Disable QLoRA sanity test because the required model supported for QL… by @abhijeet-dhumal in #1860
- Add support to provide runtime image dynamically for vllm by @tarukumar in #1863
- Fix dry run by @tarukumar in #1864
- add RESOURCE_EDIT_BTN variable and check for it by @ConorOM1 in #1865
- Disable Test SMCP Already Created by @mattmahoneyrh in #1874
- Removing hard coded auth_provider by @tonyxrmdavidson in #1878
- Add the Resources-GPU tag to a test that requires GPU by @jstourac in #1882
- Update Ray image to latest available by @sutaa...
2.13.0
What's Changed
New Tests
- RHOAIENG-7217 KServe and KServe.Serving management states by @mattmahoneyrh in #1736
- Added onnx model REST protocol test on triton by @Raghul-M in #1737
- caikit standalone embeddings test endpoints for kserve by @nehachopra27 in #1744
- Added onnx model Modelmesh test on triton by @Raghul-M in #1777
New Tasks
Enhancements
- Rename some root suite directories to reflect new scrum org by @bdattoma in #1734
- Fix "SKIPPED" status in Post upgrade suite by @bdattoma in #1738
- Create root suite directory for unassigned components and move culler suite under IDE by @bdattoma in #1743
- Disable ModelRegistry Tests On RHOAI by @mattmahoneyrh in #1749
- Check KServer Managment State To Ensure That It Is Not Empty by @mattmahoneyrh in #1751
- [fix] xpaths to couple of elements in dashboard data science projects by @jstourac in #1756
- Fix keyword to watch SM cluster provisioning logs and increase timeout by @bdattoma in #1754
- [fix] xPaths with regards the change in RHOAI 2.13 by @jstourac in #1763
- Refactor Data Science Pipelines Backend Tests introducing new keywords by @jgarciao in #1767
- Fix
Verify User Can Change The Minimum Number Of Replicas For A Model
test case in ods-ci by @hdefazio in #1765 - Fix variable evaluation in "Verify Model Inference" and associated keywords by @lugi0 in #1773
- Fix JupyterHub tag in special-user-testing test suite by @jgarciao in #1771
- Fix wrong argument in test case, missing argument in keyword call (deployment_mode) by @lugi0 in #1782
- Add additional params for object storage configuration in CreatePipelineServer, fixing tests on disconnected by @jgarciao in #1781
- Use single tier/gate tag, fix robocop complaints in Model Serving Test Suites by @lugi0 in #1778
- Fix pipeline server creation when url ends with / by @jgarciao in #1791
- Increase Trusted CA Bundle Resource Check Timeouts by @mattmahoneyrh in #1796
Other Changes
- Support disconnected environment for Pipeline SDK tests by @diegolovison in #1730
- fix: solve issues when uninstalling and reinstalling serverless operator due to operator group not being removed by @CFSNM in #1739
- Pipeline for Importer Components by @diegolovison in #1723
- fix: use common vars in the oc uninstall keywords by @CFSNM in #1745
- Fix "Verify User Can Access Model Metrics From UWM" test in "Model Serving Llm" suite by @hdefazio in #1755
- Fix DW UI test image to use image digest by @Srihari1192 in #1760
- Added new tests to validate release.name and release.version attributes of a dsc/dsci by @CFSNM in #1750
- Create pipeline run with different user by @diegolovison in #1628
- Update runtime image for 2.13 by @tarukumar in #1766
- fix: rework in some of the operator test cases by @CFSNM in #1761
- Allow to install gpu-operator-certified in disconnected env by @apodhrad in #1639
- Fix for Authorino TC by @mwaykole in #1770
- Update DW UI tests to accommodate changes introduced in 2.13 and instability tests by @Srihari1192 in #1758
- reworking platform tests tagging following the 1-tag approach by @CFSNM in #1769
- fix: increase dsci timeout by @CFSNM in #1774
- Add verification for container images in smoke test by @ChughShilpa in #1759
- Use newer fms-hf-tuning image by @sutaakar in #1775
- fix: solving some issues in the must gather tests by @CFSNM in #1776
- Add Rhods Osd Install Repo to generateTestConfigFile by @asanzgom in #1780
- fix: add rhosi setup as a requirement for post-upgrade setup by @CFSNM in #1785
- [RHOAIENG-11805] Avoid multiple suite tags for IDE tests by @jstourac in #1787
- Update to allow installation of the Python Client without external access by @tonyxrmdavidson in #1779
- Add new runtime image with chat-template for vllm by @tarukumar in #1798
- fix: remove flaky condition to avoid false negative results for the rhods log test by @CFSNM in #1799
New Contributors
Full Changelog: 2.12.0...2.13.0
2.12.0
2.11.0
What's Changed
New Tests
- RHOAIENG-8546 - Platform DSC Modelmeshserving Test Case by @mattmahoneyrh in #1530
- Feat: Authorino UI basic test by @FedeAlonso in #1485
Enhancements
- Set default SR for Kserve to Caikit+TGIS by @lugi0 in #1558
- Force Caikit TGIS SR in UI tests by @lugi0 in #1559
- [vllm/tgis]Add support for amd for model deployment by @tarukumar in #1564
- Adapt Data Science Pipelines tests to changes introduced by Pipeline Experiments by @jgarciao in #1576
- Check that the URL list is not empty before verifying HTTP status by @manosnoam in #1584
Enhancements in scripts and CI/CD
- Update amd script by @bdattoma in #1540
- Generalize GPU provisioning script to ease the addition of new providers by @bdattoma in #1568
Misc
- Move Serving and Pipelines suites out of Dashboard folder by @bdattoma in #1553
- Create IDE test suite directory with proper nested suites by @bdattoma in #1562
- Move ai explainability suite in dedicated directory by @bdattoma in #1575
Other Changes
- Add Upgrade test scenarios for Distributed workloads by @Srihari1192 in #1491
- moved 144 Dsc Negative No Dependant Op to Tier3 by @asanzgom in #1566
- Tag both Operator and ModelRegistry on 112_model_registry by @asanzgom in #1567
- RHOAIENG-3472: Added test to validate the DSC without dependant operator when kserver is unmanaged by @CFSNM in #1556
- update test name in codeflare tests by @ChughShilpa in #1573
- Access job submission as non-admin by @diegolovison in #1571
- Update repo for codeflare tests by @ChughShilpa in #1570
- All pipelines connections are secured by default from the client perspective by @diegolovison in #1577
- Fix Test
Verify Resource Link HTTP Status Code
by @manosnoam in #1582 - Add granite 7b lab model by @tarukumar in #1579
- Update rhoai 2.11 runtime images by @tarukumar in #1585
- RHOAIENG-7226 - Add TestMnistRayGpu by @jiripetrlik in #1580
- RHOAIENG-2512: Added test to validate the DSC and DSCI when Serverless operator is not installed by @CFSNM in #1574
- RHOAIENG-7919 Istio Kserve Gateway For Internal Endpoint by @mattmahoneyrh in #1583
- Update AppsInfoDictionary_latest.json with the new App: Elasticsearch by @manosnoam in #1590
- Add DW test to verify requested resources in case of multiple local queue exists by @Srihari1192 in #1565
Full Changelog: 2.10.0...2.11.0
2.10.0
What's Changed
New Tests
- RHOAIENG-5435 - Distributed Workloads Components by @mattmahoneyrh in #1392
- RHOAIENG-6627 - Training-Operator test case by @mattmahoneyrh in #1430
- Add base test for vLLM and its metrics by @lugi0 in #1438
- RHOAIENG-7181 Check DW Components are Enabled by Default by @asanzgom in #1502
- Expanded vLLM metrics test by @lugi0 in #1500
- RHOAIENG-7298 - New DSC Component Dashboard and Datasciencepipelines Test Cases by @mattmahoneyrh in #1509
- Add support for embedded endpoint for vllm by @tarukumar in #1511
- RHOAIENG-6517 Automate support for configuration of controller resources by @asanzgom in #1515
- Add Support for vllm model deployment from UI by @tarukumar in #1531
- ODS-2584 Create DSCI and DSC with Service Mesh operator NOT installed by @CFSNM in #1487
- Add embedding model deployment from ui for vllm by @tarukumar in #1548
Enhancements
- [Fix] check for the CUDA version installed on image by @jstourac in #1418
- Add support to uninstall odh-nightly from managed cluster by @tarukumar in #1421
- [fix] Update image used for must-gather test by @jstourac in #1420
- Fix "PLC0415", #
import
should be at the top-level of a file by @jiridanek in #1423 - Add Test and Kw for authorino by @mwaykole in #1396
- Fix "F403", #
from python_terraform import *
used; unable to detect undefined names by @jiridanek in #1424 - Parameterize the model deployment for tgis and using ratio to match model response by @tarukumar in #1447
- Add ProductBug tag to tgis metrics test cases by @bdattoma in #1448
- [fix] the test for special usernames by @jstourac in #1451
- [fix] two test that starts Standard Data Science workbench on ODH by @jstourac in #1456
- [fix] expected title of the browser window when running with ODH by @jstourac in #1457
- [fix] the expected network policy content for the ODH execution by @jstourac in #1454
- Bumping timeout or retries to avoid flaky timeless issues by @CFSNM in #1461
- Bumping default retry to 150 in Wait Until Operator Subscription Last Condition Is by @CFSNM in #1470
- Moved API to v2beta1 by @diegolovison in #1480
- RHOAIENG-7580 - Add Pod Ready Check by @mattmahoneyrh in #1478
- Fix "E402", # Module level import not at top of file by @jiridanek in #1483
- Refactor Data Science Pipelines to slim down sanity (Sanity on a diet) by @jgarciao in #1481
- Fix iris-pipeline sample to use the standard_scaler parameter in step normalize_dataset by @diegolovison in #1489
- Update Xpath for AiKit Card by @asanzgom in #1505
- Fix missing
poetry run
in run_robot_test.sh by @jiridanek in #1496 - [fix] installation of servicemesh dependant operator on managed cluster by @jstourac in #1508
- Modify Pipeline UI test in Smoke to use pip_index_url (making it compatible with disconnected clusters) by @jgarciao in #1507
- Update installation channel for the authorino dependency operator by @jstourac in #1514
- Small two DS project test fixes/stabilization by @jstourac in #1523
- [fix] close browser after each test in 415__ods_dashboard_projects.robot by @jstourac in #1524
- [fix] stabilize the ODS-1864 test by scrolling button into view by @jstourac in #1526
- fix: use activeModelState to wait ISVC status by @FedeAlonso in #1528
- Remove auth from ray by @diegolovison in #1482
- fix: 30s sleep when ISVC is loaded in order to avoid polling treshold by @FedeAlonso in #1534
- [fix] Update must-gather image reference for the RHOAI 2.10 by @jstourac in #1535
- fix: ODS-2574 wrong xpaths by @FedeAlonso in #1539
- fix: Model serving LLM UI tests by @FedeAlonso in #1541
- Simplify pipeline setting pip_index_url and pip_trusted_host by @jgarciao in #1549
- fix: Dashboard tests diet by @FedeAlonso in #1552
- Add sleep to ovms test, skip fail if UWM configmaps already present by @lugi0 in #1557
Enhancements in scripts and CI/CD
- Add script to fetch new test cases by @bdattoma in #1459
- Add option in fetch_new_test.py to automatically fetch previous release branch by @bdattoma in #1474
- Add tagger date and version:refname sort attribute for fetching releases branches by @bdattoma in #1503
- fix: wait for kserve inference host via cli by @FedeAlonso in #1518
- Add Dashboard tag to Dashboard related suites by @FedeAlonso in #1529
Misc
- [fix] disable the custom manifest support temporarily by @jstourac in #1458
- [Jupyter] RHOAIENG-7490 update test tags - remove many from Sanity by @jstourac in #1471
- Add support for amd operator installation by @tarukumar in #1498
- Finalize WIP task for fixing outstanding linter warnings by @jiridanek in #1497
- Add a
trainingoperator
component to the DSC template list by @jstourac in #1519 - Add SeaLights integration files and deps. Configure SonarCloud inclusions/exclusions by @jgarciao in #1533
Other Changes
- After filling the form, Create a Run button element should be enabled by @diegolovison in #1415
- Select project before checking the pipeline run status by @diegolovison in #1416
- Create kueue resources for the project by @diegolovison in #1414
- Increase the dsci timeout by @tarukumar in #1422
- Explicit move to Applications Enabled page by @diegolovison in #1432
- Add tag for Model Registry test to execute only on ODH for now by @nehachopra27 in #1426
- Include Git mirror details into test-variables.yaml by @apodhrad in #1434
- Properly set multiline custom CA Bundle by @apodhrad in #1433
- Add Training operator smoke tests to DW stack by @sutaakar in #1436
- Update codeflare-sdk tests to run against latest release tag by @Srihari1192 in #1435
- Skip Training operator smoke tests until brought to RHOAI by @sutaakar in #1446
- Fix "FA100", # Missing
from __future__ import annotations
, but usestyping.Optional
by @jiridanek in #1441 - Fix "E721", # Use
is
andis not
for type comparisons, orisinstance()
for isinstance checks by @jiridanek in #1443 - Add python-Levenshtein to remove fuzzywuzzy warning by @tarukumar in #1450
- Add Polarion test cases for DW smoke tests by @jiripetrlik in #1449
- Fix "F841", # Local ...
2.8.0
Note: the original release date was March 15, 2024 against 1ce419d commit but we updated this so the required back-ported changes are part of this release.
What's Changed
New Tests
- Add TGIS test for fetching model from Minio object storage by @bdattoma in #1231
- adding TC for model serving setting page by @mwaykole in #1076
- Add TGIS test for bigscience/mt0-xxl model by @bdattoma in #1244
- Add support for flan-t5-xl model by @tarukumar in #1252
- Add test for flant5-xxl by @tarukumar in #1254
- Feat: Accelerators Profile Administration UI e2e Tests by @FedeAlonso in #1209
- Add test for ELYZA-japanese-Llama-2-7b-instruct by @bdattoma in #1253
- Add flan-ul test case by @tarukumar in #1261
- Add test for ibm/mpt-7b-instruct2 model by @lugi0 in #1258
- add codellama-34b-instruct-hf test by @lugi0 in #1263
- Add query to ModelInfo and Tokenize endpoints by @bdattoma in #1266
- adding TC for llama-2-13b-chat by @mwaykole in #1267
- Add test for deploying and querying a prompt-tuned google/flan-t5-xl LLM by @bdattoma in #1272
Enhancements
- RHOAIENG-23 - Cleanup CodeFlare installation code by @jiripetrlik in #1180
- Stabilize Dashboard Test Suite (415) by @manosnoam in #1235
- Improve
utils.execute_command
, add a Pytest selftest for it, and run it in GHA by @jiridanek in #1243 - Set namespace for dummy-storage-creds.yaml by @diegolovison in #1256
- Fix the issue with model path by @tarukumar in #1264
- For purley Kserv raw deployment teardown will fail when OSSM operator and resources are not deployed by @tarukumar in #1265
- Fix for Multi-Attach error PVC by @tarukumar in #1268
- FIx: Automation Issues from 2.8 RC1 Sanity execution by @FedeAlonso in #1274
- fix: ODS-282 Verify Content In RHODS Explore Section by @FedeAlonso in #1280
- fix: ODS-1226 Open links by @FedeAlonso in #1282
- fix: ODS-1718 update endpoint by @FedeAlonso in #1286
- Add baseline 40Gi memory request to all llm models by @lugi0 in #1278
- fix: get started and cards related tests by @FedeAlonso in #1292
- Make feature tests running on GPU and Default Raw by @bdattoma in #1277
- Fix for model response file by @tarukumar in #1294
- [Fix] Uninstallation of the RHOAI operator by @jstourac in #1245
- fix: Verify successful pipeline via UI from Pipelines->Runs view by @FedeAlonso in #1303
- Enforce the client to use a valid certificate by @diegolovison in #1285
- fix: Add productBug tag to ODS-282 by @FedeAlonso in #1304
- Backport required changes from master to releases/2.8.0 by @jstourac in #1318
Enhancements in scripts and CI/CD
Other Changes
- Fix in ocm.py for interop pipeline by @mwaykole in #1233
- update the log error messages and execute of cmd and output by @kobihk in #1234
- Reenable Kueue tests by @jiripetrlik in #1236
- increase the delete cluster timeout by @kobihk in #1238
- use cluster_id instead of cluster_name with ocm command by @kobihk in #1237
- Reapply "Add support for kueue component" by @jstourac in #1246
- add support for latest rosa version by @kobihk in #1242
- Add deployment mode support for kserve in DSC by @tarukumar in #1248
- Raise the timeout for wait of the CatalogSource to be ready. by @jstourac in #1250
- Remove Trusty tests from Sanity and Tier1 by @nehachopra27 in #1255
- RHOAIENG-3768 - Define or implement Sanity tests for KubeRay by @jiripetrlik in #1251
- Add sanity test for kueue by @ChughShilpa in #1249
- fix: New xpath on model serving runtime selection dropdown by @FedeAlonso in #1257
- Revert "Fix for Multi-Attach error PVC" by @tarukumar in #1270
- Change tier1 tag for llm model by @tarukumar in #1269
- Add tag Tier2 to kueue e2e tests by @ChughShilpa in #1262
- add existing e2e test as a sanity test for codeflare by @abhijeet-dhumal in #1260
- Delete model downloader pod after model is downloaded by @tarukumar in #1271
- Add Kserverarwa support by @tarukumar in #1273
- Wait for Hive Provision status
ProvisionFailed=False
up to 15 minutes by @manosnoam in #1279 - adding model-info and tokenize to the TC RHOAIENG-3483 by @mwaykole in #1281
- remove Known Issues Tags by @asanzgom in #1288
- [RHOAIENG-3757] DW: Reduce time of setting up of e2e tests by @sutaakar in #1283
- Select only worker nodes by @ChughShilpa in #1284
- update the hive workaround to support the new hive by @kobihk in #1287
- RHOAIENG-4488 - Remove test-run-dw-tests.robot by @jiripetrlik in #1291
- RHOAIENG-3767 Implement Smoke tests for DW components by @jiripetrlik in #1290
- Store DSC CR in case waiting for component fails by @sutaakar in #1297
- Extend the timeout waiting for component to be enabled by @sutaakar in #1300
- [RHOAIENG-3757] DW: Reduce time of setting up of e2e tests by @sutaakar in #1293
- Modify the env name with actually parameter name by @tarukumar in #1299
- fix: add productbug tag to ODS-1969 by @FedeAlonso in #1298
New Contributors
- @abhijeet-dhumal made their first contribution in #1260
- @sutaakar made their first contribution in #1283
Full Changelog: 2.7.0...2.8.0
2.8.2
What's Changed
Enhancements
- Update the tgis runtime for rhoai_2_8_z by @tarukumar in #1417
- Backport some of the changes from master to 2.8 by @jstourac in #1419
Full Changelog: 2.8.1...2.8.2
2.9.0
What's Changed
New Tests
- RHOAIENG-3425 - Validate Trusted CA Bundle by @mattmahoneyrh in #1310
- RHOAIENG-2519 Service Mesh Test Case by @mattmahoneyrh in #1336
- RHOAIENG-2508 ODS-2600 Validate DSC creates all Serverless CRs by @asanzgom in #1259
- RHOAIENG-5092 - Validate Authorino Resources by @mattmahoneyrh in #1346
- Add check on containers list for KServe model deployments by @bdattoma in #1400
- RHOAIENG-4500 Model registry Operator Deployment by @nehachopra27 in #1295
New Tasks
Enhancements
- Install Authorino Operator as a prerequisite for RHOAI 2.9+ by @jstourac in #1289
- Fix deletion confirmation message change in RHOAI 2.9.0 Dashboard by @jiridanek in #1301
- Adding link to ticket bugs in some tests by @bdattoma in #1296
- Fix Dashboard Tests for ODH and RHOAI 2.9 by @manosnoam in #1308
- [Fix] request body logged content by @jstourac in #1316
- [Fix] cleanup for the dashboard api tests by @jstourac in #1317
- [Fix] Notebook API test by @jstourac in #1306
- Migrate pipelines tests to DSPv2 (pipelines-api, pipelines-kfp) by @diegolovison in #1312
- Migrate to pipeline v2 by @diegolovison in #1322
- Reuse KW
Wait For Dashboard Page Title
in more tests by @manosnoam in #1321 - Use cluster id while adding machinepool by @tarukumar in #1324
- Fix linter errors in DataSciencePipelinesKfp.py and ray_integration.py by @jiridanek in #1325
- Migrate to pipeline v2 (DataSciencePipelinesKfp) by @diegolovison in #1328
- Add support to open also ODH via application list by @jstourac in #1319
- Fix linter errors in iris_pipeline.py by @jiridanek in #1332
- Exclude AI apps tests on ODH since these are irrelevant there by @jstourac in #1338
Open Data Science Project Details Page
also switch to a requested tab by @manosnoam in #1333- Update new runtime image for tgis with snyk fixes by @tarukumar in #1340
- [RHOAIENG-5073] Add pod port fowarding for raw due to headless service by @tarukumar in #1343
- Update dashboard tests "415" by @manosnoam in #1344
- Update Keywords for the new UI: Test suite 420__model_serving.robot by @manosnoam in #1345
- Update Xpath data-testid for Jupyter Explorer Card by @manosnoam in #1350
- Fix "F811", # Redefinition of unused
hide_values_in_op_json
from line 565 by @jiridanek in #1353 - Fix "W605", # Invalid escape sequence:
\d
by @jiridanek in #1354 - Add common KW
Open "Get Started" For App Name
by @manosnoam in #1352 - Fix "RET503", # Missing explicit
return
at the end of function able to return non-None
value by @jiridanek in #1357 - Revert "Fix "RET503", # Missing explicit
return
at the end of funct… by @jstourac in #1360 - Enhance Pipelines UI tests for DSPv2 and add some example pipelines by @jgarciao in #1358
- fix: Delete outdated skipped tests by @FedeAlonso in #1362
- fix: Delete AutomationBug tag from ODS-2379 by @FedeAlonso in #1361
- Speed-up execution of keyword "Is RHODS Self-Managed" in local by @jgarciao in #1366
- Add ibmcloud among supported platform for RHOAI install task by @bdattoma in #1364
- In RHOAI 2.9, the number of containers for envoy increased by @diegolovison in #1371
- Fix "RET503", # Missing explicit return at the end of function able… by @jiridanek in #1369
- "B007", # Loop control variable
retry
not used within loop body by @jiridanek in #1374 - Change
IBM Watson Studio
toIBM watsonx.ai
title in 2.9+ by @jstourac in #1372 - Dashboard Sanity tests fixes for RHOAI 2.9 by @manosnoam in #1363
- Fix "PLR5501", # Use
elif
instead ofelse
thenif
, to reduce indentation by @jiridanek in #1375 - Change
IBM Watson Studio
toIBM watsonx.ai
references for 2.9+ by @jstourac in #1376 - Update Xpath for WORKBENCH_IMAGE by @manosnoam in #1382
- fix: ODS-1814 wrong xpath by @FedeAlonso in #1383
- Migrate pipelines tests to DSPv2 by @diegolovison in #1378
- fix: ODS-2054 issues by @FedeAlonso in #1384
- Adapt Trusted CA bundles tests to ODH by @asanzgom in #1380
- Verify That There Are No Sample Pipelines After Creating Pipeline Server in RHOAI by @Raghul-M in #1368
- Fix required xpaths for the selection of the model server template by @jstourac in #1387
- fix: ODS-2276 and ODS-2279 issues by @FedeAlonso in #1388
- Fix and exclude some tests in smoke for odh compatibility by @jgarciao in #1381
- Fix Canary rollout and non-admin test case in Caikit+TGIS suite (Sanity) by @bdattoma in #1390
- Fix expected version of Jupyterhub-git package for 2024.1 images by @jstourac in #1393
- Fix Quickstart tests in 412__ods_dashboard_resources.robot by @manosnoam in #1395
- Add self-signed CA bundle support for kserve grpc/http requests by @lugi0 in #1391
- Fixing Automation For Elyra Test in Dspv2 by @Raghul-M in #1394
- fix: DS Projects permission mgmt tests by @FedeAlonso in #1399
- Rhoaieng 6358 restore custom ca bundle by @mattmahoneyrh in #1398
- fix: ODS-2542 outdated xpaths by @FedeAlonso in #1403
- Update Serving Runtime images for API testing by @bdattoma in #1406
- Fix/420 model serving dashboard tests by @FedeAlonso in #1402
- Embed required data in iris-pipeline to avoid an external connection and improve compatibility with disconnected clusters by @diegolovison in #1408
- Remove workaround needed for self-signed S3 by @apodhrad in #1407
- Migrate the code to the latest changes in DW by @diegolovison in #1410
- Fix Verify Switcher to Masterhead test by @jstourac in #1404
- Fix: GPU related tests by @FedeAlonso in #1413
Enhancements in scripts and CI/CD
- Replace black and isort with ruff by @jiridanek in #1337
- Configure include and exclude paths for ruff linter by @jiridanek in #1359
- Add ruff to pre-commit by @jiridanek in #1341
- Refine
execute_command
function for printing aligned tabbed tables by @jiridanek in #1379
Misc
- Add DependencyLibrary to support test case/suite dependency by @manosnoam in #1323
- Add pyright typechecker...