Skip to content

Releases: red-hat-data-services/ods-ci

2.15.0

28 Oct 10:34
a5cf4f8
Compare
Choose a tag to compare

What's Changed

New Tests

  • Adds a new tests to check the notebook controllers deployments by @jstourac in #1957
  • Added Tensorflow model REST protocol test on triton for Modelmesh by @Raghul-M in #1840
  • Add pre/post upgrade test for Model Registry by @lugi0 in #1970

Enhancements

  • Only upload the openshift CA cert if the cluster is self-managed in MR test by @lugi0 in #1936
  • Fix: new start and stop wb buttons by @FedeAlonso in #1953
  • RHOAIENG-14857 Update the test to implement data-testids by @ConorOM1 in #1954

Other Changes

Full Changelog: 2.14.0...2.15.0

2.14.0

16 Oct 10:31
4950bcc
Compare
Choose a tag to compare

What's Changed

New Tests

Enhancements

  • fix: DSProjects view wrong xpath by @FedeAlonso in #1801
  • Add support for provisioning GPUs from GCP by @bdattoma in #1794
  • Remove two Model Serving tests from Smoke by @lugi0 in #1793
  • RHOAIENG-12833 - Validate Image Pull Path Is From registry.redhat.io by @mattmahoneyrh in #1809
  • Increase cluster provisioning timeout by @bdattoma in #1820
  • Update button xpath to work with latest ODH by @lugi0 in #1837
  • Updating Model Registry E2E Test to Use the Latest Python Client by @tonyxrmdavidson in #1838
  • Set DSCInitialization timeout to 3 minutes if TEST_ENV is CRC by @manosnoam in #1845
  • Fix for the Elyra pipeline execution by @jstourac in #1858
  • Fix: xpath=//input[@data-testid="resource-manage-project-modal-name"] failure by @ConorOM1 in #1857
  • Introduce support for the Jupyter/Elyra 4. by @jstourac in #1859
  • RHOAIENG-12022 - Enable DSC Modelregistry Tests To Run On RHOAI by @mattmahoneyrh in #1831
  • fix: ODS-2206, wrong pipelines xpath by @FedeAlonso in #1868
  • Add ModelRegistry Namespace Check by @mattmahoneyrh in #1862
  • Fix check for nvidia-device-plugin-daemonset when deploying NVIDIA operator stack by @bdattoma in #1871
  • Shorten the name of a project resource name to pass the check by @jstourac in #1881
  • Model Registry e2e UI test + breaking ui changes by @lugi0 in #1879
  • Enable Model Registry test in Smoke by @lugi0 in #1883
  • Status for the starting workbench doesn't contain three dots anymore by @jstourac in #1884
  • Add 2.14 tgis runtime image by @tarukumar in #1889
  • Remove kube-rbac-proxy container due to RHOAIENG-13837 by @lugi0 in #1893
  • Add new runtime image for vllm by @tarukumar in #1894
  • Update the Python version and other requirements for the 2024b OOTB images by @jstourac in #1870
  • Increase timeout when saving permissions in Dashboard by @jgarciao in #1897
  • Fix the workbench start for the Jupyter 4 (images 2024.2) by @jstourac in #1899
  • Dynamically change python target version for MR dependencies by @lugi0 in #1898
  • fix: increase logo's timeout by @FedeAlonso in #1904
  • fix: ODS-1813 wrong span by @FedeAlonso in #1903
  • [Fix] partially reverts #1901 as we should keep using the library keyword by @jstourac in #1905
  • Reorganize sample pipelines in "cache-enabled" and "cache-disabled" folders by @jgarciao in #1891
  • [Fix] the Jupyter tests for working with git repository by @jstourac in #1909
  • Fix user permission tests by @jstourac in #1913
  • [Fix] test that checks that Notebook resource has expected size by @jstourac in #1916
  • Fix suite 0401__ods_dashboard Tests and Keywords by @manosnoam in #1912
  • [Fix] the tests for custom image import by @jstourac in #1920
  • [Fix] expected version in the 2024.2 images by @jstourac in #1919
  • Fix: Dashboard UI tests by @FedeAlonso in #1922
  • [Fix] the test for the package versions on images by @jstourac in #1923
  • [Fix] the project selector on the pipelines page by @jstourac in #1929
  • [Fix] the tests for the minimal image by @jstourac in #1930
  • [Fix] this fixes the negative test for the Anaconda app integration by @jstourac in #1931
  • Remove Deprovision on failure from OCP provisioning task by @bdattoma in #1924

Enhancements in scripts and CI/CD

Other Changes

Read more

2.13.0

11 Sep 13:05
088852e
Compare
Choose a tag to compare

What's Changed

New Tests

New Tasks

Enhancements

  • Rename some root suite directories to reflect new scrum org by @bdattoma in #1734
  • Fix "SKIPPED" status in Post upgrade suite by @bdattoma in #1738
  • Create root suite directory for unassigned components and move culler suite under IDE by @bdattoma in #1743
  • Disable ModelRegistry Tests On RHOAI by @mattmahoneyrh in #1749
  • Check KServer Managment State To Ensure That It Is Not Empty by @mattmahoneyrh in #1751
  • [fix] xpaths to couple of elements in dashboard data science projects by @jstourac in #1756
  • Fix keyword to watch SM cluster provisioning logs and increase timeout by @bdattoma in #1754
  • [fix] xPaths with regards the change in RHOAI 2.13 by @jstourac in #1763
  • Refactor Data Science Pipelines Backend Tests introducing new keywords by @jgarciao in #1767
  • Fix Verify User Can Change The Minimum Number Of Replicas For A Model test case in ods-ci by @hdefazio in #1765
  • Fix variable evaluation in "Verify Model Inference" and associated keywords by @lugi0 in #1773
  • Fix JupyterHub tag in special-user-testing test suite by @jgarciao in #1771
  • Fix wrong argument in test case, missing argument in keyword call (deployment_mode) by @lugi0 in #1782
  • Add additional params for object storage configuration in CreatePipelineServer, fixing tests on disconnected by @jgarciao in #1781
  • Use single tier/gate tag, fix robocop complaints in Model Serving Test Suites by @lugi0 in #1778
  • Fix pipeline server creation when url ends with / by @jgarciao in #1791
  • Increase Trusted CA Bundle Resource Check Timeouts by @mattmahoneyrh in #1796

Other Changes

  • Support disconnected environment for Pipeline SDK tests by @diegolovison in #1730
  • fix: solve issues when uninstalling and reinstalling serverless operator due to operator group not being removed by @CFSNM in #1739
  • Pipeline for Importer Components by @diegolovison in #1723
  • fix: use common vars in the oc uninstall keywords by @CFSNM in #1745
  • Fix "Verify User Can Access Model Metrics From UWM" test in "Model Serving Llm" suite by @hdefazio in #1755
  • Fix DW UI test image to use image digest by @Srihari1192 in #1760
  • Added new tests to validate release.name and release.version attributes of a dsc/dsci by @CFSNM in #1750
  • Create pipeline run with different user by @diegolovison in #1628
  • Update runtime image for 2.13 by @tarukumar in #1766
  • fix: rework in some of the operator test cases by @CFSNM in #1761
  • Allow to install gpu-operator-certified in disconnected env by @apodhrad in #1639
  • Fix for Authorino TC by @mwaykole in #1770
  • Update DW UI tests to accommodate changes introduced in 2.13 and instability tests by @Srihari1192 in #1758
  • reworking platform tests tagging following the 1-tag approach by @CFSNM in #1769
  • fix: increase dsci timeout by @CFSNM in #1774
  • Add verification for container images in smoke test by @ChughShilpa in #1759
  • Use newer fms-hf-tuning image by @sutaakar in #1775
  • fix: solving some issues in the must gather tests by @CFSNM in #1776
  • Add Rhods Osd Install Repo to generateTestConfigFile by @asanzgom in #1780
  • fix: add rhosi setup as a requirement for post-upgrade setup by @CFSNM in #1785
  • [RHOAIENG-11805] Avoid multiple suite tags for IDE tests by @jstourac in #1787
  • Update to allow installation of the Python Client without external access by @tonyxrmdavidson in #1779
  • Add new runtime image with chat-template for vllm by @tarukumar in #1798
  • fix: remove flaky condition to avoid false negative results for the rhods log test by @CFSNM in #1799

New Contributors

Full Changelog: 2.12.0...2.13.0

2.12.0

20 Aug 15:17
835efd8
Compare
Choose a tag to compare
Fix Test `Verify Documentation Links HTTP Status Code` (#1731)

Signed-off-by: manosnoam <nmanos@redhat.com>

2.11.0

03 Jul 11:17
6223e67
Compare
Choose a tag to compare

What's Changed

New Tests

Enhancements

  • Set default SR for Kserve to Caikit+TGIS by @lugi0 in #1558
  • Force Caikit TGIS SR in UI tests by @lugi0 in #1559
  • [vllm/tgis]Add support for amd for model deployment by @tarukumar in #1564
  • Adapt Data Science Pipelines tests to changes introduced by Pipeline Experiments by @jgarciao in #1576
  • Check that the URL list is not empty before verifying HTTP status by @manosnoam in #1584

Enhancements in scripts and CI/CD

Misc

  • Move Serving and Pipelines suites out of Dashboard folder by @bdattoma in #1553
  • Create IDE test suite directory with proper nested suites by @bdattoma in #1562
  • Move ai explainability suite in dedicated directory by @bdattoma in #1575

Other Changes

  • Add Upgrade test scenarios for Distributed workloads by @Srihari1192 in #1491
  • moved 144 Dsc Negative No Dependant Op to Tier3 by @asanzgom in #1566
  • Tag both Operator and ModelRegistry on 112_model_registry by @asanzgom in #1567
  • RHOAIENG-3472: Added test to validate the DSC without dependant operator when kserver is unmanaged by @CFSNM in #1556
  • update test name in codeflare tests by @ChughShilpa in #1573
  • Access job submission as non-admin by @diegolovison in #1571
  • Update repo for codeflare tests by @ChughShilpa in #1570
  • All pipelines connections are secured by default from the client perspective by @diegolovison in #1577
  • Fix Test Verify Resource Link HTTP Status Code by @manosnoam in #1582
  • Add granite 7b lab model by @tarukumar in #1579
  • Update rhoai 2.11 runtime images by @tarukumar in #1585
  • RHOAIENG-7226 - Add TestMnistRayGpu by @jiripetrlik in #1580
  • RHOAIENG-2512: Added test to validate the DSC and DSCI when Serverless operator is not installed by @CFSNM in #1574
  • RHOAIENG-7919 Istio Kserve Gateway For Internal Endpoint by @mattmahoneyrh in #1583
  • Update AppsInfoDictionary_latest.json with the new App: Elasticsearch by @manosnoam in #1590
  • Add DW test to verify requested resources in case of multiple local queue exists by @Srihari1192 in #1565

Full Changelog: 2.10.0...2.11.0

2.10.0

25 Jun 09:49
6271666
Compare
Choose a tag to compare

What's Changed

New Tests

  • RHOAIENG-5435 - Distributed Workloads Components by @mattmahoneyrh in #1392
  • RHOAIENG-6627 - Training-Operator test case by @mattmahoneyrh in #1430
  • Add base test for vLLM and its metrics by @lugi0 in #1438
  • RHOAIENG-7181 Check DW Components are Enabled by Default by @asanzgom in #1502
  • Expanded vLLM metrics test by @lugi0 in #1500
  • RHOAIENG-7298 - New DSC Component Dashboard and Datasciencepipelines Test Cases by @mattmahoneyrh in #1509
  • Add support for embedded endpoint for vllm by @tarukumar in #1511
  • RHOAIENG-6517 Automate support for configuration of controller resources by @asanzgom in #1515
  • Add Support for vllm model deployment from UI by @tarukumar in #1531
  • ODS-2584 Create DSCI and DSC with Service Mesh operator NOT installed by @CFSNM in #1487
  • Add embedding model deployment from ui for vllm by @tarukumar in #1548

Enhancements

  • [Fix] check for the CUDA version installed on image by @jstourac in #1418
  • Add support to uninstall odh-nightly from managed cluster by @tarukumar in #1421
  • [fix] Update image used for must-gather test by @jstourac in #1420
  • Fix "PLC0415", # import should be at the top-level of a file by @jiridanek in #1423
  • Add Test and Kw for authorino by @mwaykole in #1396
  • Fix "F403", # from python_terraform import * used; unable to detect undefined names by @jiridanek in #1424
  • Parameterize the model deployment for tgis and using ratio to match model response by @tarukumar in #1447
  • Add ProductBug tag to tgis metrics test cases by @bdattoma in #1448
  • [fix] the test for special usernames by @jstourac in #1451
  • [fix] two test that starts Standard Data Science workbench on ODH by @jstourac in #1456
  • [fix] expected title of the browser window when running with ODH by @jstourac in #1457
  • [fix] the expected network policy content for the ODH execution by @jstourac in #1454
  • Bumping timeout or retries to avoid flaky timeless issues by @CFSNM in #1461
  • Bumping default retry to 150 in Wait Until Operator Subscription Last Condition Is by @CFSNM in #1470
  • Moved API to v2beta1 by @diegolovison in #1480
  • RHOAIENG-7580 - Add Pod Ready Check by @mattmahoneyrh in #1478
  • Fix "E402", # Module level import not at top of file by @jiridanek in #1483
  • Refactor Data Science Pipelines to slim down sanity (Sanity on a diet) by @jgarciao in #1481
  • Fix iris-pipeline sample to use the standard_scaler parameter in step normalize_dataset by @diegolovison in #1489
  • Update Xpath for AiKit Card by @asanzgom in #1505
  • Fix missing poetry run in run_robot_test.sh by @jiridanek in #1496
  • [fix] installation of servicemesh dependant operator on managed cluster by @jstourac in #1508
  • Modify Pipeline UI test in Smoke to use pip_index_url (making it compatible with disconnected clusters) by @jgarciao in #1507
  • Update installation channel for the authorino dependency operator by @jstourac in #1514
  • Small two DS project test fixes/stabilization by @jstourac in #1523
  • [fix] close browser after each test in 415__ods_dashboard_projects.robot by @jstourac in #1524
  • [fix] stabilize the ODS-1864 test by scrolling button into view by @jstourac in #1526
  • fix: use activeModelState to wait ISVC status by @FedeAlonso in #1528
  • Remove auth from ray by @diegolovison in #1482
  • fix: 30s sleep when ISVC is loaded in order to avoid polling treshold by @FedeAlonso in #1534
  • [fix] Update must-gather image reference for the RHOAI 2.10 by @jstourac in #1535
  • fix: ODS-2574 wrong xpaths by @FedeAlonso in #1539
  • fix: Model serving LLM UI tests by @FedeAlonso in #1541
  • Simplify pipeline setting pip_index_url and pip_trusted_host by @jgarciao in #1549
  • fix: Dashboard tests diet by @FedeAlonso in #1552
  • Add sleep to ovms test, skip fail if UWM configmaps already present by @lugi0 in #1557

Enhancements in scripts and CI/CD

  • Add script to fetch new test cases by @bdattoma in #1459
  • Add option in fetch_new_test.py to automatically fetch previous release branch by @bdattoma in #1474
  • Add tagger date and version:refname sort attribute for fetching releases branches by @bdattoma in #1503
  • fix: wait for kserve inference host via cli by @FedeAlonso in #1518
  • Add Dashboard tag to Dashboard related suites by @FedeAlonso in #1529

Misc

  • [fix] disable the custom manifest support temporarily by @jstourac in #1458
  • [Jupyter] RHOAIENG-7490 update test tags - remove many from Sanity by @jstourac in #1471
  • Add support for amd operator installation by @tarukumar in #1498
  • Finalize WIP task for fixing outstanding linter warnings by @jiridanek in #1497
  • Add a trainingoperator component to the DSC template list by @jstourac in #1519
  • Add SeaLights integration files and deps. Configure SonarCloud inclusions/exclusions by @jgarciao in #1533

Other Changes

  • After filling the form, Create a Run button element should be enabled by @diegolovison in #1415
  • Select project before checking the pipeline run status by @diegolovison in #1416
  • Create kueue resources for the project by @diegolovison in #1414
  • Increase the dsci timeout by @tarukumar in #1422
  • Explicit move to Applications Enabled page by @diegolovison in #1432
  • Add tag for Model Registry test to execute only on ODH for now by @nehachopra27 in #1426
  • Include Git mirror details into test-variables.yaml by @apodhrad in #1434
  • Properly set multiline custom CA Bundle by @apodhrad in #1433
  • Add Training operator smoke tests to DW stack by @sutaakar in #1436
  • Update codeflare-sdk tests to run against latest release tag by @Srihari1192 in #1435
  • Skip Training operator smoke tests until brought to RHOAI by @sutaakar in #1446
  • Fix "FA100", # Missing from __future__ import annotations, but uses typing.Optional by @jiridanek in #1441
  • Fix "E721", # Use is and is not for type comparisons, or isinstance() for isinstance checks by @jiridanek in #1443
  • Add python-Levenshtein to remove fuzzywuzzy warning by @tarukumar in #1450
  • Add Polarion test cases for DW smoke tests by @jiripetrlik in #1449
  • Fix "F841", # Local ...
Read more

2.8.0

05 Apr 08:45
1b0da61
Compare
Choose a tag to compare

Note: the original release date was March 15, 2024 against 1ce419d commit but we updated this so the required back-ported changes are part of this release.

What's Changed

New Tests

Enhancements

Enhancements in scripts and CI/CD

Other Changes

New Contributors

Full Changelog: 2.7.0...2.8.0

2.8.2

04 May 11:56
Compare
Choose a tag to compare

What's Changed

Enhancements

Full Changelog: 2.8.1...2.8.2

2.9.0

30 Apr 16:44
aae86d2
Compare
Choose a tag to compare

What's Changed

New Tests

New Tasks

  • Add Provisioning ability for IBM Cloud Self-managed by @bdattoma in #1335

Enhancements

Enhancements in scripts and CI/CD

Misc

  • Add DependencyLibrary to support test case/suite dependency by @manosnoam in #1323
  • Add pyright typechecker...
Read more

2.8.1

11 Apr 09:06
ca8e4a8
Compare
Choose a tag to compare

What's Changed

Other Changes

Full Changelog: 2.8.0...2.8.1