v2.3.0
Release notes - Hopsworks - Version 2.3.0
Bug
HOPSWORKS-2663 Fix docker installation on ubuntu 18.04
HOPSWORKS-2639 NPE with no Databricks Clusters in Feature Store Integration
HOPSWORKS-2634 Feature order not respected in training dataset prepared statement
HOPSWORKS-2631 SYNC_BASE_ENV operation should also show error logs in case of failure
HOPSWORKS-2628 OnlineFS schema of feature groups with appended features misses old features
HOPSWORKS-2626 MySQL timezone issue
HOPSWORKS-2625 Add status to dataset projectsSharedWith
HOPSWORKS-2619 Add missing JVM imports in Livy for Spark 3
HOPSWORKS-2618 NPE when force deleting a Project
HOPSWORKS-2614 Training Dataset from Python with default connector fails
HOPSWORKS-2609 Unshare a pending feature store fails
HOPSWORKS-2594 Attaching Jupyter config when running notebook with Spark or Python kernel with git backend fails
HOPSWORKS-2583 Experiment mnist notebook should work in airgapped environment
HOPSWORKS-2582 Spark driver cores is incorrectly set to number of configured executor cores
HOPSWORKS-2577 Python Feature Group Ingestion fails with additional write arguments
HOPSWORKS-2574 Feature validation rule Level.Warning defaults to Error
HOPSWORKS-2569 Allow capital letters keywords
HOPSWORKS-2567 Nullpointerexception when retrieving validations for on-demand feature groups
HOPSWORKS-2556 Jupyter should use default DockerJobConfiguration for Experiments and Spark
HOPSWORKS-2555 KAFKA_BROKERS not set in Python kernel
HOPSWORKS-2554 oauth2 get user bug
HOPSWORKS-2553 Fix kfserving airgapped deployment
HOPSWORKS-2546 Add RonDB services to kagent even if disabled
HOPSWORKS-2538 Secrets API not setting projectId and visibility in certain cases
HOPSWORKS-2536 Online FS Avro schema constructor decimals should take precision and scale
HOPSWORKS-2526 add fg to prepared statement only if it contains features other than pk and targets.
HOPSWORKS-2520 Installing python libraries with no version and from git should use --no-cache docker build option
HOPSWORKS-2517 Job executions not filtered by submission time
HOPSWORKS-2515 Set spark.serializer to Kryo for Databricks integration
HOPSWORKS-2510 Updating validationType on feature group response contains old value
HOPSWORKS-2503 Pin containerd version in ubuntu
HOPSWORKS-2495 HSFS connection cannot not read JWT in Python jobs
HOPSWORKS-2490 Disable Python Library Updates Monitor for snapshot versions
HOPSWORKS-2386 Decimal types are converted to varbinary on the online feature grouip
HOPSWORKS-2349 Hive InodeHelper doesn't work if path contains slahs (/)
HOPSWORKS-2343 Validate storage connector type before creating a training dataset
Improvement
HOPSWORKS-2653 Flyway dir already exists error in hopsworks::install
HOPSWORKS-2645 Support feature validation for on-demand FGs in hsfs
HOPSWORKS-2643 Add option to enable hopsfs/rm audit logs
HOPSWORKS-2636 Add option to specify Kubernetes node labels from cluster definition
HOPSWORKS-2615 Add option to redirect stdout and stderr of Docker jobs
HOPSWORKS-2607 Set NotValidBefore of issued X.509 a few minutes earlier
HOPSWORKS-2605 Configuration parameter for Kubernetes maximum retry number
HOPSWORKS-2604 add option to specify additional insecure docker registry
HOPSWORKS-2597 Add hops Python helper methods for model and dataset modules
HOPSWORKS-2584 Increase Schema Registry database schema column size
HOPSWORKS-2578 Use a separate Data directory to store Hopsworks state
HOPSWORKS-2575 Make Online FS Kafka topic partition number configurable
HOPSWORKS-2560 Support Memory, Cores and GPU as a resource for model serving
HOPSWORKS-2559 Add input paths option for Docker jobs and multiple commands
HOPSWORKS-2552 Send monitoring URLs as part of execution dto
HOPSWORKS-2551 Bump hops dependencies to 3.2.0.4-SNAPSHOT
HOPSWORKS-2529 Package dockerfile:experimental in the base.tar for
HOPSWORKS-2528 Add support to provide PIP extra-index-url in the cluster definition
HOPSWORKS-2523 Use own java cookbook instead of upstream
HOPSWORKS-2506 Feature Validation Improvements
HOPSWORKS-2502 Add JOB audience to delete endpoint for training datasets
HOPSWORKS-2492 Improve readiness check of KFServing inference services
HOPSWORKS-2356 Alerting for hopsworks services
HOPSWORKS-2167 Add inference logging sidecar to KFServing deployments
New Feature
HOPSWORKS-2381 Project level configuration for Jupyter notebooks and Jobs
HOPSWORKS-2334 Support custom transformers in KFServing deployments
HOPSWORKS-2319 Add API to interact with the secret store
HOPSWORKS-2104 Model Serving with KFServing
Task
HOPSWORKS-2637 Bump hops dependencies to 3.2.0.4-RC0
HOPSWORKS-2622 pin six to 1.15.0
HOPSWORKS-2621 Bump pip in hops-system to last version that supports python 2.7
HOPSWORKS-2601 Update swagger code to be compatible with the latest swagger hub and enable for demo cluster
HOPSWORKS-2498 Remove filebeat beam recipes
HOPSWORKS-2424 Attach transformation function to training dataset
HOPSWORKS-2420 Bump hops dependencies to 3.2.0.3-SNAPSHOT
HOPSWORKS-1942 Upgrade to Spark 3.x