Skip to content

Release 2.0.0
Compare
Choose a tag to compare
@tkakantousis tkakantousis released this 01 Feb 09:23
v2.0.0
d42991c
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Release notes - Hopsworks - Version 2.0.0

Task

HOPSWORKS-2287 Bump up docker.io version for ubuntu
HOPSWORKS-2186 Remove installation of slack operator in Airflow cookbook
HOPSWORKS-2161 Option to disable just the Registration UI
HOPSWORKS-2156 Pin all TensorFlow projects in Docker image
HOPSWORKS-2126 Cleanup old hops-util(-py) feature store notebooks
HOPSWORKS-2125 Bump hops dependencies to 3.2.0.1-RC0
HOPSWORKS-2109 Remove base_env from PythonDep
HOPSWORKS-2094 Setup GPU monitoring without enabling it even when it's not a GPU deployment
HOPSWORKS-2090 Bump up docker.io version for Ubuntu
HOPSWORKS-2072 [hops-hadoop-chef] Recipe should check if Hops distro has been build with correct profiles
HOPSWORKS-2043 Upgrade base and airflow conda environment to python 3.7
HOPSWORKS-2042 Unmanaged Hopsworks Image
HOPSWORKS-2041 Bump Hops Hadoop version to 3.2.0.1-SNAPSHOT
HOPSWORKS-2040 Docker registry does not need to be versioned
HOPSWORKS-2039 Bump hops dependencies to 3.2.0.0-RC3
HOPSWORKS-2037 Rename map_fun and wrapper_fun to train_fn
HOPSWORKS-1945 Store AWS access/secret key in the secret store.
HOPSWORKS-1944 Split feature store tests in several categories
HOPSWORKS-1387 Upgrade to NDB 8

Bug

HOPSWORKS-2202 Docker registry caches deleted manifests
HOPSWORKS-2182 Disable unattended-upgrades in Ubuntu
HOPSWORKS-2162 Airflow page does not open
HOPSWORKS-2151 Tag validation doesn't work for key only tags
HOPSWORKS-2150 S3 storage connector should not bother about secrets if iam role is configured
HOPSWORKS-2149 Disable generating and sharing ssh key freely
HOPSWORKS-2147 Add feature group api scope to statistics resource endpoint
HOPSWORKS-2146 Resolve namenode consul name before setting feature group location
HOPSWORKS-2145 Flask (sklearn) race condition when reading pid file
HOPSWORKS-2128 Create api key not adding the right scope
HOPSWORKS-2122 Backend not handling null TimeTravelFormat sent by client
HOPSWORKS-2116 Add --network option to docker build
HOPSWORKS-2095 Uninstalling conda libraries doesn't work in airgapped environments
HOPSWORKS-2092 Overwriting a feature group by dropping/recreating loses default value of appended features
HOPSWORKS-2081 Fix search for registration disabled
HOPSWORKS-2080 Hops services should wait for Hopsworks before they start
HOPSWORKS-2068 Singleton initialization failure
HOPSWORKS-2067 shared featuregroup creation
HOPSWORKS-2065 Restart systemd units after failure
HOPSWORKS-2064 UI fixes for data preview
HOPSWORKS-2062 ProjectException should set prefix usrMsg from the causing exception's messge
HOPSWORKS-2061 Datasets browser order files by name not working while paginating
HOPSWORKS-2058 Conda environments are not removed when deleting a project
HOPSWORKS-2056 Change DNS server for docker containers in Localhost deployments
HOPSWORKS-2054 Increment timeout when launching Jupyter locally
HOPSWORKS-2053 Fix systemd dependencies
HOPSWORKS-2051 Save preferences for jobs/page filter
HOPSWORKS-2048 Jupyter-git missing configuration for git_backend
HOPSWORKS-2047 Non LTS Nvidia Driver version doesn't work on Azure VMs
HOPSWORKS-2038 Python client can't handle disabled online feature store
HOPSWORKS-2015 Users should not be allowed to create Dataset 'Projects'
HOPSWORKS-1988 IPynb converter fails for notebooks which contain special characters in the filename
HOPSWORKS-1918 Spark executor memory not modifiable from UI when starting jupyter
HOPSWORKS-1876 Data validation UI doesn't fill in Job parameters
HOPSWORKS-1861 API keys not all selectable for Github Jupyter notebooks

Improvement

HOPSWORKS-2140 Increase retries for HDFS Mover in hops-hadoop-chef
HOPSWORKS-2130 Refactor on-demand feature groups for HSFS
HOPSWORKS-2124 Remove R installation from spark::yarn
HOPSWORKS-2123 Add option to disable datasource validation when deploying Hopsworks
HOPSWORKS-2113 Add endpoint to list a user's projects
HOPSWORKS-2112 Return the user activation time as part of the userProfileDTO
HOPSWORKS-2093 remove env/pkgs dir symlinks in conda installation
HOPSWORKS-2091 Label/Prediction feature metadata for training datasets
HOPSWORKS-2084 Remove default_storage option from feature groups
HOPSWORKS-2077 add support for reading csv files as tf data object and rename feeder to tf_data
HOPSWORKS-2046 Kafka broker should use zookeeper fqdn instead of IP
HOPSWORKS-2045 artifact usage
HOPSWORKS-2044 Add option to return an error message if a user starts a YARN job but no nodemanagers are available
HOPSWORKS-2025 Delete a job's executions
HOPSWORKS-2010 Upgrade hudi to 0.6.1-SNAPSHOT for hsfs
HOPSWORKS-1986 Add redshift/snowflake examples and libraries
HOPSWORKS-1982 Deequ statistics for Feature Groups/Training Datasets
HOPSWORKS-1878 Add default args for Jobs
HOPSWORKS-1847 online feature store storage connectors should not be stored in the database
HOPSWORKS-1833 Move beam related files from conf directory to lib
HOPSWORKS-1769 enable publishing models to other projects
HOPSWORKS-1374 Add Hudi API to HSFS and commits to the FeatureStore metadata

New Feature

HOPSWORKS-2014 Manage AWS roles per application in Hopsworks
HOPSWORKS-2009 Append Features to Feature Group schema
HOPSWORKS-1853 Support installation of custom egg, wheel and from git sources
HOPSWORKS-1751 Query replay for training datasets

Sub-task

HOPSWORKS-1580 Online Feature Store JDBC password retrieval from UI

Assets 2
Loading