Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update taskcluster to 44.17.0 #1447

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Update taskcluster to 44.17.0 #1447

wants to merge 1 commit into from

Conversation

pyup-bot
Copy link
Collaborator

This PR updates taskcluster from 1.3.5 to 44.17.0.

Changelog

44.16.4

USERS

▶ [patch] [5517](https://github.com/taskcluster/taskcluster/issues/5517)
This patch fixes the quarantined value on the workers table to be `n/a` if the quarantined value is in the past. This issue was first noticed in v44.16.3.

DEVELOPERS

▶ [patch]
Added docker-compose.yml for local development.

OTHER

▶ Additional change not described here: [5503](https://github.com/taskcluster/taskcluster/issues/5503).

44.16.3

GENERAL

▶ [patch]
This patch returns up the `quarantineUntil` field in the `workerManager.getWorker` and `workerManager.listWorkers` methods. This issue was first noticed in v44.15.0.

44.16.2

GENERAL

▶ [patch]
This patch adds a new field to be logged out on a failed provision call. This field will be used to measure the provisioning failed count.

USERS

▶ [patch] [5503](https://github.com/taskcluster/taskcluster/issues/5503)
Add missing task-rerun scope to github handler.

▶ [patch] [5506](https://github.com/taskcluster/taskcluster/issues/5506)
Log debug information for incoming Github webhooks.

▶ [patch] [5501](https://github.com/taskcluster/taskcluster/issues/5501)
This patch makes it so a user cannot click the `Terminate Worker` button on a Static or Standalone worker. This patch also moves the `Terminate Worker` button on the view individual worker page to the speed dial menu alongside the `Quarantine` button. These issues were first brought up in v44.15.0.

Automated Package Updates

<details>
<summary>1 Renovate updates</summary>

* Update module golang.org/x/tools to v0.1.11 (147766abb)

</details>

44.16.1

GENERAL

▶ [patch]
This fixes the default worker state of a worker not known by worker manager to be `standalone` as opposed to `unmanaged` to be consistent with the rest of the project. This issue was first brought up in v44.16.0

USERS

▶ [patch]
Fix this error (`Function listWorkers takes options: continuationToken, limit, quarantined, workerState but was given isQuarantined`) while filtering workers based on quaratine status.

44.16.0

GENERAL

▶ [patch]
Don't allow additional properties in `worker-response.yml` schema. Updated descriptions in `worker-response.yml` and `list-workers-response.yml` schemas to explain some default values that may occur in the case where the queue knows about the worker, but worker manager does not. Also, updated the GraphQL queries to extract additional needed data.

▶ [patch]
Fix schema validation issues.

▶ [patch]
Upgrade node to the latest LTS release, v16.15.1. Also upgrade `golangci-lint` to 1.46.2.

▶ [patch]
Upgrade to `go1.18.3` from `go1.18.2`.

DEPLOYERS

▶ [patch] [5042](https://github.com/taskcluster/taskcluster/issues/5042)
Add a configuration option to disable CORS configuration for the queue's S3
client. This is a step forward for supporting minio as a S3 backend.

▶ [patch] [5043](https://github.com/taskcluster/taskcluster/issues/5043)
Add a configuration option to enable `s3ForcePathStyle` for the queue's S3 client

USERS

▶ [minor] [5085](https://github.com/taskcluster/taskcluster/issues/5085)
Allow Taskcluster to rerun single task from github interface.

▶ [patch]
Replace rust-crypto by hmac-sha256 in the rust client to help with dependency deduplication

▶ [patch]
Update a few rust dependencies in the client crate to help reducing duplicates

44.15.5

GENERAL

▶ [patch]
Handle some null checks with optional chaining. Also, ensure all data is extracted out during `workerManager.listWorkers()` calls.

44.15.4

GENERAL

▶ [patch]
Fix arguments for `get_task_queue_wm_2` (`get_task_queue_wm` is now deprecated).

44.15.3

USERS

▶ [patch]
Remove unneeded read access to `workers` table from `queue` service. Add read access to `task_queues` table to `worker_manager` service for `workerManager.getWorker()` method to prevent 500 permission denied SQL error.

44.15.2

USERS

▶ [patch]
Fix `GRAPHQL_VALIDATION_FAILED` error on ViewWorker query.

44.15.1

USERS

▶ [patch]
Fix output schema validation error when calling `workerManager.listWorkers()` and `workerManager.getWorker()` methods by not requiring additional worker manager fields.

44.15.0

GENERAL

▶ [patch] [5459](https://github.com/taskcluster/taskcluster/issues/5459)
Add exponential backoff retries to the `dockerPush` function to help alleviate intermittent failures in the `release-publish` task.

DEPLOYERS

▶ [patch]
Updated k8s ingress API from deprecated `extensions/v1beta1` to `networking.k8s.io/v1` allowing usage of k8s 1.22+

USERS

▶ [minor] [5440](https://github.com/taskcluster/taskcluster/issues/5440)
Add functionality to terminate workers via a Terminate Worker button in the Worker views.

▶ [minor] [3060](https://github.com/taskcluster/taskcluster/issues/3060)
Mix queue and worker info to provide worker manager worker data in Worker views. This additional data also enabled us to provide a Terminate Worker button in the Worker views.

**Deprecated**: `queue.listWorkers()` and `queue.getWorker()`

**Use instead**: `workerManager.listWorkers()` and `workerManager.getWorker()`

▶ [patch] [5446](https://github.com/taskcluster/taskcluster/issues/5446)
Don't require user to hover over speed dial actions button to reach Raw Log button. Show by default.

▶ [patch] [5361](https://github.com/taskcluster/taskcluster/issues/5361)
Link Worker State Buttons on Worker Pool Details View to a filtered view of workers in that state.

▶ [patch]
Update some rust dependencies to get rid of duplicated versions of base64

DEVELOPERS

▶ [minor] [5152](https://github.com/taskcluster/taskcluster/issues/5152)
Fix default config value and improve prompt message.

44.14.0

GENERAL

▶ [minor] [5179](https://github.com/taskcluster/taskcluster/issues/5179)
Lazy rendering of big tables. Improves Roles page rendering

▶ [patch]
Go update from 1.18.1 to 1.18.2. Also upgrade golangci-lint from 1.45.2 to 1.46.1.

WORKER-DEPLOYERS

▶ [minor] [3490](https://github.com/taskcluster/taskcluster/issues/3490)
Azure: scan only worker pools with errors

44.13.7

GENERAL

▶ [patch]
Deprecate old Azure endpoints that are no longer use:
- `azureCredentials` (Can be migrated to `secrets` service)
- `azureTables`
- `azureTablesSAS`
- `azureContainers`
- `azureContainersSAS`

Remove test dependency on AZURE_ACCOUNT

▶ [patch] [5287](https://github.com/taskcluster/taskcluster/issues/5287)
fix: remove `temporary` dependency.

USERS

▶ [patch] [5363](https://github.com/taskcluster/taskcluster/issues/5363)
The generic-worker no longer resolves tasks as exception that mount a file/directory that has disappeared from the file system. Instead it invalidates the cache entry.

44.13.6

WORKER-DEPLOYERS

▶ [patch] [4999](https://github.com/taskcluster/taskcluster/issues/4999)
Introduce queue timeout to avoid some cloud calls to be stuck and fail whole scan process.

USERS

▶ [patch] [4366](https://github.com/taskcluster/taskcluster/issues/4366)
Display last date active in the worker detail view.

▶ [patch] [5412](https://github.com/taskcluster/taskcluster/issues/5412)
Docker-worker no longer accepts and ignores arbitrary properties in task payloads. It now only accepts properties defined in its payload schema.

▶ [patch] [2776](https://github.com/taskcluster/taskcluster/issues/2776)
Show worker tasks from most recent to least recent. Also, link the `taskId` field to the task page.

▶ [patch] [5433](https://github.com/taskcluster/taskcluster/issues/5433)
Show workers from last recently active. Also, removed the deprecated prop `onChangePage` and replaced with `onPageChange`.

44.13.5

GENERAL

▶ [patch]
Add null check to `lastDateActive` in queue workers serialize() func.

44.13.4

No changes

44.13.3

GENERAL

▶ [patch] [bug 1767244](http://bugzil.la/1767244)
Upgrade `hawk` to v9.0.1 to fix a vuln.

44.13.2

DEVELOPERS

▶ [patch]
Fix build.sh

44.13.1

GENERAL

▶ [patch]
Upgrade Node.js version from v16.14.2 to v16.15.0.

DEPLOYERS

▶ [patch] [5393](https://github.com/taskcluster/taskcluster/issues/5393)
Make `worker_info_update_frequency` optional.

WORKER-DEPLOYERS

▶ [patch] [5336](https://github.com/taskcluster/taskcluster/issues/5336)
Fix scroll to bottom link

USERS

▶ [patch] [5395](https://github.com/taskcluster/taskcluster/issues/5395)
Fixed exception in Github service's latest endpoint when using checks reporting

44.13.0

GENERAL

▶ [patch] [5373](https://github.com/taskcluster/taskcluster/issues/5373)
Allow local UI to run against existing taskcluster installation using `TASKCLUSTER_ROOT_URL`.

▶ [patch] [5362](https://github.com/taskcluster/taskcluster/issues/5362)
Display task artifacts sorted by importance

▶ [patch] [5348](https://github.com/taskcluster/taskcluster/issues/5348)
Fix artifact copy functionality.

▶ [patch]
Fix null check error from 5380

▶ [patch]
Upgrades some vulnerable rust deps and rust toolchain from 1.49.0 to 1.60.0.

WORKER-DEPLOYERS

▶ [minor] [4999](https://github.com/taskcluster/taskcluster/issues/4999)
Trigger immediate resource provisioning for Azure.

Since operations are already async, this shouldn't slow down provisioning loop.
It is done in attempt to prevent azure workers stay in 'Requested' state until the next `workerScannerAzure` loop picks it up.

▶ [patch] [bug 1613593](http://bugzil.la/1613593)
Adding extra information about failed worker provisioning

USERS

▶ [patch] [5364](https://github.com/taskcluster/taskcluster/issues/5364)
The `github/v1/repository/<owner>/<repo>/<branch>/latest` endpoint now supports projects using `checks-v2` reporting.

Automated Package Updates

<details>
<summary>1 Renovate updates</summary>

* Update dependency jwks-rsa to v2.1.0 (ea3902996)

</details>

44.12.3

GENERAL

▶ [patch]
Return `lastDateActive` from `queue.listWorkers()`.

Automated Package Updates

<details>
<summary>1 Renovate updates</summary>

* Update dependency eslint to v8.14.0 (3d31a1b0b)

</details>

44.12.2

GENERAL

▶ [patch]
Update `ViewWorkers` query to get `lastDateActive`. Update some schemas too.

Automated Package Updates

<details>
<summary>1 Renovate updates</summary>

* Update dependency azure/ms-rest-js to v2.6.1 (02b72bc2e)

</details>

44.12.1

GENERAL

▶ [patch]
`go get` no longer builds or installs packages in module-aware mode, so replacing with `go install`.

44.12.0

GENERAL

▶ [minor]
Go update from 1.17.8 to 1.18.1. Also upgrade golangci-lint from 1.44.2 to 1.45.2.

WORKER-DEPLOYERS

▶ [patch] [3163](https://github.com/taskcluster/taskcluster/issues/3163)
Add extra debug information for worker manager provisioner and scanner.

USERS

▶ [minor] [4366](https://github.com/taskcluster/taskcluster/issues/4366)
Display the last date active in the queue workers view.

DEVELOPERS

▶ [minor] [4366](https://github.com/taskcluster/taskcluster/issues/4366)
Add `last_date_active` column to `queue_workers` table. Add `queue_worker_seen_with_last_date_active`, `quarantine_queue_worker_with_last_date_active`, `get_queue_worker_tqid_with_last_date_active`, and `get_queue_workers_tqid_with_last_date_active` functions for this new column.

Deprecates `quarantine_queue_worker`, `get_queue_worker_tqid`, `get_queue_workers_tqid`, and `queue_worker_seen`.

44.11.1

GENERAL

▶ [patch]
Add new counts/capacities to graphql schema.

44.11.0

WORKER-DEPLOYERS

▶ [minor] [4987](https://github.com/taskcluster/taskcluster/issues/4987)
Worker manager scanner split in two: non-azure providers and azure.

USERS

▶ [minor] [4942](https://github.com/taskcluster/taskcluster/issues/4942)
Addresses 4942. Add worker capacities by state for worker pools to UI.

44.10.0

DEVELOPERS

▶ [minor] [4942](https://github.com/taskcluster/taskcluster/issues/4942)
Addresses 4942. Add `get_worker_pool_with_capacity_and_counts_by_state`, `get_worker_pools_with_capacity_and_counts_by_state`, and `update_worker_pool_with_capacity_and_counts_by_state` functions to get worker counts and capacity by state for worker pools.

Deprecates `get_worker_pool_with_capacity`, `get_worker_pools_with_capacity`, and `update_worker_pool_with_capacity`.

44.9.2

WORKER-DEPLOYERS

▶ [patch]
Change azure nic payload.

44.9.1

WORKER-DEPLOYERS

▶ [patch] [4987](https://github.com/taskcluster/taskcluster/issues/4987)
Azure cannot create VMs without with Network interface. We create network interface always, but skip provisioning of public IP when it's not needed.
There might be a case where public IP is needed for RDP though.

44.9.0

GENERAL

▶ [patch]
The existing pulse messages for worker-manager are now documented.

WORKER-DEPLOYERS

▶ [minor] [4987](https://github.com/taskcluster/taskcluster/issues/4987)
Skip public network creation for Azure workers that only have generic worker config.

OTHER

▶ Additional change not described here: [5323](https://github.com/taskcluster/taskcluster/issues/5323).

Automated Package Updates

<details>
<summary>1 Renovate updates</summary>

* Update dependency node-forge to v1.3.0 [SECURITY] (d53f7ce2a)

</details>

44.8.5

GENERAL

▶ [patch]
Upgrade Node.js version from v16.14.0 to v16.14.2 for OpenSSL security patch.

▶ [patch]
Upgrade to latest `minimist` version to address https://github.com/taskcluster/taskcluster/security/dependabot/73.

▶ [patch]
Upgrade to latest `mocha` version to address https://github.com/taskcluster/taskcluster/security/dependabot/70, https://github.com/taskcluster/taskcluster/security/dependabot/71, and https://github.com/taskcluster/taskcluster/security/dependabot/72.

USERS

▶ [patch] [5282](https://github.com/taskcluster/taskcluster/issues/5282)
Fix issue with unicode characters in user profile.

Using Github as oauth provider encodes user profile using base64 encoding,
which, if contains unicode characters, is not decoded properly by `atob()`.

44.8.4

GENERAL

▶ [patch] [5003](https://github.com/taskcluster/taskcluster/issues/5003)
Allow provisioner to exit instead of being stuck in delayed loop.

OTHER

▶ Additional changes not described here: [4999](https://github.com/taskcluster/taskcluster/issues/4999), [#5217](https://github.com/taskcluster/taskcluster/issues/5217).

44.8.3

DEPLOYERS

▶ [patch] [5235](https://github.com/taskcluster/taskcluster/issues/5235)
Added `__version__`, `__lbheartbeat__`, and `__heartbeat__` endpoints to web-server service. Can be reached at `/api/<service name>/v1/{__version__, __lbheartbeat__, __heartbeat__}`. `__heartbeat__` is simply returning a 200 empty JSON object for now - implementation to follow in individual PRs per service.

WORKER-DEPLOYERS

▶ [patch] [5269](https://github.com/taskcluster/taskcluster/issues/5269)
Worker-runner now renews worker credentials at an appropriate time, even if the host hibernates before the credentials expire.

USERS

▶ [patch] [5277](https://github.com/taskcluster/taskcluster/issues/5277)
Fix "can't access property length of undefined" that prevented showing missing permissions error.

▶ [patch] [5274](https://github.com/taskcluster/taskcluster/issues/5274)
fix: `Follow Log` enabled by default to automatically load to bottom of log file.

DEVELOPERS

▶ [patch] [5271](https://github.com/taskcluster/taskcluster/issues/5271)
Added missing badge statuses, changed badge colors to be more distinctive.

▶ [patch] [bug 1651965](http://bugzil.la/1651965)
Update get_queue_artifacts_paginated query to use index and speed up query.
Details: https://bugzilla.mozilla.org/show_bug.cgi?id=1651965

▶ [patch] [5284](https://github.com/taskcluster/taskcluster/issues/5284)
Updated azure test signature due to expiration of existing one.

▶ [patch]
Fix usage of `temporary.writeFile` in `uploadToS3` for docker-worker

44.8.2

GENERAL

▶ [patch]
Go patch update from 1.17.7 to 1.17.8. Also upgrade golangci-lint from 1.39.0 to 1.44.2.

DEPLOYERS

▶ [patch] [5234](https://github.com/taskcluster/taskcluster/issues/5234)
Added initial `/__heartbeat__` endpoint to all service APIs. Simply returning a 200 empty JSON object for now - implementation to follow in individual PRs per service.
Addresses issues 5234, 5236, 5237, 5238, 5239, 5240, 5241, 5242

Automated Package Updates

<details>
<summary>1 Renovate updates</summary>

* Update dependency karma to v6.3.16 [SECURITY] (cf36b0cc8)

</details>

44.8.1

DEPLOYERS

▶ [patch] [5235](https://github.com/taskcluster/taskcluster/issues/5235)
Added ingress to the web-server service to access the `__version__` and `__lbheartbeat__` endpoints. Can be reached at `/api/web-server/v1/{__version__, __lbheartbeat__}`.
These were added to comply with the [Dockerflow standard](https://github.com/mozilla-services/Dockerflow/#containerized-app-requirements).

USERS

▶ [patch] [5247](https://github.com/taskcluster/taskcluster/issues/5247)
Pagination and filters shown conditionally

▶ [patch]
Fix the badge generation when using the badge API. It now works when deployed through helm too

DEVELOPERS

▶ [patch]
Introduces `dev:ensure:db` and `dev:ensure:rabbit` commands to ensure postgres and rabbit have necessary user accounts and permissions.
Updated `dev-deployment.md` with instructions how to set up own rabbitmq/posgres for testing/dev puropses.

OTHER

▶ Additional change not described here: [5150](https://github.com/taskcluster/taskcluster/issues/5150).

44.8.0

DEPLOYERS

▶ [patch]
Added `__version__` and `__lbheartbeat__` endpoints to all services. Can be reached at `/api/<service name>/v1/{__version__, __lbheartbeat__}`.
These were added to comply with the [Dockerflow standard](https://github.com/mozilla-services/Dockerflow/#containerized-app-requirements).

USERS

▶ [minor] [5139](https://github.com/taskcluster/taskcluster/issues/5139)
Added support for `reporting: checks-v1` in generated github badges

44.7.2

USERS

▶ [patch] [5181](https://github.com/taskcluster/taskcluster/issues/5181)
Added "Copy URL" to the artifacts table.

Added filter row functionality for big tables.

▶ [patch] [5027](https://github.com/taskcluster/taskcluster/issues/5027)
Clicking on a secret row now works outside of the text part as well

Automated Package Updates

<details>
<summary>1 Renovate updates</summary>

* Update golang.org/x/sys commit hash to f242548 (f92231483)

</details>

44.7.1

GENERAL

▶ [patch]
Remove unneeded nginx config, `tcp_nopush` as it's already set in the default config by nginx.

44.7.0

GENERAL

▶ [patch] [4983](https://github.com/taskcluster/taskcluster/issues/4983)
Improved snapshot testing with react-testing-library (instead of Enzyme).
Fixes UI menu for the task actions: correct icon for tasks named `^(rerun|retrigger)`.
Improves ViewTask page: show all details without "Show more/show less".
Shows artifacts by default, if there's less than 10 of them.

▶ [patch]
Updated nginx user config location due to node LTS upgrade changing paths from `/etc/nginx/conf.d/default.conf` to `/etc/nginx/http.d/default.conf`.
Also, added `__heartbeat__` config back to `nginx.conf` to continue to serve 200s until work in https://github.com/taskcluster/taskcluster/issues/4597 is complete.

USERS

▶ [minor] [3540](https://github.com/taskcluster/taskcluster/issues/3540)
`generic-worker` tasks can now use `tar.xz` and `tar.zst` formatted mounts.

44.6.1

DEVELOPERS

▶ [patch] [5193](https://github.com/taskcluster/taskcluster/issues/5193)
Fix webpack loader to properly handle `.mjs` modules.

Include `yarn build` in testing pipeline to avoid inconsistent dependencies.

44.6.0

GENERAL

▶ [minor]
Node.js major update from 14.17.15 to 16.13.2, the latest LTS version.

Update the worker-ci image from Ubuntu 14.04 to 20.04, the current LTS version.
This image is used in Taskcluster CI testing. This includes Python 3.8 (as
python3), needed to build with node-gyp, and no longer includes Python 2.7.
It also updates the Docker engine from 18.06.3 to 20.10.12.

▶ [minor]
Node.js minor update from 16.13.2 to 16.14.0, the latest LTS version.

▶ [minor]
This release updates the `docker-worker-websocket-client` and
`docker-worker-websocket-server` libraries, used by `docker-worker` to execute
commands inside a running container. These updates fix a bug when reading and
writing data to the process in the container, which may have been broken since
2015, and be a part of why VNC was broken
(see [issue 3542](https://github.com/taskcluster/taskcluster/issues/3542#issuecomment-746934147)).
This change required for Node v16, and may affect tasks that use this library like the
[interactive feature](https://docs.taskcluster.net/docs/reference/workers/docker-worker/features#feature-interactive).

▶ [patch]
Go patch update from 1.17.6 to 1.17.7.

▶ [patch]
Replaced `github.com/dgrijalva/jwt-go` with `github.com/golang-jwt/jwt/v4` as suggested in the *high* dependabot vulnerability listed [here](https://github.com/taskcluster/taskcluster/security/dependabot/19).

▶ [patch] [4940](https://github.com/taskcluster/taskcluster/issues/4940)
Sets the content type of the json returned by the `__heartbeat__` and `__lbheartbeat__` endpoints.

USERS

▶ [patch] [5153](https://github.com/taskcluster/taskcluster/issues/5153)
Fixes https://github.com/taskcluster/taskcluster/issues/5153. CLI signin now properly redirects to a success page.

DEVELOPERS

▶ [patch]
Replacing ui test runner from `karma` to `jest` to allow snapshot testing.

Automated Package Updates

<details>
<summary>4 Renovate updates</summary>

* Update dependency error-stack-parser to v2.0.7 (a5e2e2848)
* Update dependency cronstrue to v1.125.0 (180be8ada)
* Update dependency memorystore to v1.6.7 (dbae29c2a)
* Update dependency sinon to v13 (aebe0f51b)

</details>

44.5.0

GENERAL

▶ [patch] [5082](https://github.com/taskcluster/taskcluster/issues/5082)
Updated go from 1.16.7 to 1.17.6. This fixes an issue where the generic worker
failed to build on M1 MacBooks (arm64).

USERS

▶ [minor]
Fixed artifacts pagination

OTHER

▶ Additional change not described here: [5070](https://github.com/taskcluster/taskcluster/issues/5070).

Automated Package Updates

<details>
<summary>7 Renovate updates</summary>

* Update dependency marked to v4.0.12 (0906dace1)
* Update dependency commander to v9 (1f4311d02)
* Update dependency node-forge to v1.2.1 (5c574d544)
* Update dependency matrix-js-sdk to v15 (7cf55a467)
* Update dependency node-fetch to v2.6.7 [SECURITY] (0cfcab9dd)
* Update dependency apollo-server-express to v3 (181db987b)
* Update dependency github-slugger to v1.4.0 (d44be4204)

</details>

44.4.0

DEPLOYERS

▶ [patch] [5039](https://github.com/taskcluster/taskcluster/issues/5039)
The new `queue.aws_endpoint` Helm configuration value allows setting the endpoint used to access S3 buckets.  This configuration enables use of non-AWS S3-compatible backends.

DEVELOPERS

▶ [minor] [4614](https://github.com/taskcluster/taskcluster/issues/4614)
This version drops support for Python-2.7 in the Python client. Python-2.7's support window ended over one year ago.

OTHER

▶ Additional change not described here: [4594](https://github.com/taskcluster/taskcluster/issues/4594).

44.3.0

GENERAL

▶ [patch]
In the Monitoring Services document, display the generated table of scheduled tasks.

▶ [patch] [bug 1735159](http://bugzil.la/1735159)
UI no longer visually emphasizes special characters of scopes (reverts 974 / 904).

WORKER-DEPLOYERS

▶ [patch] [4926](https://github.com/taskcluster/taskcluster/issues/4926)
Adds release binary for generic-worker-simple on MacOS arm64.

▶ [patch] [5011](https://github.com/taskcluster/taskcluster/issues/5011)
In worker-runner, the static provider is incompatible with cacheOverRestarts.  The tool now produces more useful error messages in this situaiton.

Worker-runner also fails with a useful error message if its credentials are too old on startup, as might happen if a worker restart takes too long.

▶ [patch] [bug 1635730](http://bugzil.la/1635730)
generic-worker multiuser engine running on macOS will now attempt to cleanup /private/var/folders when deleting a task OS user account.

ADMINS

▶ [patch] [4999](https://github.com/taskcluster/taskcluster/issues/4999)
The registration-error-warning, logged from the Azure provider's register()
function in worker-manager, now includes workerPoolId, providerID, and
workerID in its context.

When register-error-warning is due to the state not being REQUESTED,
the workerState is also in the context.

USERS

▶ [minor] [2679](https://github.com/taskcluster/taskcluster/issues/2679)
Now after `taskcluster signin` the sign in dialog is shown instead of message if user is not logged in.

▶ [patch] [4962](https://github.com/taskcluster/taskcluster/issues/4962)
Clicking on the role row now works outside of the text part as well

DEVELOPERS

▶ [minor] [5021](https://github.com/taskcluster/taskcluster/issues/5021)
for `upload_artifact` from `client-py` let `contet` be `bytes` or `str`.

▶ [patch] [4242](https://github.com/taskcluster/taskcluster/issues/4242)
Replacing the UI element for non-editable object display to allow yaml/json serialization

OTHER

▶ Additional changes not described here: [4939](https://github.com/taskcluster/taskcluster/issues/4939), [#4947](https://github.com/taskcluster/taskcluster/issues/4947), [#4997](https://github.com/taskcluster/taskcluster/issues/4997), [#5106](https://github.com/taskcluster/taskcluster/issues/5106).

Automated Package Updates

<details>
<summary>6 Renovate updates</summary>

* Update dependency prismjs to v1.25.0 [SECURITY] (ba2350c98)
* Update dependency react-router-dom to v5.2.1 (470a49616)
* Update dependency marked to v3.0.2 (85607db2e)
* Update dependency marked to v3.0.1 (2223cdcee)
* Update dependency generate-password to v1.6.1 (038c1f6c6)
* Update dependency marked to v3 (4a868be54)

</details>

44.2.2

DEPLOYERS

▶ [patch]
No changes. Deployment failed for 44.2.1 as well.

44.2.1

DEPLOYERS

▶ [patch]
No changes. Deployment failed on 44.2.0 due to intermittent network issue.

44.2.0

GENERAL

▶ [minor]
Upgrade from node 14.16.1 to 14.17.5, and from go 1.16.3 to 1.16.7.

ADMINS

▶ [patch] [4946](https://github.com/taskcluster/taskcluster/issues/4946)
On the UI page /hooks, fix the "no hooks" detection so that hook groups are displayed.

OTHER

▶ Additional change not described here: [4944](https://github.com/taskcluster/taskcluster/issues/4944).

44.1.0

USERS

▶ [minor] [bug 1131975](http://bugzil.la/1131975)
taskcluster command line tool to validate json against a schema. having syntax `taskcluster validate-json https://some_schema.json https://example.son`

▶ [patch] [4896](https://github.com/taskcluster/taskcluster/issues/4896)
The queue no longer returns 500 errors when calling `queue.getArtifact` for an object artifact.

DEVELOPERS

▶ [patch] [4934](https://github.com/taskcluster/taskcluster/issues/4934)
When running ``yarn dev:init``, store the RabbitMQ cluster management API
origin at ``meta.rabbitAdminManagementOrigin`` rather than the root key
``rabbitAdminManagementOrigin``.  This avoids a schema validation error when
running ``yarn dev:apply``. If you've already run ``yarn dev:init``, then you
can manually move ``rabbitAdminManagementOrigin`` in ``dev-config.yml``.

▶ [patch] [2749](https://github.com/taskcluster/taskcluster/issues/2749)
updated the hook component to be using ListView from material-ui

OTHER

▶ Additional change not described here: [4920](https://github.com/taskcluster/taskcluster/issues/4920).

Automated Package Updates

<details>
<summary>4 Renovate updates</summary>

* Update dependency dot-prop-immutable to v2.1.1 (ab1053410)
* Update dependency dotenv to v10 (2a5debab3)
* Update dependency highlight.js to v11 (580294e2e)
* Update golang.org/x/net commit hash to 04defd4 (26471370b)

</details>

44.0.0

GENERAL

▶ [patch] [bug 1712924](http://bugzil.la/1712924)
Resolves an issue with github logins

DEPLOYERS

▶ [patch] [4882](https://github.com/taskcluster/taskcluster/issues/4882)
Taskcluster-lib-pulse now supports connections to servers that use SNI, such as up-to-date CloudAMQP clusters using a custom certificate.  It does so by passing an explicit `servername` socket option.

WORKER-DEPLOYERS

▶ [patch] [4606](https://github.com/taskcluster/taskcluster/issues/4606)
Generic-worker now supports downloading object artifacts as well as the older s3 artifacts.

USERS

▶ [MAJOR] [4895](https://github.com/taskcluster/taskcluster/issues/4895)
The upload helper functions included with each client now take an uploadId parameter.  For Go and Rust, these parameters are required.

▶ [patch] [bug 1711612](http://bugzil.la/1711612)
Retried calls to `queue.createArtifact` will now work correctly, allowing both retries and the documented updates.

▶ [patch] [4764](https://github.com/taskcluster/taskcluster/issues/4764)
The JS, Rust, Go (in a previous release) and Python clients now have artifact download functions which will download an artifact regardless of its storage type, applying retries and other best practices.

▶ [patch] [4714](https://github.com/taskcluster/taskcluster/issues/4714)
The client libraries' object-upload functions now calculate and send hashes for the uploaded objects.

▶ [patch] [4890](https://github.com/taskcluster/taskcluster/issues/4890)
This version fixes a bug in the rust client where API methods with method POST but without a request payload would result in 411 errors due to a missing Content-Length header.

▶ [patch] [bug 1711921](http://bugzil.la/1711921)
When a docker-worker's payload specifies an artifact name ending with `/`, it has historically produced an artifact containing `//`.  That is now normalized to a single `/`.

OTHER

▶ Additional changes not described here: [4757](https://github.com/taskcluster/taskcluster/issues/4757), [#4807](https://github.com/taskcluster/taskcluster/issues/4807), [#4889](https://github.com/taskcluster/taskcluster/issues/4889).

Automated Package Updates

<details>
<summary>40 Renovate updates</summary>

* Update golang.org/x/crypto commit hash to c07d793 (ea40252e1)
* Update dependency markdown-it-highlightjs to v3.5.0 (d67d60600)
* Update babel monorepo to v7.14.2 (115ac480b)
* Update dependency slack/web-api to v6.2.3 (3d16b170a)
* Update dependency newrelic to v7.4.0 (90fe4b739)
* Update dependency slack/web-api to v6.2.2 (7ba2251ef)
* Update dependency slack/web-api to v6.2.0 (b25bc43b5)
* Update dependency dotenv to v9.0.2 (dfbf4b795)
* Update dependency azure/ms-rest-js to v2.5.0 (7c591e5e6)
* Update dependency matrix-js-sdk to v10.1.0 (b3ccf63db)
* Update sentry monorepo to v6.3.6 (710cf7ec4)
* Update dependency dotenv to v9.0.1 (04f077b34)
* Update dependency date-fns to v2.21.3 (48c0813c0)
* Update dependency eslint to v7.26.0 (97e6c18e8)
* Update dependency fontsource/roboto to v4.3.0 (09b4e5db2)
* Update dependency mocha to v8.4.0 (4557c4f26)
* Update dependency glob to v7.1.7 (bf726bf1e)
* Update dependency cronstrue to v1.113.0 (467bf9cc1)
* Update dependency webpack-cli to v4.7.0 (a196ecfde)
* Update dependency react-error-boundary to v3.1.2 (83fda51a3)
* Update dependency dotenv to v9 (da7db4cf8)
* Update dependency azure/ms-rest-js to v2.4.1 (bd381f834)
* Update dependency dotenv to v8.6.0 (0504cbc01)
* Update dependency dotenv to v8.5.1 (7c1d516fa)
* Update dependency date-fns to v2.21.2 (1bd674399)
* Update dependency prism-themes to v1.7.0 (79933532b)
* Update dependency babel/preset-env to v7.14.1 (9a0a0acdf)
* Update golang.org/x/crypto commit hash to e9a3299 (785646e19)
* Update dependency utf-8-validate to v5.0.5 (d03cd44fc)
* Update dependency sift to v13.5.3 (ff7806d5e)
* Update dependency c8 to v7.7.2 (9ea49cac1)
* Update dependency googleapis to v73 (b1d025c50)
* Update dependency babel/core to v7.14.0 (e9403fe28)
* Update dependency apollo-server-express to v2.24.0 (c3b2d47bd)
* Update sentry monorepo to v6.3.5 (6254bca4c)
* Update sentry monorepo to v6.3.4 (f964f5786)
* Update babel monorepo to v7.14.0 (cc6150681)
* Update dependency graphql-tag to v2.12.4 (890bc312c)
* Update mui monorepo (436da33e3)
* Update module github.com/Microsoft/go-winio to v0.5.0 (4837680df)

</details>

43.2.0

DEPLOYERS

▶ [minor] [4746](https://github.com/taskcluster/taskcluster/issues/4746)
The object service is now ready for use.
The queue supports an `object` storage type which will be stored in the object service.
As of this version, we recommended setting `procs: 1` for the object service if it had previously been set to `0`, and [configuring at least one backend](https://docs.taskcluster.net/docs/manual/deploying/object-service) for artifacts.

▶ [patch] [4648](https://github.com/taskcluster/taskcluster/issues/4648)
All services now have a `<service>.pulse_amqps` Helm configuration that controls whether to use amqps (with TLS) to communicate with the Pulse server.  The value defaults to true, matching current behavior, but can be set to false in cases where the AMQP server is local and encryption is unnecessary.

▶ [patch]
The object service now defaults to 1 replica, not 0.  The service will not start if it is not properly configured, and we recommend setting the service up at this time, as in the next major release workers will begin uploading objects to the queue.

WORKER-DEPLOYERS

▶ [minor] [bug 1631824](http://bugzil.la/1631824)
The Azure provider of the worker-manager service now assigns unique names to all data disks attached to a VM, allowing those disks to be removed when the worker is removed.

▶ [patch] [4765](https://github.com/taskcluster/taskcluster/issues/4765)
Native "Apple silicon" binaries of taskcluster-proxy, livelog, start-worker and generic-worker are provided (darwin-arm64). The darwin amd64 executables no longer need to be run through Rosetta 2 binary translation on darwin/arm64 workers.

▶ [patch] [3925](https://github.com/taskcluster/taskcluster/issues/3925)
The worker-manager service now ships with the latest CA certs, avoiding the need to download these at runtime.  These certificates are good until October 8, 2024.

OTHER

▶ Additional changes not described here: [4707](https://github.com/taskcluster/taskcluster/issues/4707), [#4779](https://github.com/taskcluster/taskcluster/issues/4779), [#4795](https://github.com/taskcluster/taskcluster/issues/4795).

Automated Package Updates

<details>
<summary>36 Renovate updates</summary>

* Update dependency nodemailer to v6.6.0 (017dabd7a)
* Update dependency graphql-scalars to v1.9.3 (45bc9229d)
* Update dependency dockerode to v3.3.0 (8468771e4)
* Update dependency acorn-walk to v8.1.0 (441cbbd37)
* Update dependency acorn-loose to v8.1.0 (3173f9ef7)
* Update dependency sentry/node to v6.3.1 (2d544b14e)
* Update sentry monorepo to v6.3.1 (97356358d)
* Update module github.com/elastic/go-sysinfo to v1.7.0 (fec645d00)
* Update dependency eslint to v7.25.0 (7a16de292)
* Update dependency cron-parser to v3.5.0 (544d48373)
* Update dependency matrix-js-sdk to v10 (a8b8859ce)
* Update dependency sift to v13.5.2 (9f53306db)
* Update dependency mock-fs to v4.14.0 (2db47d750)
* Update dependency jwks-rsa to v2.0.3 (03791e002)
* Update module github.com/Microsoft/go-winio to v0.4.19 (5948f9cde)
* Update dependency octokit/auth-app to v3.4.0 (cd84ff0c0)
* Update dependency codemirror to v5.61.0 (2230e8455)
* Update dependency chalk to v4.1.1 (1a83c1860)
* Update dependency octokit/rest to v18.5.3 (8d73079f6)
* Update dependency serialize-error to v8.1.0 (c2e871c97)
* Update dependency cron-parser to v3.4.0 (30614faef)
* Update sentry monorepo to v6.3.0 (ad265870e)
* Update babel monorepo to v7.13.16 (b06a39065)
* Update module github.com/Microsoft/go-winio to v0.4.18 (549708f6b)
* Update dependency azure/ms-rest-js to v2.4.0 (63e03fbb4)
* Update dependency cronstrue to v1.112.0 (5cff320d3)
* Update dependency material-ui-json-schema-viewer to v1.2.0 (ea79b2183)
* Update dependency fast-azure-storage to v3.1.4 (705d8460e)
* Update golang.org/x/net commit hash to e915ea6 (55c6abd6d)
* Update golang.org/x/sys commit hash to 66c3f26 (c957d084c)
* Update golang.org/x/crypto commit hash to 4f45737 (85a4e60dd)
* Update dependency ws to v7.4.5 (226ed46e3)
* Update dependency escape-string-regexp to v5 (7de69356b)
* Update dependency markdown-it to v12.0.6 (37ffe8301)
* Update dependency markdown-it to v12.0.5 (82cf42d2b)
* Update dependency date-fns to v2.21.1 (71095d097)

</details>

43.1.0

GENERAL

▶ [patch] [4696](https://github.com/taskcluster/taskcluster/issues/4696)
The `github.com/taskcluster/taskcluster/vNN/workers/generic-worker/mocktc` library is no longer publicly exposed.

▶ [patch]
Upgrade from node 14.16.0 to 14.16.1 across services and docker-worker.

DEPLOYERS

▶ [patch] [bug 1442024](http://bugzil.la/1442024)
The object service now serves `text/html` content with `Content-Disposition: attachment` to avoid security issues inherent in serving arbitrary HTML documents.

WORKER-DEPLOYERS

▶ [patch]
Go major version upgrade for generic-worker and worker-runner (go 1.15.6 -> go 1.16.3). Prerequisite step for providing native darwin/arm64 binaries for both (native Apple Silicon builds).

USERS

▶ [minor] [4548](https://github.com/taskcluster/taskcluster/issues/4548)
The queue now additionally supports artifacts with the storageType `object`, stored via the object service.

▶ [patch] [4576](https://github.com/taskcluster/taskcluster/issues/4576)
The shell client now has two new commands to download data from Taskcluster:
* `taskcluster download object <name> <filename>` -- download directly from the object service
* `taskcluster download artifact <taskId> [<runId>] <name> <filename>` -- download the content of an artifact
These commands follow current best practices, including retries with backoff.  When supported by the object service, they will also verify download integrity.

▶ [patch] [4698](https://github.com/taskcluster/taskcluster/issues/4698)
Uploading functions in the Python client have been renamed to use camel-case instead of underscores.

OTHER

▶ Additional changes not described here: [4623](https://github.com/taskcluster/taskcluster/issues/4623), [#4631](https://github.com/taskcluster/taskcluster/issues/4631), [#4739](https://github.com/taskcluster/taskcluster/issues/4739), [#4741](https://github.com/taskcluster/taskcluster/issues/4741), [#4744](https://github.com/taskcluster/taskcluster/issues/4744).

Automated Package Updates

<details>
<summary>20 Renovate updates</summary>

* Update dependency js-yaml to v4.1.0 (bc2dda559)
* Update dependency apollo-server-express to v2.23.0 (66941613e)
* Update dependency newrelic to v7.3.1 (bd6a791e4)
* Update dependency date-fns to v2.21.0 (64f8cc301)
* Update module github.com/Microsoft/go-winio to v0.4.17 (426fca502)
* Update dependency azure/arm-network to v24 (f825d482d)
* Update dependency pg to v8.6.0 (30f5a5e10)
* Update dependency pg-connection-string to v2.5.0 (2242418b5)
* Update dependency date-fns to v2.20.3 (ca4880d6a)
* Update dependency matrix-js-sdk to v9.11.0 (ddae91aeb)
* Update dependency date-fns to v2.20.2 (4f6c915d6)
* Update dependency googleapis to v71 (b3a9a029e)
* Update dependency marked to v2.0.3 (9b7f98b46)
* Update dependency fontsource/roboto to v4.2.3 (80ca3de16)
* Update dependency eslint to v7.24.0 (b41017797)
* Update dependency mock-aws-s3 to v4.0.2 (9be4a7c0e)
* Update dependency date-fns to v2.20.1 (ecc66230b)
* Update babel monorepo to v7.13.15 (9a5a263fd)
* Update dependency taskcluster-client-web to v43 (9fd14d658)
* Update dependency taskcluster-client to v43 (ef7574f3c)

</details>

43.0.0

DEPLOYERS

▶ [patch] [4655](https://github.com/taskcluster/taskcluster/issues/4655)
Since 4586 landed, the built-in-workers service has failed to resolve tasks due to using the wrong credentials.  This issue has been fixed, and no released version of Taskcluster had this bug.

▶ [patch] [4561](https://github.com/taskcluster/taskcluster/issues/4561)
The GitHub service now allows collaborators to test out a `.taskcluster.yml` in a PR, when there is no such file in the default branch initialized yet.

▶ [patch] [4556](https://github.com/taskcluster/taskcluster/issues/4556)
The `auth.azure_accounts` Helm value is no longer required.

▶ [patch] [3981](https://github.com/taskcluster/taskcluster/issues/3981)
The new `queue.task_claim_timeout` Helm configuration parameter controls the duration of the task claim that `queue.claimWork` returns.  The default is 20 minutes, matching the previous hard-coded setting.

WORKER-DEPLOYERS

▶ [MAJOR] [3779](https://github.com/taskcluster/taskcluster/issues/3779)
Generic-worker simple/docker engine now have a default tasks directory of `tasks`, relative to the working directory. This is a breaking change from previous behaviour.

▶ [patch] [4691](https://github.com/taskcluster/taskcluster/issues/4691)
Added a generic-worker config parameter (`livelogPortBase`) to allow configuring which ports are used for live logging.

▶ [patch] [4715](https://github.com/taskcluster/taskcluster/issues/4715)
The worker-manager service now deprovisions workers when `removeWorker` is called and when the workers terminate themselves.  Previously it would wait forever for such workers to be deleted, without attempting that deletion.

USERS

▶ [MAJOR] [4586](https://github.com/taskcluster/taskcluster/issues/4586)
The following queue API endpoints no longer support their legacy scopes.
In most of these cases, the legacy scopes are shorter than the still-supported fully-qualified scopes.
* `queue.claimTask` no longer accepts `queue:claim-task`.
* `queue.reclaimTask` no longer accepts `queue:reclaim-task`.
* `queue.reportCompleted` and `queue.reportException` no longer accept `queue:resolve-task`.
* `queue.createArtifact` no longer accepts `queue:create-artifact:<name>`.

Investigations detailed in the linked issue suggest that none of these scopes are actively used.

▶ [minor] [4516](https://github.com/taskcluster/taskcluster/issues/4516)
The index service has a new `index.deleteTask` method that can be used to delete indexed tasks.

▶ [minor] [4547](https://github.com/taskcluster/taskcluster/issues/4547)
This version adds new queue methods `artifact`, `latestArtifact`, `artifactInfo`, and `latestArtifactInfo`, all of which provide more flexible access to information about artifacts.

▶ [patch] [4502](https://github.com/taskcluster/taskcluster/issues/4502)
The GitHub service now correctly handles tasks that depend on other tasks not defined in `.taskcluster.yml`.

▶ [patch] [3794](https://github.com/taskcluster/taskcluster/issues/3794)
The worker manager no longer considers quarantined users in its definition of existing capacity. If necessary, it will provision new workers for any pending tasks as if the quarantined worker did not exist.

DEVELOPERS

▶ [patch] [2393](https://github.com/taskcluster/taskcluster/issues/2393)
On the Secrets and Roles pages, a delete button now appears on each row.

▶ [patch]
The client libraries (Go, Python, Rust, and JS) now provide convenience methods for uploading/downloading objects to/from the Object Service.

▶ [patch] [3964](https://github.com/taskcluster/taskcluster/issues/3964)
The styleguidist support in `ui/` was outdated and has been removed.

OTHER

▶ Additional changes not described here: [bug 1419577](http://bugzil.la/1419577), [bug 1701255](http://bugzil.la/1701255), [#3948](https://github.com/taskcluster/taskcluster/issues/3948), [#3993](https://github.com/taskcluster/taskcluster/issues/3993), [#4133](https://github.com/taskcluster/taskcluster/issues/4133), [#4420](https://github.com/taskcluster/taskcluster/issues/4420), [#4422](https://github.com/taskcluster/taskcluster/issues/4422), [#4423](https://github.com/taskcluster/taskcluster/issues/4423), [#4424](https://github.com/taskcluster/taskcluster/issues/4424), [#4453](https://github.com/taskcluster/taskcluster/issues/4453), [#4523](https://github.com/taskcluster/taskcluster/issues/4523), [#4587](https://github.com/taskcluster/taskcluster/issues/4587), [#4592](https://github.com/taskcluster/taskcluster/issues/4592), [#4608](https://github.com/taskcluster/taskcluster/issues/4608), [#4610](https://github.com/taskcluster/taskcluster/issues/4610), [#4631](https://github.com/taskcluster/taskcluster/issues/4631), [#4631](https://github.com/taskcluster/taskcluster/issues/4631), [#4646](https://github.com/taskcluster/taskcluster/issues/4646), [#4649](https://github.com/taskcluster/taskcluster/issues/4649), [#4705](https://github.com/taskcluster/taskcluster/issues/4705), [#4722](https://github.com/taskcluster/taskcluster/issues/4722), [#4537](https://github.com/taskcluster/taskcluster/issues/4537).

Automated Package Updates

<details>
<summary>87 Renovate updates</summary>

* Update dependency date-fns to v2.20.0 (147161c51)
* Update dependency aws-sdk to v2.882.0 (66b55c44b)
* Update dependency c8 to v7.7.1 (1114447ee)
* Update golang.org/x/crypto commit hash to 0c34fe9 (2f3539aba)
* Update dependency newrelic to v7.3.0 (f40bd6f02)
* Update dependency octokit/core to v3.4.0 (ecea473b8)
* Update dependency googleapis to v70 (9f337e00c)
* Update dependency highlight.js to v10.7.2 (df0248dcc)
* Update dependency netmask to v2.0.2 (c1b85704c)
* Update dependency classnames to v2.3.1 (e1288ae9d)
* Update dependency ajv-formats to v1.6.1 (c732037d2)
* Update sentry monorepo to v6.2.5 (acb83ddba)
* Lock file maintenance (a64902252)
* Update dependency classnames to v2.3.0 (801d4b22e)
* Update dependency azure/ms-rest-nodeauth to v3.0.9 (cd67b124b)
* Update dependency sentry/browser to v6.2.4 (f4dabf757)
* Update sentry monorepo to v6.2.4 (8095de61d)
* Update babel monorepo (33994a37a)
* Update dependency semver to v7.3.5 (75b8729ee)
* Update dependency matrix-js-sdk to v9.10.0 (144178e0e)
* Update dependency octokit/core to v3.3.2 (09794f9ac)
* Update dependency newrelic to v7.2.1 (e1353ac2b)
* Update dependency webpack-cli to v4.6.0 (39826fb85)
* Update dependency c8 to v7.7.0 (1274fa2c3)
* Update dependency cronstrue to v1.111.0 (fe975dfd2)
* Update dependency karma to v6.3.2 (3014cf357)
* Update babel monorepo (571dfed8d)
* Update dependency apollo-server-express to v2.22.2 (e034c01f0)
* Update dependency ajv-formats to v1.6.0 (b770ddccc)
* Update dependency ajv to v7.2.4 (b7e86e1b9)
* Update dependency netmask to v2.0.1 [SECURITY] (12ccc3d98)
* Update dependency azure/ms-rest-js to v2.3.0 (f52fa443a)
* Update dependency eslint to v7.23.0 (2b5cfe601)
* Update dependency octokit/rest to v18.5.2 (8e18d296c)
* Update dependency newrelic to v7.2.0 (70660da47)
* Update dependency sanitize-html to v2.3.3 (8bca0746c)
* Update dependency jwks-rsa to v2.0.2 (7391cd61c)
* Update dependency qs to v6.10.1 (b64ae138f)
* Update dependency karma to v6.3.1 (9c2ccbbc7)
* Update dependency mockdate to v3.0.5 (57361d447)
* Update dependency apollo-server-express to v2.22.1 (824e1ab8c)
* Update dependency commander to v7.2.0 (fa9fbf0b9)
* Update dependency octokit/rest to v18.5.0 (791826713)
* Update dependency email-templates to v8.0.4 (15aea7477)
* Update dependency octokit/auth-app to v3.3.0 (9b1f6093b)
* Update dependency highlight.js to v10.7.1 (e133da2c1)
* Update dependency codemirror to v5.60.0 (3bc8581f6)
* Update dependency azure/arm-compute to v16.1.0 (3b612f872)
* Update dependency azure/ms-rest-nodeauth to v3.0.8 (209a76159)
* Update dependency azure/arm-network to v23.3.0 (e4349eb8a)
* Update dependency prism-themes to v1.6.0 (b1bdf6d93)
* Update babel monorepo (1eaf00a21)
* Update dependency sinon to v10 (90090115e)
* Update dependency mocha to v8.3.2 (597d41365)
* Update dependency netmask to v2 (baca3986e)
* Update dependency json-e to v4.4.1 (36a027bd7)
* Update dependency got to v11.8.2 (a2d93a036)
* Update dependency memorystore to v1.6.6 (edd1dffbb)
* Update dependency apollo-server-express to v2.21.2 (c07a423a4)
* Update dependency qs to v6.10.0 (744632b5d)
* Update dependency mockdate to v3.0.4 (212ec99f4)
* Update dependency ajv to v7 (0894eba1a)
* Update module github.com/sirupsen/logrus to v1.8.1 (6c60fe019)
* Update dependency query-string to v7 (b57ba45bd)
* Update sentry monorepo to v6.2.2 (e4780e450)
* Update dependency ws to v7.4.4 (0d0288e0f)
* Update dependency nock to v13.0.11 (d3e475f55)
* Update dependency mocha to v8.3.2 (82ecf1082)
* Update dependency mockdate to v3.0.3 (8294292ef)
* Update dependency octokit/core to v3.3.1 (da988bc58)
* Update dependency jwks-rsa to v2.0.1 (a31c440d6)
* Update dependency eslint to v7.22.0 (86b38bc82)
* Update dependency chai to v4.3.4 (bdcc64e37)
* Update dependency matrix-js-sdk to v9.9.0 (f51fbb19e)
* Update dependency json-e to v4.4.1 (5247310e6)
* Update dependency material-ui/pickers to v3.3.10 (1973bbaf7)
* Update dependency jwks-rsa to v2 (1f3634f04)
* Update dependency newrelic to v7.1.3 (75ea84a48)
* Update dependency cronstrue to v1.110.0 (98ac5e7f9)
* Update dependency apollo-server-express to v2.21.1 (df7622487)
* Update dependency amqplib to v0.7.1 (612d1bc8d)
* Update dependency slack/web-api to v6.1.0 (12ae248d4)
* Update dependency karma to v6.2.0 (549495342)
* Update dependency octokit/rest to v18.3.5 (284fdbdc4)
* Update dependency octokit/core to v3.3.0 (c30372968)
* Update dependency nock to v13.0.11 (30d166150)
* Update dependency nodemailer to v6.5.0 (619bcc75f)

</details>

42.1.1

USERS

▶ [patch] [4519](https://github.com/taskcluster/taskcluster/issues/4519)
Tasks with `priority` or `requires` can once again be created via the UI. (This includes creating interactive tasks.)

Automated Package Updates

<details>
<summary>4 Renovate updates</summary>

* Update babel monorepo to v7.13.10 (1026e2d45)
* Update dependency mocha to v8.3.1 (6667e8596)
* Update dependency azure/arm-compute to v16 (02d180889)
* Update dependency sentry/browser to v6.2.1 (8fbf8ac79)

</details>

42.1.0

USERS

▶ [minor] [4470](https://github.com/taskcluster/taskcluster/issues/4470)
The task-creator and retrigger function now treat task definitions as a JSON object, accepting new properties such as `taskQueueId` and `projectId`.

▶ [patch] [4502](https://github.com/taskcluster/taskcluster/issues/4502)
A case where an invalid .taskcluster.yml would not result in a user-visible error has been fixed

DEVELOPERS

▶ [patch] [2393](https://github.com/taskcluster/taskcluster/issues/2393)
On the page where all clients are listed, added Delete icon beside each client. This helps to delete client faster without going to the Client page.

OTHER

▶ Additional change not described here: [4458](https://github.com/taskcluster/taskcluster/issues/4458).

Automated Package Updates

<details>
<summary>20 Renovate updates</summary>

* Update dependency octokit/rest to v18.3.4 (f5b805bbf)
* Update dependency date-fns to v2.19.0 (c8cae454e)
* Update dependency octokit/rest to v18.3.3 (1b64a996e)
* Update sentry monorepo to v6.2.1 (a52b78160)
* Update dependency cron-parser to v3.3.0 (69a28fc11)
* Update dependency react-error-boundary to v3.1.1 (71b86fafb)
* Update dependency chai to v4.3.3 (e8ac053e9)
* Update dependency matrix-js-sdk to v9.8.0 (87fad9cd5)
* Update dependency marked to v2.0.1 (59bb9f3c6)
* Update Node.js to v14.16.0 (2617e646a)
* Update dependency eslint to v7.21.0 (143a2abb8)
* Update dependency octokit/rest to v18.3.2 (75e899684)
* Update dependency date-fns to v2.18.0 (b3ac91860)
* Update dependency nock to v13.0.10 (3d1f5667a)
* Update dependency nock to v13.0.9 (5ae899c61)
* Update dependency chai to v4.3.1 (a0b21ef23)
* Update babel monorepo (11b91534e)
* Update dependency octokit/rest to v18.3.0 (aeb0296cd)
* Update dependency taskcluster-client-web to v42 (36d2b1c01)
* Update dependency taskcluster-client to v42 (d2211e9b2)

</details>

42.0.0

USERS

▶ [MAJOR] [4437](https://github.com/taskcluster/taskcluster/issues/4437)
The `hooks.triggerHook` and `hooks.triggerHookWithToken` methods now returns only `{taskId: .., status: { taskId: .. } }`, where previously they returned an entire task-status data structure.  Callers which require those status fields must be modified to request the status directly (`queue.status`) before this upgrade occurs.

Automated Package Updates

<details>
<summary>12 Renovate updates</summary>

* Update babel monorepo to v7.13.8 (3cd03d493)
* Update dependency query-string to v6.14.1 (6c7ed0bcb)
* Update dependency memorystore to v1.6.5 (4284afc0b)
* Update dependency got to v11.8.2 (981c118eb)
* Update dependency jwks-rsa to v1.12.3 (2ffc76841)
* Update dependency inquirer to v8 (ea0ca23e9)
* Update dependency nock to v13.0.8 (11b33a5e5)
* Update dependency nock to v13.0.8 (e4dc8307b)
* Update dependency newrelic to v7.1.2 (8c8c0ca89)
* Update dependency octokit/rest to v18.2.1 (7ec67f16b)
* Update dependency codemirror to v5.59.4 (b15982674)
* Update dependency azure/ms-rest-nodeauth to v3.0.7 (6458929f8)

</details>

41.1.0

WORKER-DEPLOYERS

▶ [minor] [4050](https://github.com/taskcluster/taskcluster/issues/4050)
Docker-worker and generic-worker now use `link` artifacts to connect `live.log` to `live_backing.log`.  This functionality requires Taskcluster services running at least Taskcluster-40.0.0.

USERS

▶ [minor] [4455](https://github.com/taskcluster/taskcluster/issues/4455)
As of this version, the [Javascript client library](https://www.npmjs.com/package/taskcluster-client) now uses [got](https://github.com/sindresorhus/got) instead of superagent to make its HTTP requests.  There is no intentional user-visible impact.

OTHER

▶ Additional changes not described here: [4386](https://github.com/taskcluster/taskcluster/issues/4386), [#4444](https://github.com/taskcluster/taskcluster/issues/4444).

Automated Package Updates

<details>
<summary>20 Renovate updates</summary>

* Update dependency babel/core to v7.13.1 (ce29caebb)
* Update babel monorepo (24d1da5a8)
* Update babel monorepo (f618db2be)
* Update dependency amqplib to ^0.7.0 (f70461923)
* Update dependency cron-parser to v3.2.0 (59a72b449)
* Update dependency lodash to v4.17.21 (b30652b40)
* Update golang.org/x/crypto commit hash to 5ea612d (28097fc3f)
* Update dependency googleapis to v67.1.0 (0c5d822fa)
* Update dependency octokit/rest to v18.2.0 (6f3c21f13)
* Update dependency babel/core to v7.12.17 (57ef685a2)
* Update dependency octokit/auth-app to v3 (937576b35)
* Update babel monorepo to v7.12.17 (b07c8c07f)
* Update dependency sentry/node to v6.2.0 (740c24508)
* Update sentry monorepo to v6.2.0 (12ec38548)
* Update dependency taskcluster-client to v41.0.2 (3ff1a5635)
* Update dependency c8 to v7.6.0 (19ddaf425)
* Update module sirupsen/logrus to v1.8.0 (dfe199479)
* Update dependency taskcluster-client-web to v41.0.2 (ba08701d5)
* Update dependency taskcluster-client to v41 (deba99393)
* Update dependency mime to v2.5.2 (8617ada01)

</details>

41.0.2

USERS

▶ [patch] [4417](https://github.com/taskcluster/taskcluster/issues/4417)
In a followup to a bug partially fixed in v41.0.1, the `hooks.triggerHook` function no longer crashes due to the `projectId` property from `queue.createTask`.

OTHER

▶ Additional change not described here: [4405](https://github.com/taskcluster/taskcluster/issues/4405).

Automated Package Updates

<details>
<summary>1 Renovate updates</summary>

* Update dependency taskcluster-client-web to v41.0.1 (efd467ae9)

</details>

41.0.1

USERS

▶ [patch] [4417](https://github.com/taskcluster/taskcluster/issues/4417)
The `hooks.triggerHook` method no longer fails with a 500 error, and now correctly includes the `taskQueueId` property.

▶ [patch] [4411](https://github.com/taskcluster/taskcluster/issues/4411)
The `queue.createArtifact` method now allows specifying a contentType for "link" artifacts, which is necessary to indicate to the UI that a link can be viewed as a logfile.

▶ [patch] [4304](https://github.com/taskcluster/taskcluster/issues/4304)
The queue now better tracks workers.  In particular, it will not "lose track of" a worker which resumes claiming work a short time after it expires, and workers will not immediately expire after being un-quarantined.

OTHER

▶ Additional changes not described here: [4273](https://github.com/taskcluster/taskcluster/issues/4273), [#4274](https://github.com/taskcluster/taskcluster/issues/4274), [#4340](https://github.com/taskcluster/taskcluster/issues/4340), [#4346](https://github.com/taskcluster/taskcluster/issues/4346), [#4380](https://github.com/taskcluster/taskcluster/issues/4380), [#4388](https://github.com/taskcluster/taskcluster/issues/4388).

Automated Package Updates

<details>
<summary>21 Renovate updates</summary>

* Update dependency mocha to v8.3.0 (205958586)
* Update dependency eslint to v7.20.0 (7654b7449)
* Update module sirupsen/logrus to v1.7.1 (87369652b)
* Update dependency matrix-js-sdk to v9.7.0 (37289c213)
* Update dependency commander to v7.1.0 (e62b471a5)
* Update dependency aws-sdk to v2.843.0 (1266aaf06)
* Update dependency eslint to v7.20.0 (981d5f82b)
* Update dependency karma to v6.1.1 (02ee7187f)
* Update dependency octokit/rest to v18.1.1 (6be5adbc4)
* Update module golang.org/x/tools to v0.1.0 (a7613ff48)
* Update golang.org/x/sys commit hash to 22da62e (42ff3f3d2)
* Update dependency aws-sdk to v2.842.0 (ec4e97e35)
* Update dependency apollo-server-express to v2.21.0 (f53175ae8)
* Update dependency mocha to v8.3.0 (deecc9b82)
* Update dependency azure/ms-rest-js to v2.2.3 (3826a4ccd)
* Update babel monorepo (807282eb6)
* Update dependency nodemailer to v6.4.18 (89cf9dff9)
* Update module spf13/cobra to v1.1.3 (1a944988b)
* Update module elastic/go-sysinfo to v1.6.0 (a3dc77d83)
* Update dependency taskcluster-client-web to v41 (95d780f0c)
* Update Node.js to v14.15.5 (24ca296cb)

</details>

41.0.0

GENERAL

▶ [patch] [4272](https://github.com/taskcluster/taskcluster/issues/4272)
The experimental `object.uploadObject` endpoint has been removed and replaced with `object.createUpload`.  The object service remains entirely experimental and further breaking changes will be made without major version bumps.

DEPLOYERS

▶ [patch] [4276](https://github.com/taskcluster/taskcluster/issues/4276)
The worker-manager service will now start up even if one of its providers is down or misconfigured.  Worker pools using that provider will not be provisioned, but other pools will continue to operate normally.

WORKER-DEPLOYERS

▶ [patch] [4336](https://github.com/taskcluster/taskcluster/issues/4336)
Worker-Runner now correctly includes the `workerGroup` and `workerId` properties in error reports.

ADMINS

▶ [MAJOR] [4262](https://github.com/taskcluster/taskcluster/issues/4262)
Tasks now have a `projectId` property that can be used to distinguish tasks for different purposes run in the same Taskcluster deployment.  The `queue.createTask` method now requires scope `queue:create-task:project:<projectId>`, permitting administrative control over which clients can create tasks for which projects.

The default `projectId` is `none`.  To avoid permissions errors on upgrade, _we recommend that `queue:create-task:project:none` be added to the `anonymous` role_ before upgrading to this version.  Once the upgrade is complete, callers may be modified to create tasks with non-default `projectId` and given appropriate scopes.

▶ [minor] [4270](https://github.com/taskcluster/taskcluster/issues/4270)
Task manipulation (rerun, cancel, schedule) is now controlled by scopes related to the task's `projectId`, completing implementation of [RFC163](https://github.com/taskcluster/taskcluster-rfcs/blob/main/rfcs/0163-project-id.md).  With this change, and with the inclusion of `projectId` in task definitions, administrators can control task manipulation by granting `queue:<verb>-task-in-project:<projectId>` scopes to the appropriate entities.

▶ [patch]
Upgrade to Sentry v6, but disable the new
[session tracking feature](https://docs.sentry.io/product/releases/health/)
with ``autoSessionTracking: false``, to avoid collecting more data than is
needed.

USERS

▶ [MAJOR] [3581](https://github.com/taskcluster/taskcluster/issues/3581)
Client methods that took two separate provisionerId and taskQueueId parameters take now a
single parameter (workerPoolId or taskQueueId depending on the service involved).
Affected methods are `queue.claimWork`, `queue.pendingTasks`, `purgeCache.purgeCache` and `purgeCache.purgeRequests`.
The API maintains compatibility at the URL level.

▶ [MAJOR] [4058](https://github.com/taskcluster/taskcluster/issues/4058)
The `queue.getArtifact` and `queue.getLatestArtifact` methods now also return a JSON body containing the URL from which the artifact can be downlodaed, in addition to the existing behavior, returning a 303 redirect.

This is a major change only because it changes the function signatures in the Go client.

▶ [minor] [3580](https://github.com/taskcluster/taskcluster/issues/3580)
The queue service API responses will now include the taskQueueId, which will match provisionerId/workerType,
which are also returned. Also, it is now possible to create tasks supplying a taskQueueId instead of the
separate provisionerId and workerType identifiers.

▶ [minor] [4247](https://github.com/taskcluster/taskcluster/issues/4247)
Updating an artifact from a `reference` type to `link` type now correctly updates the artifact type.

▶ [patch] [4248](https://github.com/taskcluster/taskcluster/issues/4248)
Fixed an issue where listing tasks with link artifacts would cause errors.

▶ [patch] [4269](https://github.com/taskcluster/taskcluster/issues/4269)
The task properties `projectId` and `taskQueueId` are now displayed in the Taskcluster UI, and referenced appropriately in the documentation.

▶ [patch] [bug 1562993](http://bugzil.la/1562993)
generic-worker now only reports the first error it encounters when a task fails or hits an exception.

DEVELOPERS

▶ [minor] [4058](https://github.com/taskcluster/taskcluster/issues/4058)
Client libraries no longer treat redirects as errors.  The methods that return redirects are those which involve fetching artifacts, and typically these have required generating signed URLs.  With this change, these methods can be called directly and will return a JSON payload containing a `url` property from which the artifact can be downloaded.  The fetch API does not support reading bodies from redirects, so this functionality is not available in `taskcluster-client-web`, which treats redirects as errors.

▶ [minor] [2393](https://github.com/taskcluster/taskcluster/issues/2393)
On the page where all roles are listed, added Delete icon beside each role. This helps to delete role faster without going to the Role page.

▶ [minor]
Taskcluster now sports a [Rust client](https://crates.io/crates/taskcluster)!

▶ [patch] [3789](https://github.com/taskcluster/taskcluster/issues/3789)
Fixed an issue where when there's no more data, the continuationToken property was not being omitted, but being returned as just an empty string. Depending on implementation, that could cause a calle

@pyup-bot pyup-bot mentioned this pull request Jun 29, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@pyup-bot