codeintel: first implementation of auto-indexing secrets

[Strum355]

Adds executor secrets support to auto-indexing, allowing for new capabilities including, and most notably, authentication with private registries. This is an early-phase (but functional) PR with first-step support for private Go modules.

Test plan

Ran a local E2E test-run (not an actual E2E automated test), back-compat tests keeping the DB stuff relatively sane, but also stressed importance of reviewing that as well as running it through a few scenarios

main dry-run https://buildkite.com/sourcegraph/sourcegraph/builds/189673

[sg-e2e-regression-test-bob]

Bundle size report 📦

Initial size	Total size	Async size	Modules
0.00% (+0.05 kb)	0.00% (+0.16 kb)	0.00% (+0.12 kb)	0.00% (0)

Look at the Statoscope report for a full comparison between the commits 52df392 and 3cb4a50 or learn more.

Open explanation

• Initial size is the size of the initial bundle (the one that is loaded when you open the page)
• Total size is the size of the initial bundle + all the async loaded chunks
• Async size is the size of all the async loaded chunks
• Modules is the number of modules in the initial bundle

[eseliger]

nice, good stuff!

[Strum355]

@evict Im not sure how desirable this would be. Any opinions?

[evict]

Hm, I think we should keep existing access logs even though user_id is not set.

[Strum355]

@bobheadxi is there an approach we should take in the down migration here? Im not sure how we can preserve it without losing the machine_user info

[eseliger]

let's move it to a backup table for worst-case scenarios.

[Strum355]

yep thats the approach im going to go with, will have an impl for review today

[Strum355]

Implemented here, second+ pair of eyes appreciated https://github.com/sourcegraph/sourcegraph/pull/45580/commits/46b40fd3383fc522c77fe15cf4e54d3dae063ca6

[sourcegraph-bot]

Codenotify: Notifying subscribers in CODENOTIFY files for diff 3774fbd...52df392.

Notify	File(s)
@efritz	client/web/src/enterprise/executors/secrets/ExecutorSecretsListPage.tsx client/web/src/enterprise/executors/secrets/SecretAccessLogsModal.tsx enterprise/cmd/frontend/internal/executorqueue/queues/codeintel/queue.go enterprise/cmd/frontend/internal/executorqueue/queues/codeintel/transform.go enterprise/cmd/frontend/internal/executorqueue/queues/codeintel/transform_test.go enterprise/internal/codeintel/autoindexing/internal/background/utils.go enterprise/internal/codeintel/autoindexing/internal/inference/lang_go_test.go enterprise/internal/codeintel/autoindexing/internal/inference/lang_typescript_test.go enterprise/internal/codeintel/autoindexing/internal/inference/lua/go.lua enterprise/internal/codeintel/autoindexing/internal/inference/lua/typescript.lua enterprise/internal/codeintel/autoindexing/internal/inference/luatypes/index_job.go enterprise/internal/codeintel/autoindexing/internal/jobselector/job_selector.go enterprise/internal/codeintel/autoindexing/internal/store/scan.go enterprise/internal/codeintel/autoindexing/internal/store/store_indexes.go enterprise/internal/codeintel/shared/types/index.go lib/codeintel/autoindex/config/types.go
@eseliger	client/web/src/enterprise/executors/secrets/ExecutorSecretsListPage.tsx client/web/src/enterprise/executors/secrets/SecretAccessLogsModal.tsx enterprise/cmd/frontend/internal/executorqueue/queues/codeintel/queue.go enterprise/cmd/frontend/internal/executorqueue/queues/codeintel/transform.go enterprise/cmd/frontend/internal/executorqueue/queues/codeintel/transform_test.go
@sourcegraph/code-insights-backend	enterprise/internal/insights/store/store.go

[eseliger]

nice SQL trickery!