support Dockerized s3 tests #337

donsizemore · 2023-12-06T16:19:13Z

@pdurbin ignore my myriad commits; they'll be squashed on merge.

Closes #327

…ores

… S3-based datastores

pdurbin

Looks good! Ship it! Thanks, @donsizemore !!! 🚀 ❤️ 🎉

(I did leave one comment for future consideration.)

Thanks!

templates/minio_compose.j2

Don Sizemore added 30 commits October 18, 2023 13:26

#327 initial jenkins.yml changes for phil's review

4f8d5c9

#327 only one storage_driver_id, remains file

57cf564

#327 remove config deletion from dataverse-storage.yml

04c8a47

Merge remote-tracking branch 'origin/develop' into 327_multiple_s3_st…

b2eeb54

…ores

Merge remote-tracking branch 'origin/develop' into 327_multiple_s3_st…

83632c0

…ores

#327 stub out docker/localstack

3e5dda7

Merge remote-tracking branch 'origin/develop' into 327_multiple_s3_st…

547771f

…ores

#327 tweak lookup loop

6bfe02d

#327 add localstack_create.yml

e9c6adb

#327 add localstack_create_bucket.yml

7137898

#327 add CORS config

7f783ca

#327 add cors.json for S3 testing

8646de4

#327 remove errant localstack variable name prefix

531cfc6

#327 correct docker repo installation

d9fca9c

#327 remove second errant localstack variable name prefix

2314dd0

#327 ansible_user is now ansible_ssh_user

6b53d93

#327 infer docker user

c4b2918

#327 do we even need raw/endraw

a520250

#327 add necessary localstack group_vars

48d99f9

#327 add missing single ticks

985a22b

#327 container should be container_name

33789ca

#327 switch to docker compose v2

09c8d33

#327 disable most of S3 configuration in favor of supporting multiple…

e56b879

… S3-based datastores

#327 uncomment S3 in favor of s3.enabled false in group_vars

857316f

#327 let's pass AWS keys to localstack

7ebc99c

#327 too many items spoil the broth

6579842

#327 include_tasks with loop

5f80f14

#327 loop with block

0c595be

#327 attempt include_tasks with_items

5ddd7e6

#327 now it IS sending item properly

456dd2e

Don Sizemore added 25 commits November 29, 2023 12:00

#327 variables must exist, length 0

5d9dff3

#327 keep variables, comment out in case

62c4a22

#327 adjust commented spacing

f04faaf

#327 adjust template indentation

db5f630

#327 if blocks causing trouble

5e74320

#327 set MinIO jvm-options

34cd897

#327 quote MinIO CEU value

a497741

#327 escape custom-endpoint-url colons

0fa758a

#327 underscores only

18aa4b2

#327 update minio variables

e00dae3

#327 localstack1, mybucket

e9a271a

#327 localstack label, caps count

01dc08f

#327 LocalStack: match Phil's options exactly

fd34213

#327 touch up variables post-Zoom

e00d8d5

#327 run tests and reports as Dataverse service account

801c6ee

#327 disable global s3 creds/config as a test

463763a

#327 correct localstack variables

76a21e6

#327 correct identifier group_var syntax

4a3731f

#327 use ibiblio mirror for now, minio wants to match AWS credentials

7c1844e

#327 correct minio secret-access-key

d2ec1d8

#327 add localstack/minio group_vars to defaults/vagrant yml

48594cf

#327 duplicate Docker CIDR to default/vagrant

5b458dc

#327 hopefully final touch-ups

d66f79f

#327 keep aws_config.yml for now

2efaafa

#327 correct minio secret_key

37bae1f

donsizemore requested a review from pdurbin December 6, 2023 16:19

donsizemore self-assigned this Dec 6, 2023

pdurbin approved these changes Dec 6, 2023

View reviewed changes

templates/minio_compose.j2 Show resolved Hide resolved

pdurbin mentioned this pull request Dec 6, 2023

add S3 tests, LocalStack, MinIO IQSS/dataverse#10044

Merged

donsizemore merged commit ac67a88 into develop Dec 7, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

support Dockerized s3 tests #337

support Dockerized s3 tests #337

donsizemore commented Dec 6, 2023

pdurbin left a comment

support Dockerized s3 tests #337

support Dockerized s3 tests #337

Conversation

donsizemore commented Dec 6, 2023

pdurbin left a comment

Choose a reason for hiding this comment