Code

colossus s3 api#5150

Code

Open

ignazio-bovo wants to merge 61 commits intoJoystream:masterJoystream/joystream:masterfrom ignazio-bovo:feat/colossus-s3-apiignazio-bovo/joystream:feat/colossus-s3-apiCopy head branch name to clipboard

+468,777-5,991

Commits

Commits on Apr 19, 2024

• feat: 🎨 env var in order to run content-directory scenario

  

  Ignazio Bovo

  committed
  bb9a565

  Copy full SHA for bb9a565

• feat: 🎨 create s3 api model

  

  Ignazio Bovo

  committed
  4fe88e9

  Copy full SHA for 4fe88e9

• Merge branch 'master' into feat/colossus-s3-api

  

  Ignazio Bovo

  committed
  f9544cf

  Copy full SHA for f9544cf

Commits on Apr 22, 2024

• feat: 🎨 refactor filemodel

  

  Ignazio Bovo

  committed
  ccbf56b

  Copy full SHA for ccbf56b

Commits on Apr 23, 2024

• feat: 🎨 add connection handler abstract in order to conect to block storage providers-

  

  Ignazio Bovo

  committed
  5d19954

  Copy full SHA for 5d19954

• refactor: ♻️ connection handlers

  

  Ignazio Bovo

  committed
  a1aaed0

  Copy full SHA for a1aaed0

Commits on Apr 24, 2024

• feat: 🎨 file cache improvements

  

  Ignazio Bovo

  committed
  73a47b0

  Copy full SHA for 73a47b0

Commits on May 7, 2024

• refactor: 🎨 refactor to accomodate synch task

  

  Ignazio Bovo

  committed
  336893e

  Copy full SHA for 336893e

• feat: 🎨 list files functionality

  

  Ignazio Bovo

  committed
  4354320

  Copy full SHA for 4354320

Commits on May 12, 2024

• feat: 🎨 improvements on connection handlers

  

  Ignazio Bovo

  committed
  a37dcd4

  Copy full SHA for a37dcd4

• feat: 🎨 refactor sync task and add task for remote storage provider upload

  

  Ignazio Bovo

  committed
  940b06f

  Copy full SHA for 940b06f

• feat: 🎨 renaming the storage provider module and sync/task module improvements

  Show description for e697309
  

  Ignazio Bovo

  committed
  e697309

  Copy full SHA for e697309

• feat: ⚡ server setup with remote storage provider connection

  

  Ignazio Bovo

  committed
  61e3ac1

  Copy full SHA for 61e3ac1

• feat: 🎨 add file verification error class

  

  Ignazio Bovo

  committed
  1363c66

  Copy full SHA for 1363c66

Commits on May 13, 2024

• fix: 🔥 add onLocal volume / onCloud Storage flag to data Object cache and add logic to getFile

  Show description for 0df58f1
  

  Ignazio Bovo

  committed
  0df58f1

  Copy full SHA for 0df58f1

• feat: 🎨 improve accepted asset logic to accomodate cloud bucket upload

  Show description for 19cee7c
  

  Ignazio Bovo

  committed
  19cee7c

  Copy full SHA for 19cee7c

• fix: 🎨 upload file flow

  

  Ignazio Bovo

  committed
  3b72202

  Copy full SHA for 3b72202

Commits on May 14, 2024

• feat: 🎨 getFile pipe stream

  

  Ignazio Bovo

  committed
  99b8ea6

  Copy full SHA for 99b8ea6

• feat: ⚡ adapt abstractConnectionHandler

  

  Ignazio Bovo

  committed
  bcd5b12

  Copy full SHA for bcd5b12

• feat: 🎨 improve S3 connection handler

  

  Ignazio Bovo

  committed
  2395a25

  Copy full SHA for 2395a25

• fix: 🐛 list object list ALL objects in the bucket

  

  Ignazio Bovo

  committed
  c05b69a

  Copy full SHA for c05b69a

• style: 🚚 rename files

  

  Ignazio Bovo

  committed
  1bc8dfc

  Copy full SHA for 1bc8dfc

Commits on May 15, 2024

• feat: ⚡ setup cloud provider config options

  

  Ignazio Bovo

  committed
  47f47e5

  Copy full SHA for 47f47e5

Commits on May 16, 2024

• fix: 🐛 compiler errorrs

  

  Ignazio Bovo

  committed
  c80488d

  Copy full SHA for c80488d

• feat: 🎨 utilise redirect url for getFile request

  

  Ignazio Bovo

  committed
  c269c10

  Copy full SHA for c269c10

• feat: 🎨 handle multipart uploads

  

  Ignazio Bovo

  committed
  b45260b

  Copy full SHA for b45260b

• docs: 📝 update documentation

  

  Ignazio Bovo

  committed
  270ed8f

  Copy full SHA for 270ed8f

Commits on May 20, 2024

• feat: 🎨 add functionality for removing object from bucket

  

  Ignazio Bovo

  committed
  e87c578

  Copy full SHA for e87c578

Commits on May 21, 2024

• test: 🎨 setup jest integration tests

  

  Ignazio Bovo

  committed
  ac4e9e0

  Copy full SHA for ac4e9e0

Commits on May 22, 2024

• test: ✅ finally have a working jest test setup

  

  Ignazio Bovo

  committed
  3d6d0ea

  Copy full SHA for 3d6d0ea

• test: ✅ add unhappy path for move To accepted location

  

  Ignazio Bovo

  committed
  978b21f

  Copy full SHA for 978b21f

Commits on May 23, 2024

• test: ✅ add test for sync service

  

  Ignazio Bovo

  committed
  f76ebfd

  Copy full SHA for f76ebfd

• feat: 🎨 rewrite file acceptance logic for accept object and sync tasks

  

  Ignazio Bovo

  committed
  f74cb7d

  Copy full SHA for f74cb7d

• test: ✅ full green test suite for acceptObject

  

  Ignazio Bovo

  committed
  ae0c8b3

  Copy full SHA for ae0c8b3

• test: ✅ add for cache setup

  

  Ignazio Bovo

  committed
  b5e45f5

  Copy full SHA for b5e45f5

Commits on May 29, 2024

• test: ✅ add for cache setup

  

  Ignazio Bovo

  committed
  480dbd4

  Copy full SHA for 480dbd4

• test: ✅ add test setup with localstack

  

  Ignazio Bovo

  committed
  b33c9ad

  Copy full SHA for b33c9ad

• fix: ⚡ fix startup flag for storage provider

  

  Ignazio Bovo

  committed
  e75df99

  Copy full SHA for e75df99

• test: 🔥 testing

  

  Ignazio Bovo

  committed
  fc57895

  Copy full SHA for fc57895

Commits on Jun 17, 2024

• Merge branch 'petra' into feat/colossus-s3-api

  

  Ignazio Bovo

  committed
  8ae8d77

  Copy full SHA for 8ae8d77

• test: ✅ setup localstack

  

  Ignazio Bovo

  committed
  ae510bc

  Copy full SHA for ae510bc

Commits on Jun 19, 2024

• fix: ✅ integration test setup

  

  Ignazio Bovo

  committed
  81ea8fb

  Copy full SHA for 81ea8fb

• fix: 🍱 env variable setup

  

  Ignazio Bovo

  committed
  4954a82

  Copy full SHA for 4954a82

• fix: ✅ localstack integration test setup

  

  Ignazio Bovo

  committed
  eaf1d10

  Copy full SHA for eaf1d10

• fix: 📝 docker compose config

  

  Ignazio Bovo

  committed
  613ab3a

  Copy full SHA for 613ab3a

• refactor: ♻️ refactor docker compose files

  

  Ignazio Bovo

  committed
  9dfa471

  Copy full SHA for 9dfa471

Commits on Aug 23, 2024

• Merge branch 'master' into feat/colossus-s3-api

  

  Ignazio Bovo

  committed
  196c48c

  Copy full SHA for 196c48c

Commits on Aug 24, 2024

• fix integration tests

  mnaamani

  committed
  a73f483

  Copy full SHA for a73f483

• docker compose instead of docker-compose

  mnaamani

  committed
  967a893

  Copy full SHA for 967a893

• fix used pip before activating venv

  mnaamani

  committed
  5e88241

  Copy full SHA for 5e88241

• revert docker image names used in local testing

  mnaamani

  committed
  ae4e1a6

  Copy full SHA for ae4e1a6

Commits on Aug 27, 2024

• Update .env

  Show description for 334e2ad
  

  mrBovo

  and

  mnaamani

  authored
  334e2ad

  Copy full SHA for 334e2ad

• Update storage-node/src/services/webApi/controllers/filesApi.ts

  Show description for 9892e01
  

  mrBovo

  and

  mnaamani

  authored
  9892e01

  Copy full SHA for 9892e01

• Update tests/network-tests/run-tests.sh

  Show description for 763f77f
  

  mrBovo

  and

  mnaamani

  authored
  763f77f

  Copy full SHA for 763f77f

• Update docker-compose.localstack.yml

  Show description for 889a5f9
  

  mrBovo

  and

  mnaamani

  authored
  889a5f9

  Copy full SHA for 889a5f9

• Update storage-node/src/services/helpers/acceptObject.ts

  Show description for 5038ae4
  

  mrBovo

  and

  mnaamani

  authored
  5038ae4

  Copy full SHA for 5038ae4

Commits on Aug 28, 2024

• Merge branch 'feat/colossus-s3-api' into colossus-s3-api-integration-tests-fix

  

  mrBovo

  authored
  5c7bc1a

  Copy full SHA for 5c7bc1a

• Merge pull request #17 from mnaamani/colossus-s3-api-integration-tests-fix

  Show description for 6e1f6e0
  

  mrBovo

  authored
  6e1f6e0

  Copy full SHA for 6e1f6e0

• fix: ⚡ add test and configuration for existing file uploads

  

  Ignazio Bovo

  committed
  ebd0f03

  Copy full SHA for ebd0f03

• feat: 🎨 adding uploadfile if not exisitng test

  

  Ignazio Bovo

  committed
  5959615

  Copy full SHA for 5959615

• fix: 🎨 overall fixes for awsConnectionHandler test and upload with existence check

  

  Ignazio Bovo

  committed
  e3bece8

  Copy full SHA for e3bece8