Skip to content

Commit

Permalink
#20 and some vulnerabilities resolved (#47)
Browse files Browse the repository at this point in the history
* Added a running check possibility and changed documentation

* Changed initial README

* Small change in Readme on top

* Changed Pytorch Docker Image

* Feature/2023.07 os test refactor test cases (#21)

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Delete entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Delete data_extractor/data/TEST directory

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Delete data_extractor/data/TEST/interim/rb/work directory

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Delete DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Create requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Delete requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Delete entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Create requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Add a default folder for the models

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Added s3-communication.py file as a wrapper to communicate with s3 buckets

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update DOCKER_TEST file for s3 communication

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update requirements.txt in TEST_SETUP

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Adding user-friendly shell /bin/bash

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Adding VS Code folders for remote access

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update train_on_pdf.py

First step to s3 connection of main_terminal

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Create s3_settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update s3_settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update s3_settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update kpi_mapping.py

root folder has access right issues and hence we have to change to another folder

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update extraction_server.py

Updated curation step for S3

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update Dockerfile

had to change mode of code folder to ensure accessibility

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update extraction_server.py

Added create directory to empty "folders"

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Init pytest and creating test cases for upcoming refactoring

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Ongoing creation of test cases

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Ongoing creation of test cases

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Ongoing creation and modification of test cases

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Ongoing creation of test cases

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Reset branch to restore old status

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Ongoing test cases for save_train_info

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Adding test cases for save_train_info

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Finished added test cases for save_train_info

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Adding test cases for run_router function

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Backup

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Finalizing test cases for train_on_pdf

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Finishing tests for run_router function

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Adding first test cases for train_on_pdf script

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Ongoing test creation for train_on_pdf function

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Ongoing creation of tests

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Ongoing test creation

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Ongoing creation of test cases

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Ongoing test creation

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Finishing test cases for train_on_pdf script

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Adding missing file in test folder

Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Create .gitignore and protect credentials from being leaked

Signed-off-by: Heather Ackenhusen <90428947+HeatherAck@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update README.md with status

Signed-off-by: Heather Ackenhusen <90428947+HeatherAck@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update train_on_pdf.py

Turn back wrong commit

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Update inference_server.py

Undo previous push (wrong branch)

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Feature/2023.04 os test (#12)

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Delete entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Delete data_extractor/data/TEST directory

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Delete data_extractor/data/TEST/interim/rb/work directory

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Delete DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Create requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Delete requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Delete entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Create requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add a default folder for the models

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Added s3-communication.py file as a wrapper to communicate with s3 buckets

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST file for s3 communication

* Update requirements.txt in TEST_SETUP

* Adding user-friendly shell /bin/bash

* Adding VS Code folders for remote access

* Update train_on_pdf.py

First step to s3 connection of main_terminal

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Create s3_settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update s3_settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update s3_settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update kpi_mapping.py

root folder has access right issues and hence we have to change to another folder

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Updated curation step for S3

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

had to change mode of code folder to ensure accessibility

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Added create directory to empty "folders"

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Add s3 communication to model docker

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Add folder data and models to the models docker

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update config_farm_train.py

Adjust file path to be more generic for training folder

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

First step to integrate S3 to train_relevance

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update kpi_mapping.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update kpi_mapping.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

---------

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Co-authored-by: ktj8l89 <tobias.watzel@investmentdataservices.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Feature/2023.04 os test (#14)

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Delete entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Delete data_extractor/data/TEST directory

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Delete data_extractor/data/TEST/interim/rb/work directory

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Delete DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Create requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Delete requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Delete entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Create requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add a default folder for the models

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Added s3-communication.py file as a wrapper to communicate with s3 buckets

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST file for s3 communication

* Update requirements.txt in TEST_SETUP

* Adding user-friendly shell /bin/bash

* Adding VS Code folders for remote access

* Update train_on_pdf.py

First step to s3 connection of main_terminal

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Create s3_settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update s3_settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update s3_settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update kpi_mapping.py

root folder has access right issues and hence we have to change to another folder

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Updated curation step for S3

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

had to change mode of code folder to ensure accessibility

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Added create directory to empty "folders"

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Add s3 communication to model docker

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Add folder data and models to the models docker

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update config_farm_train.py

Adjust file path to be more generic for training folder

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

First step to integrate S3 to train_relevance

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update kpi_mapping.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update kpi_mapping.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update extraction_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update settings.yaml

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update inference_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update train_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update DOCKER_TEST

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update rb_server.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Update infer_on_pdf.py

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>

* Feature/2023.07 os test refactor test cases (#13)

* Init pytest and creating test cases for upcoming refactoring

* Ongoing creation of test cases

* Ongoing creation of test cases

* Ongoing creation and modification of test cases

* Ongoing creation of test cases

---------

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Co-authored-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

---------

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Co-authored-by: ktj8l89 <tobias.watzel@investmentdataservices.com>
Signed-off-by: ktj8l89 <tobias.watzel@investmentdataservices.com>

* Feature/2023.04 os test (#16)

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update requirements.txt

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update entry.sh

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Add files via upload

Signed-off-by: DaBeIDS <90916810+DaBeIDS@users.noreply.github.com>
Signed-off-by: VEIY82L <david.besslich@investmentdataservices.com>

* Update Dockerfile

Signed-off-by: DaBeIDS <9…
  • Loading branch information
7 people authored Oct 24, 2023
1 parent 254ed62 commit 9036767
Show file tree
Hide file tree
Showing 4 changed files with 23 additions and 33 deletions.
2 changes: 1 addition & 1 deletion data_extractor/code/infer_on_pdf.py
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
import argparse
import requests
import os
import config_path
import utils.config_path as config_path
import json
import yaml
import csv
Expand Down

This file was deleted.

13 changes: 5 additions & 8 deletions data_extractor/code/model_pipeline/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
ARG PYTORCH="1.6.0"
ARG CUDA="10.1"
ARG CUDNN="7"
ARG PYTORCH="1.11.0"
ARG CUDA="11.3"
ARG CUDNN="8"

FROM pytorch/pytorch:${PYTORCH}-cuda${CUDA}-cudnn${CUDNN}-devel
ENV TORCH_CUDA_ARCH_LIST="3.7 6.0 6.1 7.0+PTX"
Expand All @@ -9,10 +9,10 @@ RUN mkdir -p /.cache
RUN chmod -R 777 /.cache

RUN apt-key del 3bf863cc
RUN apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/3bf863cc.pub
RUN apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/3bf863cc.pub

RUN apt-key del 7fa2af80
RUN apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu1804/x86_64/7fa2af80.pub
RUN apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/machine-learning/repos/ubuntu2004/x86_64/7fa2af80.pub

RUN apt-get update
RUN apt-get install -y unzip vim git wget
Expand All @@ -26,9 +26,6 @@ RUN chmod -R 777 /app/code

ENV SKLEARN_ALLOW_DEPRECATED_SKLEARN_PACKAGE_INSTALL=True

WORKDIR /app/code/kpi_inference_data_pipeline
RUN pip install -e .

WORKDIR /app/code/model_pipeline
RUN pip install -e .

Expand Down
35 changes: 17 additions & 18 deletions data_extractor/code/model_pipeline/requirements.txt
Original file line number Diff line number Diff line change
@@ -1,19 +1,18 @@
traitlets==5.4
requests==2.26.0
jinja2==3.0
ipython==7.23.1
urllib3==1.26.7
gdown==3.11.1
tqdm==4.48.0
xlrd==1.2.0
traitlets
requests
gdown
tqdm
xlrd
pandas==1.0.5
farm==0.5.0
optuna==2.0.0
Werkzeug==2.2.2
Flask==2.2.5
pyspellchecker==0.5.5
spacy==2.3.2
MarkupSafe==2.0.1
boto3==1.18.15
scikit-learn==0.24.1
protobuf==3.20.0
farm
optuna
Werkzeug==0.16.1
Flask==1.1.4
pyspellchecker
spacy
MarkupSafe
boto3
scikit-learn
protobuf
fuzzywuzzy
python-Levenshtein

0 comments on commit 9036767

Please sign in to comment.