Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

21464 - Merge EFT into main branch #1552

Merged
merged 94 commits into from
May 31, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
94 commits
Select commit Hold shift + click to select a range
1713c16
19910 - Python 3.12.2 upgrade (#1435)
seeker25 Mar 5, 2024
43f1cc0
up google-auth version
seeker25 Mar 5, 2024
eba1dc2
Update prod.txt
seeker25 Mar 6, 2024
e853e7d
Update requirements.txt
seeker25 Mar 6, 2024
b33d8e3
Update prod.txt
seeker25 Mar 6, 2024
4a3dbc9
fix migration bug (#1440)
Jxio Mar 6, 2024
46b03dd
Changes to upgrade to Python 3.12
seeker25 Mar 6, 2024
2f82107
lint fix
seeker25 Mar 6, 2024
ca8f334
Small unit test fixes
seeker25 Mar 6, 2024
a661135
Fix pay-admin
seeker25 Mar 7, 2024
c339b3b
Update ftp-poller's requirements
seeker25 Mar 7, 2024
3ca21a4
19939 - EFT - Invoice Reference (#1436)
rodrigo-barraza Mar 7, 2024
e0bc697
19939 - EFT Reconciliation - Invoice Reference (#1437)
rodrigo-barraza Mar 7, 2024
6390faa
19724 - EFT - Create CFS account job modification (#1441)
Jxio Mar 8, 2024
0667321
18263 - New queues use PUB/SUB (#1438)
seeker25 Mar 13, 2024
3552acd
19724_2 - EFT - Create CFS account job (#1442)
Jxio Mar 13, 2024
c16e890
Pay API CD upgrade.
pwei1018 Mar 13, 2024
09dd93b
Rollback the auto formatting.
pwei1018 Mar 14, 2024
fb1ea12
Fixed flake8.
pwei1018 Mar 14, 2024
764d304
Merge pull request #1444 from pwei1018/feature-queue-python-upgrade
pwei1018 Mar 14, 2024
4ac1650
20299 - Poetry upgrade (#1443)
seeker25 Mar 14, 2024
4b98de5
Add pay api gcp CD flow. (#1446) (#1447)
seeker25 Mar 14, 2024
17c5c37
First run at pubsub emulation for integration tests + pg8000 upgrade …
seeker25 Mar 15, 2024
99ed7e0
Upgrade CD flows for Payment projects. (#1449)
pwei1018 Mar 17, 2024
edaa857
Fixed empty value issue.
pwei1018 Mar 18, 2024
eb37712
Fixed deployment config issue.
pwei1018 Mar 18, 2024
0c85bca
Fixed deployment environment variables issue.
pwei1018 Mar 18, 2024
dfae89d
Fixed the configuration.
pwei1018 Mar 18, 2024
1f0a84b
Fixed CD issues. (#1452)
pwei1018 Mar 18, 2024
7d6fbe2
Fixed missing service account.
pwei1018 Mar 18, 2024
d8c1279
Fixed deployment config issue.
pwei1018 Mar 18, 2024
051575c
Fixed deployment environment variables issue.
pwei1018 Mar 18, 2024
9a871a8
Fixed missing service account.
pwei1018 Mar 18, 2024
4b0a745
Merge branch 'feature-queue-python-upgrade' of https://github.com/pwe…
pwei1018 Mar 18, 2024
eec4c35
Merge pull request #1453 from pwei1018/feature-queue-python-upgrade
pwei1018 Mar 18, 2024
ff34e90
19875 - PAY Jobs - Disbursement Process handle Partial Refunds (#1428)
Jxio Mar 18, 2024
0f86928
Fixed typo.
pwei1018 Mar 18, 2024
4505356
Merge pull request #1454 from pwei1018/feature-queue-python-upgrade
pwei1018 Mar 18, 2024
6698349
14521 - Get rid of sqlalchemy-continuum (#1450)
seeker25 Mar 19, 2024
93d6c4e
19936 - EFT - PAY-API changes to handle CFS when switching payment me…
Jxio Mar 19, 2024
16e70f7
Add in logging
seeker25 Mar 19, 2024
594743e
move Migrate into __init__.py instead of in wsgi.py
seeker25 Mar 19, 2024
d009aec
move out check for migration mode
seeker25 Mar 19, 2024
1e7b331
Enhance logging
seeker25 Mar 20, 2024
ad17608
Small touch ups to get it to work in docker and hopefully gcp
seeker25 Mar 20, 2024
0dc3993
19721 - Updating EFT service for EFT invoice task (#1455)
rodrigo-barraza Mar 20, 2024
35df8c9
Update logging
seeker25 Mar 20, 2024
2c9fcd8
Merge branch 'feature-queue-python-upgrade' of https://github.com/bcg…
seeker25 Mar 20, 2024
f34b20f
Enum support for invoice tasks (#1457)
rodrigo-barraza Mar 22, 2024
620e89e
19721- Create EFT Invoices task (#1456)
rodrigo-barraza Apr 1, 2024
97bf261
Sync from main (#1460)
seeker25 Apr 4, 2024
e6ef979
add verification logic in some .setters to avoid unnecessary db actio…
Jxio Apr 8, 2024
727d338
19723 - Exposing eft short names service (#1466)
rodrigo-barraza Apr 11, 2024
e020b2d
19723 - Linking EFT Job (#1464)
rodrigo-barraza Apr 15, 2024
5336ec2
20457 - SBC-PAY Common Queue (#1467)
Jxio Apr 15, 2024
ba20cec
19496 refactor eft shortnames to support multiple account linking and…
ochiu Apr 19, 2024
1318806
19496 -EFT TDI17 Processing / Multi Account linking (#1489)
ochiu Apr 19, 2024
0311045
20454 - Pay-queue JWT Verification (#1491)
Jxio Apr 23, 2024
a091d6a
20454 - Fix a jwt condition check issue (#1492)
Jxio Apr 23, 2024
e36c4de
20454 - Add test logs (#1493)
Jxio Apr 24, 2024
b03d586
20414 - EFT Short name summaries search (#1494)
ochiu Apr 25, 2024
83a64f6
19722 - Unlinking EFT Task (#1487)
rodrigo-barraza Apr 30, 2024
a298310
20420 - EFT Short name search (#1496)
ochiu May 1, 2024
89595fb
20421 - Add cfs account status to search eft names (#1525)
Jxio May 9, 2024
594aef1
20417 - EFT Shortname links / transaction search (#1526)
ochiu May 10, 2024
cd3901d
20419 - Short name linking status (#1540)
ochiu May 27, 2024
c5c915e
Merge branch 'main' of https://github.com/bcgov/sbc-pay into feature-…
seeker25 May 31, 2024
522ed49
Fix linting issues. Make units tests pass for pay-api.
seeker25 May 31, 2024
7411bde
Fix lint and test for ftp-poller
seeker25 May 31, 2024
ff882e5
pay-queue lint, ci passing
seeker25 May 31, 2024
1dae0d2
update sbc-common-components, also remove because pay-api already inc…
seeker25 May 31, 2024
3bc8b6a
remove requirements.txt for pay-admin
seeker25 May 31, 2024
3cc0024
poetry update pay-api
seeker25 May 31, 2024
34c905b
Fix lint plus unit tests for payment-jobs
seeker25 May 31, 2024
23fed0f
21464 - Resync EFT branch with main (#1547)
seeker25 May 31, 2024
d235277
Revert "21464 - Resync EFT branch with main (#1547)" (#1550)
seeker25 May 31, 2024
d259bcf
Merge pull request #1551 from seeker25/sync-python-to-main
seeker25 May 31, 2024
32354bb
Merge branch 'main' of https://github.com/bcgov/sbc-pay into feature-…
seeker25 May 31, 2024
dcaf68d
Lint fixes
seeker25 May 31, 2024
2a3214a
Small lint fixes
seeker25 May 31, 2024
4e0b5ce
Remove duplicate literal
seeker25 May 31, 2024
4b8c72a
fix hint
seeker25 May 31, 2024
b466443
remove redundant return
seeker25 May 31, 2024
578d676
Codecov fixes
seeker25 May 31, 2024
05d4f8c
more lint fixes
seeker25 May 31, 2024
6f62e36
Fix CD
seeker25 May 31, 2024
f0885f2
Put back pay-api cd
seeker25 May 31, 2024
12c620c
update poetry, will fix error building
seeker25 May 31, 2024
7f4cede
update psycopg2-binary
seeker25 May 31, 2024
49e1d82
fix CD
seeker25 May 31, 2024
ab42afc
remove requirements.txt
seeker25 May 31, 2024
95acc7f
use latest poetry
seeker25 May 31, 2024
a79ded0
remove more requirements
seeker25 May 31, 2024
29a69f6
Put back gunicorn config, comment for GCP.
seeker25 May 31, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/bcol-api-cd.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ jobs:
name: "dev"

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4

- name: Login Openshift
shell: bash
Expand Down Expand Up @@ -74,7 +74,7 @@ jobs:
name: "${{ github.event.inputs.environment }}"

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set env by input
run: |
echo "TAG_NAME=${{ github.event.inputs.environment }}" >> $GITHUB_ENV
Expand Down
19 changes: 14 additions & 5 deletions .github/workflows/bcol-api-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ on:
pull_request:
branches:
- main
- feature-queue-python-upgrade
paths:
- "bcol-api/**"

Expand All @@ -19,7 +20,7 @@ jobs:
if: github.repository == 'bcgov/sbc-pay'

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- run: "true"

linting:
Expand All @@ -28,10 +29,10 @@ jobs:

strategy:
matrix:
python-version: [3.8]
python-version: [3.12]

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v1
with:
Expand Down Expand Up @@ -79,6 +80,10 @@ jobs:

runs-on: ubuntu-20.04

strategy:
matrix:
python-version: [3.12]

services:
postgres:
image: postgres:12
Expand All @@ -92,7 +97,7 @@ jobs:
options: --health-cmd pg_isready --health-interval 10s --health-timeout 5s --health-retries 5

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v1
with:
Expand All @@ -118,8 +123,12 @@ jobs:
needs: setup-job
runs-on: ubuntu-20.04

strategy:
matrix:
python-version: [3.12]

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: build to check strictness
id: build
run: |
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/ftp-poller-cd.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ jobs:
name: "dev"

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4

- name: Login Openshift
shell: bash
Expand Down Expand Up @@ -74,7 +74,7 @@ jobs:
name: "${{ github.event.inputs.environment }}"

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set env by input
run: |
echo "TAG_NAME=${{ github.event.inputs.environment }}" >> $GITHUB_ENV
Expand Down
23 changes: 16 additions & 7 deletions .github/workflows/ftp-poller-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ on:
pull_request:
branches:
- main
- feature-queue-python-upgrade
paths:
- "jobs/ftp-poller/**"

Expand All @@ -19,7 +20,7 @@ jobs:
if: github.repository == 'bcgov/sbc-pay'

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- run: "true"

linting:
Expand All @@ -28,10 +29,10 @@ jobs:

strategy:
matrix:
python-version: [3.8]
python-version: [3.12]

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v1
with:
Expand All @@ -51,28 +52,32 @@ jobs:
testing:
needs: setup-job
env:
DATABASE_TEST_URL: "postgresql://postgres:postgres@localhost:5432/postgres"
DATABASE_TEST_URL: "postgresql://postgres:postgres@localhost:5432/pay-test"
USE_DOCKER_MOCK: "YES"
JWT_OIDC_ISSUER: "http://localhost:8081/auth/realms/demo"
SBC_AUTH_ADMIN_CLIENT_ID: "sbc-auth-admin"
SBC_AUTH_ADMIN_CLIENT_SECRET: "2222222222"

runs-on: ubuntu-20.04

strategy:
matrix:
python-version: [3.12]

services:
postgres:
image: postgres:12
env:
POSTGRES_USER: postgres
POSTGRES_PASSWORD: postgres
POSTGRES_DB: postgres
POSTGRES_DB: pay-test
ports:
- 5432:5432
# needed because the postgres container does not provide a healthcheck
options: --health-cmd pg_isready --health-interval 10s --health-timeout 5s --health-retries 5

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v1
with:
Expand All @@ -96,8 +101,12 @@ jobs:
needs: setup-job
runs-on: ubuntu-20.04

strategy:
matrix:
python-version: [3.12]

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: build to check strictness
id: build
run: |
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/notebook-report-cd.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ jobs:
name: "dev"

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4

- name: Login Openshift
shell: bash
Expand Down Expand Up @@ -69,7 +69,7 @@ jobs:
name: "${{ github.event.inputs.environment }}"

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set env by input
run: |
echo "TAG_NAME=${{ github.event.inputs.environment }}" >> $GITHUB_ENV
Expand Down
18 changes: 13 additions & 5 deletions .github/workflows/notebook-report-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ jobs:
if: github.repository == 'bcgov/sbc-pay'

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- run: "true"

linting:
Expand All @@ -28,10 +28,10 @@ jobs:

strategy:
matrix:
python-version: [3.8]
python-version: [3.12]

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v1
with:
Expand All @@ -55,6 +55,10 @@ jobs:

runs-on: ubuntu-20.04

strategy:
matrix:
python-version: [3.12]

services:
postgres:
image: postgres:12
Expand All @@ -68,7 +72,7 @@ jobs:
options: --health-cmd pg_isready --health-interval 10s --health-timeout 5s --health-retries 5

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v1
with:
Expand All @@ -92,8 +96,12 @@ jobs:
needs: setup-job
runs-on: ubuntu-20.04

strategy:
matrix:
python-version: [3.12]

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: build to check strictness
id: build
run: |
Expand Down
30 changes: 30 additions & 0 deletions .github/workflows/pay-admin-cd-gcp.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
name: Pay Admin CD GCP

on:
push:
branches:
- feature-gcp
paths:
- "pay-admin/**"
workflow_dispatch:
inputs:
target:
description: "Deploy To"
required: true
type: choice
options:
- dev
- test
- sandbox
- prod

jobs:
pay-admin-cd:
uses: bcgov/bcregistry-sre/.github/workflows/cloud-run-service-cd.yaml@main
with:
target: ${{ inputs.target }}
app_name: "pay-admin"
working_directory: "./pay-admin"
secrets:
WORKLOAD_IDENTIFY_POOLS_PROVIDER: ${{ secrets.WORKLOAD_IDENTIFY_POOLS_PROVIDER }}
GCP_SERVICE_ACCOUNT: ${{ secrets.GCP_SERVICE_ACCOUNT }}
25 changes: 18 additions & 7 deletions .github/workflows/pay-admin-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ on:
pull_request:
branches:
- main
- feature-queue-python-upgrade
paths:
- "pay-admin/**"
- "pay-api/src/pay_api/models/**"
Expand All @@ -20,7 +21,7 @@ jobs:
if: github.repository == 'bcgov/sbc-pay'

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- run: "true"

linting:
Expand All @@ -29,10 +30,10 @@ jobs:

strategy:
matrix:
python-version: [3.8]
python-version: [3.12]

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v1
with:
Expand All @@ -53,25 +54,31 @@ jobs:
needs: setup-job
env:
FLASK_ENV: "testing"
DATABASE_TEST_URL: "postgresql://postgres:postgres@localhost:5432/postgres"
# Needs different database than POSTGRES otherwise dropping database doesn't work
DATABASE_TEST_URL: "postgresql://postgres:postgres@localhost:5432/pay-test"


runs-on: ubuntu-20.04

strategy:
matrix:
python-version: [3.12]

services:
postgres:
image: postgres:12
env:
POSTGRES_USER: postgres
POSTGRES_PASSWORD: postgres
POSTGRES_DB: postgres
# Needs different database than POSTGRES otherwise dropping database doesn't work
POSTGRES_DB: pay-test
ports:
- 5432:5432
# needed because the postgres container does not provide a healthcheck
options: --health-cmd pg_isready --health-interval 10s --health-timeout 5s --health-retries 5

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v1
with:
Expand All @@ -95,8 +102,12 @@ jobs:
needs: setup-job
runs-on: ubuntu-20.04

strategy:
matrix:
python-version: [3.12]

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: build to check strictness
id: build
run: |
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/pay-api-cd-gcp.yml
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
name: Pay API CD
name: Pay API CD GCP

on:
push:
branches:
- feature-queue-python-upgrade
- feature-gcp
paths:
- "pay-api/**"
workflow_dispatch:
Expand All @@ -27,4 +27,4 @@ jobs:
working_directory: "./pay-api"
secrets:
WORKLOAD_IDENTIFY_POOLS_PROVIDER: ${{ secrets.WORKLOAD_IDENTIFY_POOLS_PROVIDER }}
GCP_SERVICE_ACCOUNT: ${{ secrets.GCP_SERVICE_ACCOUNT }}
GCP_SERVICE_ACCOUNT: ${{ secrets.GCP_SERVICE_ACCOUNT }}
Loading
Loading