Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐛 Source RD Station Marketing: Fix stream analytics conversions #18826

Merged
merged 8 commits into from
Dec 5, 2022

Conversation

sarafonseca-123
Copy link
Contributor

@sarafonseca-123 sarafonseca-123 commented Nov 1, 2022

What

RD Station just deployed a breaking change on endpoint analytics_conversions. The data used to be in an object inside an array inside another object, and now is following other endpoints' patterns as an array inside an object. This code snippet now causes the error TypeError: 'NoneType' object is not iterable.

How

Removing the old snippet and inheriting the method parse_response from IncrementalRDStationMarketingStream like all other analytics streams.

🚨 User Impact 🚨

Are there any breaking changes? What is the end result perceived by the user? If yes, please merge this PR with the 🚨🚨 emoji so changelog authors can further highlight this if needed.

Pre-merge Checklist

Expand the relevant checklist and delete the others.

Updating a connector

Community member or Airbyter

  • Grant edit access to maintainers (instructions)
  • Secrets in the connector's spec are annotated with airbyte_secret
  • Unit & integration tests added and passing. Community members, please provide proof of success locally e.g: screenshot or copy-paste unit, integration, and acceptance test output. To run acceptance tests for a Python connector, follow instructions in the README. For java connectors run ./gradlew :airbyte-integrations:connectors:<name>:integrationTest.
  • Code reviews completed
  • Documentation updated
    • Connector's README.md
    • Connector's bootstrap.md. See description and examples
    • Changelog updated in docs/integrations/<source or destination>/<name>.md including changelog. See changelog example
  • PR name follows PR naming conventions

Airbyter

If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.

  • Create a non-forked branch based on this PR and test the below items on it
  • Build is successful
  • If new credentials are required for use in CI, add them to GSM. Instructions.
  • /test connector=connectors/<name> command is passing
  • New Connector version released on Dockerhub and connector version bumped by running the /publish command described here

Tests

Unit image
Integration

Building all of Airbyte.
/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors
Type-safe dependency accessors is an incubating feature.

Configure project :
configuring docker task for airbyte-bootloader
configuring docker task for airbyte-container-orchestrator
configuring docker task for airbyte-cron
configuring docker task for airbyte-proxy
configuring docker task for airbyte-server
configuring docker task for airbyte-temporal
configuring docker task for airbyte-webapp
configuring docker task for airbyte-workers
configuring docker task for init
configuring docker task for db-lib
configuring docker task for reporter

Task :airbyte-integrations:connectors:source-rd-station-marketing:checkPython
Using python 3.10.8 from /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing/.venv (.venv/bin/python)
Using pip 21.3.1 from /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing/.venv/lib/python3.10/site-packages/pip (python 3.10)

Task :airbyte-integrations:bases:base-normalization:checkPython
Using python 3.10.8 from /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/base-normalization/.venv (.venv/bin/python)
Using pip 21.3.1 from /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/base-normalization/.venv/lib/python3.10/site-packages/pip (python 3.10)

Task :airbyte-integrations:bases:source-acceptance-test:checkPython
Using python 3.10.8 from /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test/.venv (.venv/bin/python)
Using pip 21.3.1 from /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test/.venv/lib/python3.10/site-packages/pip (python 3.10)

Task :airbyte-integrations:bases:source-acceptance-test:pipInstall
[python] .venv/bin/python -m pip install pip==21.3.1
Requirement already satisfied: pip==21.3.1 in ./.venv/lib/python3.10/site-packages (21.3.1)
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test/.venv/bin/python -m pip install --upgrade pip' command.
[python] .venv/bin/python -m pip list --format=columns
Package Version Editable project location
--------------------------- --------- ---------------------------------------------------------------------------------------------------
airbyte-cdk 0.4.2
appdirs 1.4.4
attrs 22.1.0
backoff 2.2.1
black 22.3.0
cattrs 22.2.0
certifi 2022.9.24
charset-normalizer 2.1.1
click 8.1.3
coverage 6.3.1
dataclasses-jsonschema 2.15.1
deepdiff 5.8.1
Deprecated 1.2.13
docker 5.0.3
dpath 2.0.6
exceptiongroup 1.0.0rc9
fancycompleter 0.9.1
flake8 4.0.1
hypothesis 6.54.6
hypothesis-jsonschema 0.20.1
icdiff 1.9.1
idna 3.4
inflection 0.5.1
iniconfig 1.1.1
isort 5.6.4
Jinja2 3.1.2
jsonref 0.2
jsonschema 3.2.0
MarkupSafe 2.1.1
mccabe 0.6.1
multidict 6.0.2
mypy 0.930
mypy-extensions 0.4.3
ordered-set 4.1.0
packaging 21.3
pathspec 0.10.1
pdbpp 0.10.3
pendulum 2.1.2
pip 21.3.1
platformdirs 2.5.2
pluggy 0.13.1
pprintpp 0.4.0
py 1.11.0
pycodestyle 2.8.0
pydantic 1.9.2
pyflakes 2.4.0
Pygments 2.13.0
pyparsing 3.0.9
pyproject-flake8 0.0.1a2
pyrepl 0.9.0
pyrsistent 0.18.1
pytest 6.1.2
pytest-cov 3.0.0
pytest-mock 3.6.1
pytest-sugar 0.9.5
pytest-timeout 1.4.2
python-dateutil 2.8.2
pytzdata 2020.1
PyYAML 5.4.1
requests 2.28.1
requests-cache 0.9.6
requests-mock 1.9.3
responses 0.13.4
setuptools 63.4.3
six 1.16.0
sortedcontainers 2.4.0
source-acceptance-test 0.0.0
source-rd-station 0.0.0
source-rd-station-marketing 0.0.0 /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing
termcolor 2.0.1
toml 0.10.2
tomli 2.0.1
typing_extensions 4.4.0
url-normalize 1.4.3
urllib3 1.26.12
vcrpy 4.2.1
websocket-client 1.4.1
wmctrl 0.4
wrapt 1.14.1
yarl 1.8.1
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test/.venv/bin/python -m pip install --upgrade pip' command.

Task :airbyte-integrations:connectors:source-rd-station-marketing:pipInstall
[python] .venv/bin/python -m pip install pip==21.3.1
Requirement already satisfied: pip==21.3.1 in ./.venv/lib/python3.10/site-packages (21.3.1)
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing/.venv/bin/python -m pip install --upgrade pip' command.
[python] .venv/bin/python -m pip list --format=columns
Package Version Editable project location
--------------------------- --------- -----------------------------------------------------------------------------------------
airbyte-cdk 0.4.0
appdirs 1.4.4
attrs 22.1.0
backoff 2.2.1
black 22.3.0
cattrs 22.2.0
certifi 2022.9.24
charset-normalizer 2.1.1
click 8.1.3
coverage 6.3.1
dataclasses-jsonschema 2.15.1
deepdiff 5.8.1
Deprecated 1.2.13
distlib 0.3.6
docker 5.0.3
dpath 2.0.6
exceptiongroup 1.0.0rc9
fancycompleter 0.9.1
filelock 3.8.0
flake8 4.0.1
hypothesis 6.54.6
hypothesis-jsonschema 0.20.1
icdiff 1.9.1
idna 3.4
inflection 0.5.1
iniconfig 1.1.1
isort 5.6.4
Jinja2 3.1.2
jsonref 0.2
jsonschema 3.2.0
MarkupSafe 2.1.1
mccabe 0.6.1
multidict 6.0.2
mypy 0.930
mypy-extensions 0.4.3
ordered-set 4.1.0
packaging 21.3
pathspec 0.10.1
pdbpp 0.10.3
pendulum 2.1.2
pi 0.1.2
pip 21.3.1
platformdirs 2.5.2
pluggy 0.13.1
pprintpp 0.4.0
py 1.11.0
pycodestyle 2.8.0
pydantic 1.9.2
pyflakes 2.4.0
Pygments 2.13.0
pyparsing 3.0.9
pyproject-flake8 0.0.1a2
pyrepl 0.9.0
pyrsistent 0.18.1
pytest 6.1.2
pytest-cov 3.0.0
pytest-mock 3.6.1
pytest-sugar 0.9.5
pytest-timeout 1.4.2
python-dateutil 2.8.2
pytzdata 2020.1
PyYAML 5.4.1
requests 2.28.1
requests-cache 0.9.7
requests-mock 1.9.3
responses 0.13.4
setuptools 65.4.1
six 1.16.0
sortedcontainers 2.4.0
source-acceptance-test 0.0.0 /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test
source-rd-station-marketing 0.0.0
termcolor 2.0.1
toml 0.10.2
tomli 2.0.1
typing_extensions 4.4.0
url-normalize 1.4.3
urllib3 1.26.12
vcrpy 4.2.1
virtualenv 20.4.2
websocket-client 1.4.1
wmctrl 0.4
wrapt 1.14.1
yarl 1.8.1
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing/.venv/bin/python -m pip install --upgrade pip' command.

Task :airbyte-integrations:bases:base-normalization:pipInstall
[python] .venv/bin/python -m pip install pip==21.3.1
Requirement already satisfied: pip==21.3.1 in ./.venv/lib/python3.10/site-packages (21.3.1)
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/base-normalization/.venv/bin/python -m pip install --upgrade pip' command.
[python] .venv/bin/python -m pip list --format=columns
Package Version Editable project location
--------------------------- --------- ---------------------------------------------------------------------------------------------------
airbyte-cdk 0.2.3
appdirs 1.4.4
attrs 22.1.0
backoff 2.2.1
black 22.3.0
cattrs 22.2.0
certifi 2022.9.24
charset-normalizer 2.1.1
click 8.1.3
coverage 6.3.1
dataclasses-jsonschema 2.15.1
deepdiff 5.8.1
Deprecated 1.2.13
docker 5.0.3
dpath 2.0.6
exceptiongroup 1.0.0rc9
fancycompleter 0.9.1
flake8 4.0.1
hypothesis 6.54.6
hypothesis-jsonschema 0.20.1
icdiff 1.9.1
idna 3.4
inflection 0.5.1
iniconfig 1.1.1
isort 5.6.4
Jinja2 3.1.2
jsonref 0.2
jsonschema 3.2.0
MarkupSafe 2.1.1
mccabe 0.6.1
multidict 6.0.2
mypy 0.930
mypy-extensions 0.4.3
normalization 0.0.0
ordered-set 4.1.0
packaging 21.3
pathspec 0.10.1
pdbpp 0.10.3
pendulum 2.1.2
pip 21.3.1
platformdirs 2.5.2
pluggy 0.13.1
pprintpp 0.4.0
py 1.11.0
pycodestyle 2.8.0
pydantic 1.9.2
pyflakes 2.4.0
Pygments 2.13.0
pyparsing 3.0.9
pyproject-flake8 0.0.1a2
pyrepl 0.9.0
pyrsistent 0.18.1
pytest 6.1.2
pytest-cov 3.0.0
pytest-mock 3.6.1
pytest-sugar 0.9.5
pytest-timeout 1.4.2
python-dateutil 2.8.2
pytzdata 2020.1
PyYAML 5.4.1
requests 2.28.1
requests-cache 0.9.6
requests-mock 1.9.3
responses 0.13.4
setuptools 63.4.3
six 1.16.0
sortedcontainers 2.4.0
source-acceptance-test 0.0.0 /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test
source-rd-station 0.0.0
source-rd-station-marketing 0.0.0 /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing
termcolor 2.0.1
toml 0.10.2
tomli 2.0.1
types-PyYAML 6.0.12.1
typing_extensions 4.4.0
url-normalize 1.4.3
urllib3 1.26.12
vcrpy 4.2.1
websocket-client 1.4.1
wmctrl 0.4
wrapt 1.14.1
yarl 1.8.1
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/base-normalization/.venv/bin/python -m pip install --upgrade pip' command.

Task :airbyte-integrations:connectors:source-rd-station-marketing:isortFormat
[python] .venv/bin/python -m isort --settings-file=/Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./
Skipped 14 files

Task :airbyte-integrations:bases:source-acceptance-test:isortFormat
[python] .venv/bin/python -m isort --settings-file=/Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./
Skipped 6 files

Task :airbyte-integrations:connectors:source-rd-station-marketing:blackFormat
[python] .venv/bin/python -m black --config /Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./
All done! ✨ 🍰 ✨
11 files left unchanged.

Task :airbyte-integrations:bases:source-acceptance-test:blackFormat
[python] .venv/bin/python -m black --config /Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./
All done! ✨ 🍰 ✨
32 files left unchanged.

Task :airbyte-integrations:connectors:source-rd-station-marketing:flakeCheck
[python] .venv/bin/python -m pflake8 --config /Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./

Task :airbyte-integrations:bases:base-normalization:isortFormat
[python] .venv/bin/python -m isort --settings-file=/Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./

Task :airbyte-integrations:bases:source-acceptance-test:flakeCheck
[python] .venv/bin/python -m pflake8 --config /Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./

Task :airbyte-integrations:bases:source-acceptance-test:installLocalReqs
[python] .venv/bin/python -m pip install .[dev,tests]
Processing /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
WARNING: source-acceptance-test 0.0.0 does not provide the extra 'dev'
WARNING: source-acceptance-test 0.0.0 does not provide the extra 'tests'
Requirement already satisfied: airbyte-cdk~=0.2 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.4.2)
Requirement already satisfied: docker~=5.0.3 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (5.0.3)
Requirement already satisfied: PyYAML~=5.4 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (5.4.1)
Requirement already satisfied: icdiff~=1.9 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (1.9.1)
Requirement already satisfied: inflection~=0.5 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.5.1)
Requirement already satisfied: pdbpp~=0.10 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.10.3)
Requirement already satisfied: pydantic~=1.6 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (1.9.2)
Requirement already satisfied: pytest~=6.1 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (6.1.2)
Requirement already satisfied: pytest-sugar~=0.9 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.9.5)
Requirement already satisfied: pytest-timeout~=1.4 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (1.4.2)
Requirement already satisfied: pprintpp~=0.4 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.4.0)
Requirement already satisfied: dpath~=2.0.1 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (2.0.6)
Requirement already satisfied: jsonschema~=3.2.0 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (3.2.0)
Requirement already satisfied: jsonref==0.2 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.2)
Requirement already satisfied: deepdiff~=5.8.0 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (5.8.1)
Requirement already satisfied: requests-mock~=1.9.3 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (1.9.3)
Requirement already satisfied: pytest-mock~=3.6.1 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (3.6.1)
Requirement already satisfied: pytest-cov~=3.0.0 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (3.0.0)
Requirement already satisfied: hypothesis~=6.54.1 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (6.54.6)
Requirement already satisfied: hypothesis-jsonschema~=0.20.1 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.20.1)
Requirement already satisfied: backoff in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (2.2.1)
Requirement already satisfied: pendulum in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (2.1.2)
Requirement already satisfied: requests-cache in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (0.9.6)
Requirement already satisfied: requests in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (2.28.1)
Requirement already satisfied: Deprecated~=1.2 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (1.2.13)
Requirement already satisfied: dataclasses-jsonschema==2.15.1 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (2.15.1)
Requirement already satisfied: Jinja2~=3.1.2 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (3.1.2)
Requirement already satisfied: python-dateutil in ./.venv/lib/python3.10/site-packages (from dataclasses-jsonschema==2.15.1->airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (2.8.2)
Requirement already satisfied: ordered-set<4.2.0,>=4.1.0 in ./.venv/lib/python3.10/site-packages (from deepdiff~=5.8.0->source-acceptance-test==0.0.0) (4.1.0)
Requirement already satisfied: websocket-client>=0.32.0 in ./.venv/lib/python3.10/site-packages (from docker~=5.0.3->source-acceptance-test==0.0.0) (1.4.1)
Requirement already satisfied: sortedcontainers<3.0.0,>=2.1.0 in ./.venv/lib/python3.10/site-packages (from hypothesis~=6.54.1->source-acceptance-test==0.0.0) (2.4.0)
Requirement already satisfied: exceptiongroup>=1.0.0rc8 in ./.venv/lib/python3.10/site-packages (from hypothesis~=6.54.1->source-acceptance-test==0.0.0) (1.0.0rc9)
Requirement already satisfied: attrs>=19.2.0 in ./.venv/lib/python3.10/site-packages (from hypothesis~=6.54.1->source-acceptance-test==0.0.0) (22.1.0)
Requirement already satisfied: six>=1.11.0 in ./.venv/lib/python3.10/site-packages (from jsonschema~=3.2.0->source-acceptance-test==0.0.0) (1.16.0)
Requirement already satisfied: setuptools in ./.venv/lib/python3.10/site-packages (from jsonschema~=3.2.0->source-acceptance-test==0.0.0) (63.4.3)
Requirement already satisfied: pyrsistent>=0.14.0 in ./.venv/lib/python3.10/site-packages (from jsonschema~=3.2.0->source-acceptance-test==0.0.0) (0.18.1)
Requirement already satisfied: pygments in ./.venv/lib/python3.10/site-packages (from pdbpp~=0.10->source-acceptance-test==0.0.0) (2.13.0)
Requirement already satisfied: fancycompleter>=0.8 in ./.venv/lib/python3.10/site-packages (from pdbpp~=0.10->source-acceptance-test==0.0.0) (0.9.1)
Requirement already satisfied: wmctrl in ./.venv/lib/python3.10/site-packages (from pdbpp~=0.10->source-acceptance-test==0.0.0) (0.4)
Requirement already satisfied: typing-extensions>=3.7.4.3 in ./.venv/lib/python3.10/site-packages (from pydantic~=1.6->source-acceptance-test==0.0.0) (4.4.0)
Requirement already satisfied: py>=1.8.2 in ./.venv/lib/python3.10/site-packages (from pytest~=6.1->source-acceptance-test==0.0.0) (1.11.0)
Requirement already satisfied: iniconfig in ./.venv/lib/python3.10/site-packages (from pytest~=6.1->source-acceptance-test==0.0.0) (1.1.1)
Requirement already satisfied: packaging in ./.venv/lib/python3.10/site-packages (from pytest~=6.1->source-acceptance-test==0.0.0) (21.3)
Requirement already satisfied: pluggy<1.0,>=0.12 in ./.venv/lib/python3.10/site-packages (from pytest~=6.1->source-acceptance-test==0.0.0) (0.13.1)
Requirement already satisfied: toml in ./.venv/lib/python3.10/site-packages (from pytest~=6.1->source-acceptance-test==0.0.0) (0.10.2)
Requirement already satisfied: coverage[toml]>=5.2.1 in ./.venv/lib/python3.10/site-packages (from pytest-cov~=3.0.0->source-acceptance-test==0.0.0) (6.3.1)
Requirement already satisfied: termcolor>=1.1.0 in ./.venv/lib/python3.10/site-packages (from pytest-sugar~=0.9->source-acceptance-test==0.0.0) (2.0.1)
Requirement already satisfied: tomli in ./.venv/lib/python3.10/site-packages (from coverage[toml]>=5.2.1->pytest-cov~=3.0.0->source-acceptance-test==0.0.0) (2.0.1)
Requirement already satisfied: wrapt<2,>=1.10 in ./.venv/lib/python3.10/site-packages (from Deprecated~=1.2->airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (1.14.1)
Requirement already satisfied: pyrepl>=0.8.2 in ./.venv/lib/python3.10/site-packages (from fancycompleter>=0.8->pdbpp~=0.10->source-acceptance-test==0.0.0) (0.9.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./.venv/lib/python3.10/site-packages (from Jinja2~=3.1.2->airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (2.1.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in ./.venv/lib/python3.10/site-packages (from packaging->pytest~=6.1->source-acceptance-test==0.0.0) (3.0.9)
Requirement already satisfied: idna<4,>=2.5 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (1.26.12)
Requirement already satisfied: certifi>=2017.4.17 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (2022.9.24)
Requirement already satisfied: charset-normalizer<3,>=2 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (2.1.1)
Requirement already satisfied: pytzdata>=2020.1 in ./.venv/lib/python3.10/site-packages (from pendulum->airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (2020.1)
Requirement already satisfied: url-normalize>=1.4 in ./.venv/lib/python3.10/site-packages (from requests-cache->airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (1.4.3)
Requirement already satisfied: appdirs>=1.4.4 in ./.venv/lib/python3.10/site-packages (from requests-cache->airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (1.4.4)
Requirement already satisfied: cattrs>=1.8 in ./.venv/lib/python3.10/site-packages (from requests-cache->airbyte-cdk~=0.2->source-acceptance-test==0.0.0) (22.2.0)
Using legacy 'setup.py install' for source-acceptance-test, since package 'wheel' is not installed.
Installing collected packages: source-acceptance-test
Attempting uninstall: source-acceptance-test
Found existing installation: source-acceptance-test 0.0.0
Uninstalling source-acceptance-test-0.0.0:
Successfully uninstalled source-acceptance-test-0.0.0
Running setup.py install for source-acceptance-test: started
Running setup.py install for source-acceptance-test: finished with status 'done'
Successfully installed source-acceptance-test-0.0.0
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test/.venv/bin/python -m pip install --upgrade pip' command.

Task :airbyte-integrations:bases:base-normalization:isortFormat
Skipped 4 files

Task :airbyte-integrations:bases:base-normalization:blackFormat
[python] .venv/bin/python -m black --config /Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./
All done! ✨ 🍰 ✨
26 files left unchanged.

Task :airbyte-integrations:bases:base-normalization:flakeCheck
[python] .venv/bin/python -m pflake8 --config /Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./

Task :airbyte-integrations:connectors:source-rd-station-marketing:installReqs
[python] .venv/bin/python -m pip install .[main]
Processing /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
WARNING: source-rd-station-marketing 0.0.0 does not provide the extra 'main'
Requirement already satisfied: airbyte-cdk~=0.2 in ./.venv/lib/python3.10/site-packages (from source-rd-station-marketing==0.0.0) (0.4.0)
Requirement already satisfied: pydantic~=1.9.2 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (1.9.2)
Requirement already satisfied: backoff in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.2.1)
Requirement already satisfied: requests in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.28.1)
Requirement already satisfied: jsonschema~=3.2.0 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (3.2.0)
Requirement already satisfied: Deprecated~=1.2 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (1.2.13)
Requirement already satisfied: dataclasses-jsonschema==2.15.1 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.15.1)
Requirement already satisfied: jsonref~=0.2 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (0.2)
Requirement already satisfied: Jinja2~=3.1.2 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (3.1.2)
Requirement already satisfied: dpath~=2.0.1 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.0.6)
Requirement already satisfied: PyYAML~=5.4 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (5.4.1)
Requirement already satisfied: pendulum in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.1.2)
Requirement already satisfied: requests-cache in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (0.9.7)
Requirement already satisfied: python-dateutil in ./.venv/lib/python3.10/site-packages (from dataclasses-jsonschema==2.15.1->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.8.2)
Requirement already satisfied: wrapt<2,>=1.10 in ./.venv/lib/python3.10/site-packages (from Deprecated~=1.2->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (1.14.1)
Requirement already satisfied: MarkupSafe>=2.0 in ./.venv/lib/python3.10/site-packages (from Jinja2~=3.1.2->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.1.1)
Requirement already satisfied: six>=1.11.0 in ./.venv/lib/python3.10/site-packages (from jsonschema~=3.2.0->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (1.16.0)
Requirement already satisfied: pyrsistent>=0.14.0 in ./.venv/lib/python3.10/site-packages (from jsonschema~=3.2.0->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (0.18.1)
Requirement already satisfied: setuptools in ./.venv/lib/python3.10/site-packages (from jsonschema~=3.2.0->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (65.4.1)
Requirement already satisfied: attrs>=17.4.0 in ./.venv/lib/python3.10/site-packages (from jsonschema~=3.2.0->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (22.1.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in ./.venv/lib/python3.10/site-packages (from pydantic~=1.9.2->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (4.4.0)
Requirement already satisfied: pytzdata>=2020.1 in ./.venv/lib/python3.10/site-packages (from pendulum->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2020.1)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (1.26.12)
Requirement already satisfied: idna<4,>=2.5 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2022.9.24)
Requirement already satisfied: charset-normalizer<3,>=2 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.1.1)
Requirement already satisfied: appdirs>=1.4.4 in ./.venv/lib/python3.10/site-packages (from requests-cache->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (1.4.4)
Requirement already satisfied: url-normalize>=1.4 in ./.venv/lib/python3.10/site-packages (from requests-cache->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (1.4.3)
Requirement already satisfied: cattrs>=22.2 in ./.venv/lib/python3.10/site-packages (from requests-cache->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (22.2.0)
Requirement already satisfied: exceptiongroup in ./.venv/lib/python3.10/site-packages (from cattrs>=22.2->requests-cache->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (1.0.0rc9)
Using legacy 'setup.py install' for source-rd-station-marketing, since package 'wheel' is not installed.
Installing collected packages: source-rd-station-marketing
Attempting uninstall: source-rd-station-marketing
Found existing installation: source-rd-station-marketing 0.0.0
Uninstalling source-rd-station-marketing-0.0.0:
Successfully uninstalled source-rd-station-marketing-0.0.0
Running setup.py install for source-rd-station-marketing: started
Running setup.py install for source-rd-station-marketing: finished with status 'done'
Successfully installed source-rd-station-marketing-0.0.0
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing/.venv/bin/python -m pip install --upgrade pip' command.

Task :airbyte-integrations:connectors:source-rd-station-marketing:installTestReqs
[python] .venv/bin/python -m pip install .[tests]
Processing /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: airbyte-cdk~=0.2 in ./.venv/lib/python3.10/site-packages (from source-rd-station-marketing==0.0.0) (0.4.0)
Collecting pytest~=6.2
Using cached pytest-6.2.5-py3-none-any.whl (280 kB)
Requirement already satisfied: pytest-mock~=3.6.1 in ./.venv/lib/python3.10/site-packages (from source-rd-station-marketing==0.0.0) (3.6.1)
Requirement already satisfied: source-acceptance-test in /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test (from source-rd-station-marketing==0.0.0) (0.0.0)
Requirement already satisfied: responses~=0.13.3 in ./.venv/lib/python3.10/site-packages (from source-rd-station-marketing==0.0.0) (0.13.4)
Requirement already satisfied: requests-mock in ./.venv/lib/python3.10/site-packages (from source-rd-station-marketing==0.0.0) (1.9.3)
Requirement already satisfied: pendulum in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.1.2)
Requirement already satisfied: jsonschema~=3.2.0 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (3.2.0)
Requirement already satisfied: Deprecated~=1.2 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (1.2.13)
Requirement already satisfied: PyYAML~=5.4 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (5.4.1)
Requirement already satisfied: Jinja2~=3.1.2 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (3.1.2)
Requirement already satisfied: dataclasses-jsonschema==2.15.1 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.15.1)
Requirement already satisfied: backoff in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.2.1)
Requirement already satisfied: requests in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.28.1)
Requirement already satisfied: jsonref~=0.2 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (0.2)
Requirement already satisfied: requests-cache in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (0.9.7)
Requirement already satisfied: dpath~=2.0.1 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.0.6)
Requirement already satisfied: pydantic~=1.9.2 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (1.9.2)
Requirement already satisfied: python-dateutil in ./.venv/lib/python3.10/site-packages (from dataclasses-jsonschema==2.15.1->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.8.2)
Requirement already satisfied: attrs>=19.2.0 in ./.venv/lib/python3.10/site-packages (from pytest~=6.2->source-rd-station-marketing==0.0.0) (22.1.0)
Requirement already satisfied: py>=1.8.2 in ./.venv/lib/python3.10/site-packages (from pytest~=6.2->source-rd-station-marketing==0.0.0) (1.11.0)
Requirement already satisfied: iniconfig in ./.venv/lib/python3.10/site-packages (from pytest~=6.2->source-rd-station-marketing==0.0.0) (1.1.1)
Requirement already satisfied: packaging in ./.venv/lib/python3.10/site-packages (from pytest~=6.2->source-rd-station-marketing==0.0.0) (21.3)
Requirement already satisfied: toml in ./.venv/lib/python3.10/site-packages (from pytest~=6.2->source-rd-station-marketing==0.0.0) (0.10.2)
Requirement already satisfied: pluggy<2.0,>=0.12 in ./.venv/lib/python3.10/site-packages (from pytest~=6.2->source-rd-station-marketing==0.0.0) (0.13.1)
Requirement already satisfied: urllib3>=1.25.10 in ./.venv/lib/python3.10/site-packages (from responses~=0.13.3->source-rd-station-marketing==0.0.0) (1.26.12)
Requirement already satisfied: six in ./.venv/lib/python3.10/site-packages (from responses~=0.13.3->source-rd-station-marketing==0.0.0) (1.16.0)
Requirement already satisfied: docker~=5.0.3 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test->source-rd-station-marketing==0.0.0) (5.0.3)
Requirement already satisfied: icdiff~=1.9 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test->source-rd-station-marketing==0.0.0) (1.9.1)
Requirement already satisfied: inflection~=0.5 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test->source-rd-station-marketing==0.0.0) (0.5.1)
Requirement already satisfied: pdbpp~=0.10 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test->source-rd-station-marketing==0.0.0) (0.10.3)
Requirement already satisfied: pytest-sugar~=0.9 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test->source-rd-station-marketing==0.0.0) (0.9.5)
Requirement already satisfied: pytest-timeout~=1.4 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test->source-rd-station-marketing==0.0.0) (1.4.2)
Requirement already satisfied: pprintpp~=0.4 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test->source-rd-station-marketing==0.0.0) (0.4.0)
Requirement already satisfied: deepdiff~=5.8.0 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test->source-rd-station-marketing==0.0.0) (5.8.1)
Requirement already satisfied: pytest-cov~=3.0.0 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test->source-rd-station-marketing==0.0.0) (3.0.0)
Requirement already satisfied: hypothesis~=6.54.1 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test->source-rd-station-marketing==0.0.0) (6.54.6)
Requirement already satisfied: hypothesis-jsonschema~=0.20.1 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test->source-rd-station-marketing==0.0.0) (0.20.1)
Requirement already satisfied: ordered-set<4.2.0,>=4.1.0 in ./.venv/lib/python3.10/site-packages (from deepdiff~=5.8.0->source-acceptance-test->source-rd-station-marketing==0.0.0) (4.1.0)
Requirement already satisfied: wrapt<2,>=1.10 in ./.venv/lib/python3.10/site-packages (from Deprecated~=1.2->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (1.14.1)
Requirement already satisfied: websocket-client>=0.32.0 in ./.venv/lib/python3.10/site-packages (from docker~=5.0.3->source-acceptance-test->source-rd-station-marketing==0.0.0) (1.4.1)
Requirement already satisfied: sortedcontainers<3.0.0,>=2.1.0 in ./.venv/lib/python3.10/site-packages (from hypothesis~=6.54.1->source-acceptance-test->source-rd-station-marketing==0.0.0) (2.4.0)
Requirement already satisfied: exceptiongroup>=1.0.0rc8 in ./.venv/lib/python3.10/site-packages (from hypothesis~=6.54.1->source-acceptance-test->source-rd-station-marketing==0.0.0) (1.0.0rc9)
Requirement already satisfied: MarkupSafe>=2.0 in ./.venv/lib/python3.10/site-packages (from Jinja2~=3.1.2->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.1.1)
Requirement already satisfied: pyrsistent>=0.14.0 in ./.venv/lib/python3.10/site-packages (from jsonschema~=3.2.0->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (0.18.1)
Requirement already satisfied: setuptools in ./.venv/lib/python3.10/site-packages (from jsonschema~=3.2.0->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (65.4.1)
Requirement already satisfied: wmctrl in ./.venv/lib/python3.10/site-packages (from pdbpp~=0.10->source-acceptance-test->source-rd-station-marketing==0.0.0) (0.4)
Requirement already satisfied: pygments in ./.venv/lib/python3.10/site-packages (from pdbpp~=0.10->source-acceptance-test->source-rd-station-marketing==0.0.0) (2.13.0)
Requirement already satisfied: fancycompleter>=0.8 in ./.venv/lib/python3.10/site-packages (from pdbpp~=0.10->source-acceptance-test->source-rd-station-marketing==0.0.0) (0.9.1)
Requirement already satisfied: typing-extensions>=3.7.4.3 in ./.venv/lib/python3.10/site-packages (from pydantic~=1.9.2->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (4.4.0)
Requirement already satisfied: coverage[toml]>=5.2.1 in ./.venv/lib/python3.10/site-packages (from pytest-cov~=3.0.0->source-acceptance-test->source-rd-station-marketing==0.0.0) (6.3.1)
Requirement already satisfied: termcolor>=1.1.0 in ./.venv/lib/python3.10/site-packages (from pytest-sugar~=0.9->source-acceptance-test->source-rd-station-marketing==0.0.0) (2.0.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in ./.venv/lib/python3.10/site-packages (from packaging->pytest~=6.2->source-rd-station-marketing==0.0.0) (3.0.9)
Requirement already satisfied: idna<4,>=2.5 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (3.4)
Requirement already satisfied: charset-normalizer<3,>=2 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2.1.1)
Requirement already satisfied: certifi>=2017.4.17 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2022.9.24)
Requirement already satisfied: pytzdata>=2020.1 in ./.venv/lib/python3.10/site-packages (from pendulum->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (2020.1)
Requirement already satisfied: url-normalize>=1.4 in ./.venv/lib/python3.10/site-packages (from requests-cache->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (1.4.3)
Requirement already satisfied: appdirs>=1.4.4 in ./.venv/lib/python3.10/site-packages (from requests-cache->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (1.4.4)
Requirement already satisfied: cattrs>=22.2 in ./.venv/lib/python3.10/site-packages (from requests-cache->airbyte-cdk~=0.2->source-rd-station-marketing==0.0.0) (22.2.0)
Requirement already satisfied: tomli in ./.venv/lib/python3.10/site-packages (from coverage[toml]>=5.2.1->pytest-cov~=3.0.0->source-acceptance-test->source-rd-station-marketing==0.0.0) (2.0.1)
Requirement already satisfied: pyrepl>=0.8.2 in ./.venv/lib/python3.10/site-packages (from fancycompleter>=0.8->pdbpp~=0.10->source-acceptance-test->source-rd-station-marketing==0.0.0) (0.9.0)
Using legacy 'setup.py install' for source-rd-station-marketing, since package 'wheel' is not installed.
Installing collected packages: pytest, source-rd-station-marketing
Attempting uninstall: pytest
Found existing installation: pytest 6.1.2
Uninstalling pytest-6.1.2:
Successfully uninstalled pytest-6.1.2
Attempting uninstall: source-rd-station-marketing
Found existing installation: source-rd-station-marketing 0.0.0
Uninstalling source-rd-station-marketing-0.0.0:
Successfully uninstalled source-rd-station-marketing-0.0.0
Running setup.py install for source-rd-station-marketing: started
Running setup.py install for source-rd-station-marketing: finished with status 'done'
Successfully installed pytest-6.2.5 source-rd-station-marketing-0.0.0
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing/.venv/bin/python -m pip install --upgrade pip' command.

Task :airbyte-integrations:connectors:source-rd-station-marketing:_unitTestCoverage
[python] .venv/bin/python -m coverage run --data-file=unit_tests/.coverage.unitTest --rcfile=/Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml -m pytest -s unit_tests -c /Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml
============================= test session starts ==============================
platform darwin -- Python 3.10.8, pytest-6.2.5, py-1.11.0, pluggy-0.13.1 -- /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing/.venv/bin/python
cachedir: .pytest_cache
hypothesis profile 'default' -> database=DirectoryBasedExampleDatabase('/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing/.hypothesis/examples')
rootdir: /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing/unit_tests, configfile: ../../../../pyproject.toml
plugins: hypothesis-6.54.6, sugar-0.9.5, requests-mock-1.9.3, mock-3.6.1, timeout-1.4.2, cov-3.0.0
collecting ... collected 19 items

     unit_tests/test_incremental_streams.py::test_cursor_field PASSED
     unit_tests/test_incremental_streams.py::test_get_updated_state PASSED
     unit_tests/test_incremental_streams.py::test_stream_slices PASSED
     unit_tests/test_incremental_streams.py::test_supports_incremental PASSED
     unit_tests/test_incremental_streams.py::test_source_defined_cursor PASSED
     unit_tests/test_incremental_streams.py::test_stream_checkpoint_interval PASSED
     unit_tests/test_source.py::test_check_connection PASSED
     unit_tests/test_source.py::test_streams PASSED
     unit_tests/test_streams.py::test_path PASSED
     unit_tests/test_streams.py::test_request_params PASSED
     unit_tests/test_streams.py::test_next_page_token PASSED
     unit_tests/test_streams.py::test_parse_response PASSED
     unit_tests/test_streams.py::test_request_headers PASSED
     unit_tests/test_streams.py::test_http_method PASSED
     unit_tests/test_streams.py::test_should_retry[HTTPStatus.OK-False] PASSED
     unit_tests/test_streams.py::test_should_retry[HTTPStatus.BAD_REQUEST-False] PASSED
     unit_tests/test_streams.py::test_should_retry[HTTPStatus.TOO_MANY_REQUESTS-True] PASSED
     unit_tests/test_streams.py::test_should_retry[HTTPStatus.INTERNAL_SERVER_ERROR-True] PASSED
     unit_tests/test_streams.py::test_backoff_time PASSED
     
     =============================== warnings summary ===============================
     test_incremental_streams.py: 6 warnings
     test_source.py: 12 warnings
     test_streams.py: 11 warnings
       /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing/.venv/lib/python3.10/site-packages/airbyte_cdk/sources/streams/http/http.py:43: DeprecationWarning: Call to deprecated class NoAuth. (Set `authenticator=None` instead) -- Deprecated since version 0.1.20.
         self._authenticator: HttpAuthenticator = NoAuth()
     
     test_incremental_streams.py: 6 warnings
     test_source.py: 14 warnings
     test_streams.py: 11 warnings
       /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing/.venv/lib/python3.10/site-packages/deprecated/classic.py:173: DeprecationWarning: Call to deprecated class HttpAuthenticator. (Use requests.auth.AuthBase instead) -- Deprecated since version 0.1.20.
         return old_new1(cls, *args, **kwargs)
     
     test_source.py::test_check_connection
     test_source.py::test_streams
       /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing/source_rd_station_marketing/source.py:68: DeprecationWarning: Call to deprecated class Oauth2Authenticator. (Use airbyte_cdk.sources.streams.http.requests_native_auth.Oauth2Authenticator instead) -- Deprecated since version 0.1.20.
         stream_kwargs["authenticator"] = Oauth2Authenticator(
     
     -- Docs: https://docs.pytest.org/en/stable/warnings.html
     ======================= 19 passed, 62 warnings in 0.59s ========================

Task :airbyte-integrations:connectors:source-rd-station-marketing:unitTest
Name Stmts Miss Cover


source_rd_station_marketing/init.py 2 0 100%
source_rd_station_marketing/source.py 29 2 93%
source_rd_station_marketing/streams.py 97 17 82%

TOTAL 128 19 85%

Task :airbyte-integrations:connectors:source-rd-station-marketing:airbyteDocker
Execution optimizations have been disabled for task ':airbyte-integrations:connectors:source-rd-station-marketing:airbyteDocker' to ensure correctness due to the following reasons:

  • Gradle detected a problem with the following location: '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing'. Reason: Task ':airbyte-integrations:connectors:source-rd-station-marketing:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:source-rd-station-marketing:compileTestJava' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  • Gradle detected a problem with the following location: '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing'. Reason: Task ':airbyte-integrations:connectors:source-rd-station-marketing:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:source-rd-station-marketing:pmdMain' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  • Gradle detected a problem with the following location: '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing'. Reason: Task ':airbyte-integrations:connectors:source-rd-station-marketing:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:source-rd-station-marketing:pmdTest' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  • Gradle detected a problem with the following location: '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing'. Reason: Task ':airbyte-integrations:connectors:source-rd-station-marketing:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:source-rd-station-marketing:processTestResources' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  • Gradle detected a problem with the following location: '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing'. Reason: Task ':airbyte-integrations:connectors:source-rd-station-marketing:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:source-rd-station-marketing:spotbugsMain' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  • Gradle detected a problem with the following location: '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing'. Reason: Task ':airbyte-integrations:connectors:source-rd-station-marketing:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:source-rd-station-marketing:spotbugsTest' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
    checkin catalogs #1 [internal] load build definition from Dockerfile
    checkin catalogs #1 sha256:3cde25d5c8941f29d8a6da583c1536f180eaaaee636aef61b3b3133b1e2097e9
    checkin catalogs #1 transferring dockerfile: 37B done
    checkin catalogs #1 DONE 0.0s

#2 [internal] load .dockerignore
#2 sha256:6e12b2ae605c30c4eb7e2fa2d53bbc2cf892360867277596ce633d79036aeddd
#2 transferring context: 34B done
#2 DONE 0.0s

#3 [internal] load metadata for docker.io/library/python:3.9.11-alpine3.15
#3 sha256:615609793cad3a170d91fb8a37323caa348ca31e0a749e824da4c8c1d8da2aa4
#3 DONE 2.3s

#4 [base 1/1] FROM docker.io/library/python:3.9.11-alpine3.15@sha256:45ddd216e6b4efee0617e15d541e9148ffd6898203fcbe86a9f5bf906ce7837f
#4 sha256:4c436ac5d39299d948ef79080102d272b18d64395fbed9cc821104f1e2bd7d93
#4 DONE 0.0s

#7 [internal] load build context
#7 sha256:9d7854dfb8018b0b6e4271c99a66d1b435bbaddba0c317887cd487b3a64507cc
#7 transferring context: 2.35kB done
#7 DONE 0.0s

#10 [stage-2 2/7] COPY --from=builder /install /usr/local
#10 sha256:6d065ee98d854206be6c0564ad54859ea352146cc62afc75417f453dd7052d38
#10 CACHED

#13 [stage-2 5/7] RUN apk --no-cache add bash
#13 sha256:0026f8f9778dc9251ae2c893eb7f4d0767844d4a6ba578838eef4517b773ba88
#13 CACHED

#8 [builder 3/4] COPY setup.py ./
#8 sha256:b63d6768ba6d8aa5b3739a50a0949705eddbd4ef834b4f208f9817f725434f34
#8 CACHED

#12 [stage-2 4/7] RUN echo "Etc/UTC" > /etc/timezone
#12 sha256:793ac5e47489eb8569885658c1b0ffe170dfb90d34160d9417378ab7b6979f76
#12 CACHED

#9 [builder 4/4] RUN pip install --prefix=/install .
#9 sha256:73fa2c5cabcf28b77262cfea36d4319711f4687d9cb1d52dd9ff714d6bece967
#9 CACHED

#6 [builder 2/4] RUN apk --no-cache upgrade && pip install --upgrade pip && apk --no-cache add tzdata build-base
#6 sha256:fddd1028d4c855a19a9d12c308b03a65954965cf7ce3303f4d640a7d59aba08d
#6 CACHED

#5 [builder 1/4] WORKDIR /airbyte/integration_code
#5 sha256:736c564b6c0d634b064a8145fffebbf56c57a10eea338e59977586dee56a7251
#5 CACHED

#11 [stage-2 3/7] COPY --from=builder /usr/share/zoneinfo/Etc/UTC /etc/localtime
#11 sha256:ffbe6156d291a66819bd4b1683ceaa9007f53f1ef1cd1f065b6c9a62babdc0af
#11 CACHED

#14 [stage-2 6/7] COPY main.py ./
#14 sha256:e2bfbf73e1141954a1c5c1c18ef1816f3612c66687d1309c56a01fadccb044a3
#14 CACHED

#15 [stage-2 7/7] COPY source_rd_station_marketing ./source_rd_station_marketing
#15 sha256:67ea5076290619d486f958f605b96bc8bf3d3a0d34b13d4975ef103915097ec9
#15 DONE 0.0s

#16 exporting to image
#16 sha256:e8c613e07b0b7ff33893b694f7759a10d42e180f2b4dc349fb57dc6b71dcab00
#16 exporting layers 0.0s done
#16 writing image sha256:dfcc2812ab8d44b8ecef4fcd6e4f86aa876ffbfe4bf2c095d7ee8de114ce7922 done
#16 naming to docker.io/airbyte/source-rd-station-marketing:dev done
#16 DONE 0.0s

Use 'docker scan' to run Snyk tests against images to find vulnerabilities and learn how to fix them

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD SUCCESSFUL in 34s
42 actionable tasks: 21 executed, 21 up-to-date

Acceptance image

@github-actions github-actions bot added area/connectors Connector related issues area/documentation Improvements or additions to documentation labels Nov 1, 2022
@sarafonseca-123 sarafonseca-123 changed the title Fix stream analytics conversions on RD Station Marketing 🐛 Source RD Station Marketing: Fix stream analytics conversions Nov 1, 2022
@sarafonseca-123 sarafonseca-123 marked this pull request as ready for review November 1, 2022 23:19
@tuanchris
Copy link
Contributor

Hi @sarafonseca-123, thanks for the PR. Is there a doc to the RD Station API change that you mentioned?

@sarafonseca-123
Copy link
Contributor Author

@tuanchris there was no announcement on this change, but you can see the new response structure on this link, clicking in response 200

Copy link
Contributor

@tuanchris tuanchris left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me @sarafonseca-123.

CC @sajarin.

@tuanchris
Copy link
Contributor

tuanchris commented Nov 7, 2022

/test connector=connectors/source-rd-station-marketing

🕑 connectors/source-rd-station-marketing https://github.com/airbytehq/airbyte/actions/runs/3413035179
✅ connectors/source-rd-station-marketing https://github.com/airbytehq/airbyte/actions/runs/3413035179
Python tests coverage:

Name                                      Stmts   Miss  Cover
-------------------------------------------------------------
source_rd_station_marketing/__init__.py       2      0   100%
source_rd_station_marketing/source.py        29      2    93%
source_rd_station_marketing/streams.py       97     17    82%
-------------------------------------------------------------
TOTAL                                       128     19    85%
	 Name                                                 Stmts   Miss  Cover   Missing
	 ----------------------------------------------------------------------------------
	 source_acceptance_test/base.py                          12      4    67%   16-19
	 source_acceptance_test/config.py                       133      3    98%   87, 93, 230
	 source_acceptance_test/conftest.py                     196     92    53%   35, 41-43, 48, 54, 60, 66, 72-74, 93, 98-100, 106-108, 114-115, 120-121, 126, 132, 141-150, 156-161, 176, 200, 231, 237, 243-248, 256-261, 269-282, 287-293, 300-311, 318-334
	 source_acceptance_test/plugin.py                        69     25    64%   22-23, 31, 36, 120-140, 144-148
	 source_acceptance_test/tests/test_core.py              345    110    68%   53, 64-72, 77-84, 88-89, 93-94, 178, 216-233, 242-250, 254-259, 265, 298-303, 341-348, 391-393, 396, 461-469, 481-484, 489, 545-546, 552, 555, 591-601, 614-639
	 source_acceptance_test/tests/test_incremental.py       145     20    86%   21-23, 29-31, 36-43, 48-61, 224
	 source_acceptance_test/utils/asserts.py                 37      2    95%   57-58
	 source_acceptance_test/utils/common.py                  94     10    89%   16-17, 32-38, 72, 75
	 source_acceptance_test/utils/compare.py                 62     23    63%   21-51, 68, 97-99
	 source_acceptance_test/utils/config_migration.py        23     23     0%   5-37
	 source_acceptance_test/utils/connector_runner.py       112     50    55%   23-26, 32, 36, 39-68, 71-73, 76-78, 81-83, 86-88, 91-93, 96-114, 148-150
	 source_acceptance_test/utils/json_schema_helper.py     105     13    88%   30-31, 38, 41, 65-68, 96, 120, 190-192
	 ----------------------------------------------------------------------------------
	 TOTAL                                                 1512    375    75%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: not found in the config.
================= 26 passed, 1 skipped, 27 warnings in 32.33s ==================

@tuanchris
Copy link
Contributor

tuanchris commented Nov 7, 2022

/publish connector=connectors/source-rd-station-marketing

🕑 Publishing the following connectors:
connectors/source-rd-station-marketing
https://github.com/airbytehq/airbyte/actions/runs/3413277602


Connector Did it publish? Were definitions generated?
connectors/source-rd-station-marketing

if you have connectors that successfully published but failed definition generation, follow step 4 here ▶️

@sarafonseca-123
Copy link
Contributor Author

@tuanchris Can you merge this PR? I'm not authorized

@tuanchris
Copy link
Contributor

@sarafonseca-123 I also cannot merge. @sajarin can you help merge this?

@marcosmarxm
Copy link
Member

Hello 👋, first thank you for this amazing contribution.

We really appreciate the effort you've made to improve the project.
We ask you patience for the code review. Last month our team was focused on Hacktoberfest event and that probably left some PR without the proper feedback. And this week, due to the Thanksgiving US Holiday, most our team is out of office with their families. Another important piece of information why code won't be merge this week is: as a safety measure the core team has decided to freeze merging code to main branch to keep the release stable. Next week we'll return to you with the proper code review and update the status of your contribution.

If you have any questions feel free to send me a message in Slack!
Thanks!

@sajarin sajarin added the bounty-M Maintainer program: claimable medium bounty PR label Dec 5, 2022
@sajarin sajarin merged commit c471be2 into airbytehq:master Dec 5, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation bounty bounty-M Maintainer program: claimable medium bounty PR community connectors/source/rd-station-marketing
Projects
No open projects
Development

Successfully merging this pull request may close these issues.

6 participants