Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Source Confluence, Source Greenhouse, Source Hubspot, Source Stripe, Source Close com, Source Klaviyo, Source Notion, Source Pinterest, Source Snapchat Marketin, Source S3, Source Airtable and Source Posthog: fix builds #27135

Merged
merged 7 commits into from
Jun 9, 2023

Conversation

lazebnyi
Copy link
Collaborator

@lazebnyi lazebnyi commented Jun 7, 2023

What

Fix builds for:

  • Source Confluence. Expected and actual records mismatch: pages stream records changed html code.
  • Source Greenhouse. Expected and actual records mismatch: only updated_at field changed when was opened post for editing.
  • Source Hubspot. Expected and actual records mismatch: hubspot time depend on current time.
  • Source Stripe. Expected and actual records mismatch: invoice changed from draft to paid.
  • Source Close.com. Expected and actual records mismatch: event expired and created activities return records randomly.
  • Source Klaviyo. Expected and actual records mismatch: email templates expired.
  • Source Notion. Expected and actual records mismatch: changed emoji in database.
  • Source Pinterest. Expected and actual records mismatch: board pins records order changed.
  • Source Snapchat Marketing. Expected and actual records mismatch: one of adaccount deleted.
  • Source Posthog. _get_request_options required auth_options_method .
  • Source Airtable. Expired refresh token.
  • Source S3. Wrong test credentials.

How

  • Source Confluence: update expected records.
  • Source Greenhouse: update expected records.
  • Source Hubspot: update expected records.
  • Source Stripe: update expected records.
  • Source Close.com: update expected records.
  • Source Klaviyo: update expected records.
  • Source Notion: update expected records.
  • Source Pinterest: update expected records.
  • Source Snapchat Marketing: update expected records.
  • Source Posthog: added auth_options_method to custom commponent.
  • Source Airtable. updated test credentials.
  • Source S3. updated test credentials.

@octavia-squidington-iii octavia-squidington-iii added the area/connectors Connector related issues label Jun 7, 2023
@github-actions
Copy link
Contributor

github-actions bot commented Jun 7, 2023

Before Merging a Connector Pull Request

Wow! What a great pull request you have here! 🎉

To merge this PR, ensure the following has been done/considered for each connector added or updated:

  • PR name follows PR naming conventions
  • Breaking changes are considered. If a Breaking Change is being introduced, ensure an Airbyte engineer has created a Breaking Change Plan and you've followed all steps in the Breaking Changes Checklist
  • Connector version has been incremented in the Dockerfile and metadata.yaml according to our Semantic Versioning for Connectors guidelines
  • Secrets in the connector's spec are annotated with airbyte_secret
  • All documentation files are up to date. (README.md, bootstrap.md, docs.md, etc...)
  • Changelog updated in docs/integrations/<source or destination>/<name>.md with an entry for the new version. See changelog example
  • You, or an Airbyter, have run /test successfully on this PR - or on a non-forked branch
  • You've updated the connector's metadata.yaml file (new!)

If the checklist is complete, but the CI check is failing,

  1. Check for hidden checklists in your PR description

  2. Toggle the github label checklist-action-run on/off to re-run the checklist CI.

@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 7, 2023

/test connector=connectors/source-confluence

🕑 connectors/source-confluence https://github.com/airbytehq/airbyte/actions/runs/5205750357
✅ connectors/source-confluence https://github.com/airbytehq/airbyte/actions/runs/5205750357
Python tests coverage:

Name                            Stmts   Miss  Cover
---------------------------------------------------
source_confluence/__init__.py       2      0   100%
source_confluence/source.py        94      3    97%
---------------------------------------------------
TOTAL                              96      3    97%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: not found in the config.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
======================== 35 passed, 4 skipped in 39.28s ========================

@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 7, 2023

/test connector=connectors/source-greenhouse

🕑 connectors/source-greenhouse https://github.com/airbytehq/airbyte/actions/runs/5205753628
✅ connectors/source-greenhouse https://github.com/airbytehq/airbyte/actions/runs/5205753628
Python tests coverage:

Name                              Stmts   Miss  Cover
-----------------------------------------------------
source_greenhouse/source.py           4      0   100%
source_greenhouse/__init__.py         2      0   100%
source_greenhouse/components.py      68      5    93%
-----------------------------------------------------
TOTAL                                74      5    93%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [2] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [2] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
================== 47 passed, 5 skipped in 312.62s (0:05:12) ===================

@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 7, 2023

/test connector=connectors/source-hubspot

🕑 connectors/source-hubspot https://github.com/airbytehq/airbyte/actions/runs/5205754076
✅ connectors/source-hubspot https://github.com/airbytehq/airbyte/actions/runs/5205754076
Python tests coverage:

Name                          Stmts   Miss  Cover
-------------------------------------------------
source_hubspot/errors.py         10      0   100%
source_hubspot/constants.py       2      0   100%
source_hubspot/__init__.py        2      0   100%
source_hubspot/helpers.py        70      3    96%
source_hubspot/streams.py       971     85    91%
source_hubspot/source.py         67     20    70%
-------------------------------------------------
TOTAL                          1122    108    90%
Name                          Stmts   Miss  Cover
-------------------------------------------------
source_hubspot/constants.py       2      0   100%
source_hubspot/__init__.py        2      0   100%
source_hubspot/helpers.py        70      7    90%
source_hubspot/errors.py         10      1    90%
source_hubspot/source.py         67     14    79%
source_hubspot/streams.py       971    230    76%
-------------------------------------------------
TOTAL                          1122    252    78%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
================== 42 passed, 3 skipped in 411.22s (0:06:51) ===================

@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 7, 2023

/test connector=connectors/source-stripe

🕑 connectors/source-stripe https://github.com/airbytehq/airbyte/actions/runs/5205756387
✅ connectors/source-stripe https://github.com/airbytehq/airbyte/actions/runs/5205756387
Python tests coverage:

Name                                     Stmts   Miss  Cover
------------------------------------------------------------
source_stripe/source.py                     22      0   100%
source_stripe/__init__.py                    2      0   100%
source_stripe/availability_strategy.py      19      2    89%
source_stripe/streams.py                   351     37    89%
------------------------------------------------------------
TOTAL                                      394     39    90%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
================== 38 passed, 3 skipped in 291.94s (0:04:51) ===================

@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 8, 2023

/test connector=connectors/source-confluence

🕑 connectors/source-confluence https://github.com/airbytehq/airbyte/actions/runs/5215889209
✅ connectors/source-confluence https://github.com/airbytehq/airbyte/actions/runs/5215889209
Python tests coverage:

Name                            Stmts   Miss  Cover
---------------------------------------------------
source_confluence/__init__.py       2      0   100%
source_confluence/source.py        94      3    97%
---------------------------------------------------
TOTAL                              96      3    97%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: not found in the config.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
======================== 35 passed, 4 skipped in 44.94s ========================

@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 8, 2023

/test connector=connectors/source-greenhouse

@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 8, 2023

/test connector=connectors/source-hubspot

🕑 connectors/source-hubspot https://github.com/airbytehq/airbyte/actions/runs/5215891098
✅ connectors/source-hubspot https://github.com/airbytehq/airbyte/actions/runs/5215891098
Python tests coverage:

Name                          Stmts   Miss  Cover
-------------------------------------------------
source_hubspot/errors.py         10      0   100%
source_hubspot/constants.py       2      0   100%
source_hubspot/__init__.py        2      0   100%
source_hubspot/helpers.py        70      3    96%
source_hubspot/streams.py       971     85    91%
source_hubspot/source.py         67     20    70%
-------------------------------------------------
TOTAL                          1122    108    90%
Name                          Stmts   Miss  Cover
-------------------------------------------------
source_hubspot/constants.py       2      0   100%
source_hubspot/__init__.py        2      0   100%
source_hubspot/helpers.py        70      7    90%
source_hubspot/errors.py         10      1    90%
source_hubspot/source.py         67     14    79%
source_hubspot/streams.py       971    228    77%
-------------------------------------------------
TOTAL                          1122    250    78%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
================== 42 passed, 3 skipped in 627.46s (0:10:27) ===================

@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 8, 2023

/test connector=connectors/source-stripe

🕑 connectors/source-stripe https://github.com/airbytehq/airbyte/actions/runs/5215891432
✅ connectors/source-stripe https://github.com/airbytehq/airbyte/actions/runs/5215891432
Python tests coverage:

Name                                     Stmts   Miss  Cover
------------------------------------------------------------
source_stripe/source.py                     22      0   100%
source_stripe/__init__.py                    2      0   100%
source_stripe/availability_strategy.py      19      2    89%
source_stripe/streams.py                   351     37    89%
------------------------------------------------------------
TOTAL                                      394     39    90%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
================== 38 passed, 3 skipped in 366.52s (0:06:06) ===================

@lazebnyi lazebnyi changed the title Source Confluence, Source Greenhouse, Source Hubspot, Source Stripe: fix builds Source Confluence, Source Greenhouse, Source Hubspot, Source Stripe, Source Close com, Source Klaviyo, Source Notion, Source Pinterest and Source Snapchat Marketing: fix builds Jun 8, 2023
@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 8, 2023

/test connector=connectors/source-close-com

🕑 connectors/source-close-com https://github.com/airbytehq/airbyte/actions/runs/5216366275
✅ connectors/source-close-com https://github.com/airbytehq/airbyte/actions/runs/5216366275
No Python unittests run

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
================== 39 passed, 2 skipped in 348.04s (0:05:48) ===================

@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 8, 2023

/test connector=connectors/source-snapchat-marketing

🕑 connectors/source-snapchat-marketing https://github.com/airbytehq/airbyte/actions/runs/5216368432
✅ connectors/source-snapchat-marketing https://github.com/airbytehq/airbyte/actions/runs/5216368432
Python tests coverage:

Name                                    Stmts   Miss  Cover
-----------------------------------------------------------
source_snapchat_marketing/__init__.py       2      0   100%
source_snapchat_marketing/source.py       284     22    92%
-----------------------------------------------------------
TOTAL                                     286     22    92%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
================== 43 passed, 3 skipped in 373.77s (0:06:13) ===================

@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 8, 2023

/test connector=connectors/source-notion

🕑 connectors/source-notion https://github.com/airbytehq/airbyte/actions/runs/5216369325
✅ connectors/source-notion https://github.com/airbytehq/airbyte/actions/runs/5216369325
Python tests coverage:

Name                        Stmts   Miss  Cover
-----------------------------------------------
source_notion/__init__.py       2      0   100%
source_notion/streams.py      164     10    94%
source_notion/source.py        37      5    86%
source_notion/utils.py          9      4    56%
-----------------------------------------------
TOTAL                         212     19    91%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
================== 39 passed, 3 skipped in 124.90s (0:02:04) ===================

@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 8, 2023

/test connector=connectors/source-klaviyo

🕑 connectors/source-klaviyo https://github.com/airbytehq/airbyte/actions/runs/5216370121
✅ connectors/source-klaviyo https://github.com/airbytehq/airbyte/actions/runs/5216370121
Python tests coverage:

Name                         Stmts   Miss  Cover
------------------------------------------------
source_klaviyo/__init__.py       2      0   100%
source_klaviyo/streams.py      207     36    83%
source_klaviyo/source.py        16      3    81%
------------------------------------------------
TOTAL                          225     39    83%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
================== 39 passed, 3 skipped in 103.42s (0:01:43) ===================

@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 8, 2023

/test connector=connectors/source-pinterest

🕑 connectors/source-pinterest https://github.com/airbytehq/airbyte/actions/runs/5216371243
✅ connectors/source-pinterest https://github.com/airbytehq/airbyte/actions/runs/5216371243
Python tests coverage:

Name                           Stmts   Miss  Cover
--------------------------------------------------
source_pinterest/utils.py          8      0   100%
source_pinterest/__init__.py       2      0   100%
source_pinterest/source.py       229     17    93%
--------------------------------------------------
TOTAL                            239     17    93%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [2] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [2] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
================== 47 passed, 5 skipped in 220.41s (0:03:40) ===================

@lazebnyi lazebnyi changed the title Source Confluence, Source Greenhouse, Source Hubspot, Source Stripe, Source Close com, Source Klaviyo, Source Notion, Source Pinterest and Source Snapchat Marketing: fix builds Source Confluence, Source Greenhouse, Source Hubspot, Source Stripe, Source Close com, Source Klaviyo, Source Notion, Source Pinterest, Source Snapchat Marketing and Source S3: fix builds Jun 9, 2023
@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 9, 2023

/test connector=connectors/source-airtable

🕑 connectors/source-airtable https://github.com/airbytehq/airbyte/actions/runs/5216957853
✅ connectors/source-airtable https://github.com/airbytehq/airbyte/actions/runs/5216957853
Python tests coverage:

Name                                Stmts   Miss  Cover
-------------------------------------------------------
source_airtable/__init__.py             2      0   100%
source_airtable/streams.py             92      1    99%
source_airtable/source.py              53      3    94%
source_airtable/schema_helpers.py      48      9    81%
source_airtable/auth.py                21     10    52%
-------------------------------------------------------
TOTAL                                 216     23    89%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: Incremental syncs are not supported on this connector.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [2] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [2] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
============= 48 passed, 6 skipped, 1 warning in 123.08s (0:02:03) =============

@lazebnyi lazebnyi changed the title Source Confluence, Source Greenhouse, Source Hubspot, Source Stripe, Source Close com, Source Klaviyo, Source Notion, Source Pinterest, Source Snapchat Marketing and Source S3: fix builds Source Confluence, Source Greenhouse, Source Hubspot, Source Stripe, Source Close com, Source Klaviyo, Source Notion, Source Pinterest, Source Snapchat Marketin, Source S3, Source Airtable and Source Posthog: fix builds Jun 9, 2023
@octavia-squidington-iii octavia-squidington-iii added the area/documentation Improvements or additions to documentation label Jun 9, 2023
@lazebnyi
Copy link
Collaborator Author

lazebnyi commented Jun 9, 2023

/test connector=connectors/source-s3

🕑 connectors/source-s3 https://github.com/airbytehq/airbyte/actions/runs/5217053207
✅ connectors/source-s3 https://github.com/airbytehq/airbyte/actions/runs/5217053207
Python tests coverage:

Name                                                              Stmts   Miss  Cover
-------------------------------------------------------------------------------------
source_s3/source_files_abstract/storagefile.py                       23      0   100%
source_s3/source_files_abstract/spec.py                              55      0   100%
source_s3/source_files_abstract/formats/parquet_spec.py               9      0   100%
source_s3/source_files_abstract/formats/jsonl_spec.py                13      0   100%
source_s3/source_files_abstract/formats/csv_spec.py                  16      0   100%
source_s3/source_files_abstract/formats/avro_spec.py                  5      0   100%
source_s3/source.py                                                  28      0   100%
source_s3/exceptions.py                                              10      0   100%
source_s3/__init__.py                                                 2      0   100%
source_s3/source_files_abstract/formats/parquet_parser.py            74      3    96%
source_s3/source_files_abstract/formats/abstract_file_parser.py      44      3    93%
source_s3/s3file.py                                                  41      3    93%
source_s3/stream.py                                                  50      4    92%
source_s3/source_files_abstract/formats/jsonl_parser.py              56      6    89%
source_s3/source_files_abstract/file_info.py                         26      3    88%
source_s3/source_files_abstract/formats/avro_parser.py               47      6    87%
source_s3/source_files_abstract/formats/csv_parser.py               137     18    87%
source_s3/source_files_abstract/stream.py                           198     33    83%
source_s3/source_files_abstract/source.py                            41      7    83%
source_s3/s3_utils.py                                                20      4    80%
source_s3/utils.py                                                   31     10    68%
-------------------------------------------------------------------------------------
TOTAL                                                               926    100    89%
Name                                                              Stmts   Miss  Cover
-------------------------------------------------------------------------------------
source_s3/source_files_abstract/formats/parquet_spec.py               9      0   100%
source_s3/source_files_abstract/formats/jsonl_spec.py                13      0   100%
source_s3/source_files_abstract/formats/csv_spec.py                  16      0   100%
source_s3/source_files_abstract/formats/avro_spec.py                  5      0   100%
source_s3/__init__.py                                                 2      0   100%
source_s3/source_files_abstract/storagefile.py                       23      1    96%
source_s3/stream.py                                                  50      3    94%
source_s3/s3file.py                                                  41      3    93%
source_s3/source_files_abstract/stream.py                           198     18    91%
source_s3/source_files_abstract/formats/abstract_file_parser.py      44      5    89%
source_s3/source.py                                                  28      4    86%
source_s3/s3_utils.py                                                20      4    80%
source_s3/source_files_abstract/file_info.py                         26      8    69%
source_s3/source_files_abstract/formats/csv_parser.py               137     43    69%
source_s3/utils.py                                                   31     10    68%
source_s3/exceptions.py                                              10      4    60%
source_s3/source_files_abstract/source.py                            41     19    54%
source_s3/source_files_abstract/spec.py                              55     31    44%
source_s3/source_files_abstract/formats/jsonl_parser.py              56     33    41%
source_s3/source_files_abstract/formats/parquet_parser.py            74     48    35%
source_s3/source_files_abstract/formats/avro_parser.py               47     32    32%
-------------------------------------------------------------------------------------
TOTAL                                                               926    266    71%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [5] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [5] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
================= 100 passed, 11 skipped in 491.66s (0:08:11) ==================

@lazebnyi lazebnyi merged commit da67a60 into master Jun 9, 2023
@lazebnyi lazebnyi deleted the lazebnyi/16-fix-connector-health-build branch June 9, 2023 01:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment