Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CDC partial reset acceptance test #14551

Merged
merged 16 commits into from
Jul 15, 2022
Merged

CDC partial reset acceptance test #14551

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
7d279ec
set per stream feature flag to true for testing
lmossman Jul 8, 2022
3d8bbc1
add a second table to cdc acceptance tests
lmossman Jul 9, 2022
f18219f
add partial reset test
lmossman Jul 9, 2022
40bce5f
format
lmossman Jul 9, 2022
9d03150
add partial reset cdc tests
lmossman Jul 11, 2022
628d50a
test incremental after partial reset
lmossman Jul 11, 2022
92f4fc3
remove dev image from acceptance test
lmossman Jul 12, 2022
e23e220
fix flag and add comment
lmossman Jul 12, 2022
db4951b
Revert "set per stream feature flag to true for testing"
lmossman Jul 14, 2022
9adc47c
set USE_STREAM_CAPABLE_STATE flag to true in acceptance test script
lmossman Jul 14, 2022
2745cf4
call new update endpoint
lmossman Jul 14, 2022
a8f2f87
use methods in test harness instead
lmossman Jul 14, 2022
7e9daf0
remove comment
lmossman Jul 14, 2022
2d6d3c7
format
lmossman Jul 14, 2022
6972f9b
fix state check in basic acceptance test
lmossman Jul 15, 2022
f8fbefe
use test info for test name logging
lmossman Jul 15, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 6 additions & 2 deletions airbyte-tests/src/acceptanceTests/java/io/airbyte/test/acceptance/BasicAcceptanceTests.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -797,7 +797,7 @@ public void testSyncAfterUpgradeToPerStreamState(final TestInfo testInfo) throws

// sync one more time. verify it is the equivalent of a full refresh.
final String expectedState =
"{\"cdc\":false,\"streams\":[{\"cursor\":\"6\",\"stream_name\":\"id_and_name\",\"cursor_field\":[\"id\"],\"stream_namespace\":\"public\"}]}";
"{\"cursor\":\"6\",\"stream_name\":\"id_and_name\",\"cursor_field\":[\"id\"],\"stream_namespace\":\"public\"}";
LOGGER.info("Starting {} sync 3", testInfo.getDisplayName());
final JobInfoRead connectionSyncRead3 =
apiClient.getConnectionApi().syncConnection(new ConnectionIdRequestBody().connectionId(connectionId));
Expand All @@ -806,7 +806,11 @@ public void testSyncAfterUpgradeToPerStreamState(final TestInfo testInfo) throws
LOGGER.info("state after sync 3: {}", state);

testHarness.assertSourceAndDestinationDbInSync(WITHOUT_SCD_TABLE);
assertEquals(Jsons.deserialize(expectedState), state.getState());
assertNotNull(state.getStreamState());
assertEquals(1, state.getStreamState().size());
final StreamState idAndNameState = state.getStreamState().get(0);
assertEquals(new StreamDescriptor().namespace("public").name(STREAM_NAME), idAndNameState.getStreamDescriptor());
assertEquals(Jsons.deserialize(expectedState), idAndNameState.getStreamState());
}

@Test
Expand Down
Loading