Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Import files abs to snflk #1

Merged
merged 45 commits into from
Nov 11, 2019
Merged

Import files abs to snflk #1

merged 45 commits into from
Nov 11, 2019

Conversation

yustme
Copy link
Collaborator

@yustme yustme commented Sep 5, 2019

  • copy single file to SNFLK
  • copy sliced file to SNFLK
  • export table from SNFLK to ABS
  • setup Travis testing environment
  • incremental loads
  • duplicate all tests from php-db-import

@yustme yustme requested a review from Halama September 10, 2019 14:02
@yustme yustme self-assigned this Sep 10, 2019
@Halama
Copy link
Member

Halama commented Sep 11, 2019

jdu to kouknout

Copy link
Member

@Halama Halama left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nahodil jsem si to ale zatím z toho asi fakt moc nevykoukám začátek imho dobrý. Počkal bych až to bude implemenovat celý ten importní flow. Zajímalo by mě jak to bude pak řešeno architektonicky, doteď to bylo přes https://refactoring.guru/design-patterns/template-method ale pak se to tam trochu zkomplikovalo více typy CSV importů.

@zajca zajca self-assigned this Oct 30, 2019
@zajca
Copy link
Member

zajca commented Nov 4, 2019

Import jako ze souboru tak ze snowflake by měl být funkční. Teď "nakopíruju" ty testy z púvodní lib, jak to bude fakčit tak dodělám unit testy a pustím sa do exportu.

@zajca
Copy link
Member

zajca commented Nov 5, 2019

@Halama kdybys měl chvilku mrkni prosím tady na skipped testy jestli je ok to co sem všechno vyhodil.
https://github.com/keboola/php-db-import-export/blob/31644a0f2d0661ab75291bd4d4510117941aa136/tests/Snowflake/OtherImportTest.php

@zajca
Copy link
Member

zajca commented Nov 5, 2019

Asi bych to hodil RfR a nechal export do vlastního PR. Už tak je to mega velké.

@zajca zajca marked this pull request as ready for review November 5, 2019 17:15
@zajca zajca requested a review from Halama November 5, 2019 20:21
@Halama
Copy link
Member

Halama commented Nov 6, 2019

Zkusím to dnes nebo zítra zkouknout.

@Halama
Copy link
Member

Halama commented Nov 8, 2019

Jdu na to mrknout.

Copy link
Member

@Halama Halama left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Vypadá to super, nebál bych se to releasnout. Doladí se to při integraci do KBC v separátních PR kdyby se něco objevilo. Pořád platí že do KBC se tenhle nový importer bude v první fázi používat jenom pro ABS importy ze SNFLK takže by nemělo hrozit že to rozbije něco existujícího. viz. https://github.com/keboola/connection/issues/2015

Copy link
Member

@Halama Halama left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Potvrzuju že po tom fixu už ma jedou všechny testy i lokálně.

@zajca zajca merged commit a965b01 into master Nov 11, 2019
@Halama Halama deleted the vojta-azure-snowflake branch March 23, 2020 11:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants