Skip to content

Commit

Permalink
New Deployment for Tue Jun 18 04:55:04 UTC 2024
Browse files Browse the repository at this point in the history
  • Loading branch information
actions-user committed Jun 18, 2024
1 parent f31e505 commit 7091664
Show file tree
Hide file tree
Showing 63 changed files with 1,651 additions and 1,627 deletions.
10 changes: 5 additions & 5 deletions docs/guide/data-quality/checks.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ Let's write and modify a check, starting with one of the sdf samples.
Created hello_with_pii/checks/code_check.sql
Created hello_with_pii/src/main.sql
Created hello_with_pii/workspace.sdf.yml
Finished new in 0.187 secs
Finished new in 0.105 secs

</code>
</pre>
Expand Down Expand Up @@ -68,7 +68,7 @@ Working set 1 model file, 1 .sdf file
Compiling hello.pub.main (./src/main.sql)
Working set 1 test file, 1 .sdf file
Testing hello.pub.code_check (./checks/code_check.sql)
Finished 1 model [1 succeeded], 1 check [1 passed] in 1.084 secs
Finished 1 model [1 succeeded], 1 check [1 passed] in 0.996 secs
[Pass] Check hello.pub.code_check

</code>
Expand Down Expand Up @@ -110,7 +110,7 @@ Working set 1 model file, 1 .sdf file
Compiling hello.pub.main (./src/main.sql)
Working set 1 test file, 1 .sdf file
Testing hello.pub.code_check (./checks/code_check.sql)
Finished 1 model [1 succeeded], 1 check [1 failed] in 1.081 secs, for details see below.
Finished 1 model [1 succeeded], 1 check [1 failed] in 1.011 secs, for details see below.

[Fail] Check hello.pub.code_check
+------------+-------------+-------------+
Expand All @@ -121,7 +121,7 @@ Working set 1 test file, 1 .sdf file
1 rows.

-------
Summary 1 model [1 succeeded], 1 check [1 failed] in 1.082 secs.
Summary 1 model [1 succeeded], 1 check [1 failed] in 1.012 secs.
-------

</code>
Expand Down Expand Up @@ -181,7 +181,7 @@ Working set 2 model files, 1 .sdf file
Compiling hello.pub.sink (./src/sink.sql)
Working set 1 test file, 1 .sdf file
Testing hello.pub.code_check (./checks/code_check.sql)
Finished 2 models [2 succeeded], 1 check [1 passed] in 1.088 secs
Finished 2 models [2 succeeded], 1 check [1 passed] in 1.011 secs
[Pass] Check hello.pub.code_check

</code>
Expand Down
28 changes: 14 additions & 14 deletions docs/guide/data-quality/reports.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ Let's write and modify a report, starting with one of the sdf samples.
Created pii_saas_platform/src/internal/users_per_domain.sql
Created pii_saas_platform/src/internal/users_per_org.sql
Created pii_saas_platform/workspace.sdf.yml
Finished new in 0.190 secs
Finished new in 0.101 secs

</code>
</pre>
Expand Down Expand Up @@ -104,18 +104,18 @@ Working set 12 model files, 3 .sdf files
Compiling payment.public.invoices (./ddls/payment/public/invoices.sql)
Compiling payment.public.organizations (./ddls/payment/public/organizations.sql)
Compiling payment.public.users (./ddls/payment/public/users.sql)
Compiling transformations.internal.invoice_payment_delay (./src/internal/invoice_payment_delay.sql)
Compiling transformations.internal.avg_invoice_amt (./src/internal/avg_invoice_amt.sql)
Compiling transformations.internal.total_revenue_per_org (./src/internal/total_revenue_per_org.sql)
Compiling transformations.external.invoice_stats (./src/external/invoice_stats.sql)
Compiling transformations.internal.most_frequent_payer (./src/internal/most_frequent_payer.sql)
Compiling transformations.internal.users_per_org (./src/internal/users_per_org.sql)
Compiling transformations.internal.mau_per_org (./src/internal/mau_per_org.sql)
Compiling transformations.external.org_invoice_stats (./src/external/org_invoice_stats.sql)
Compiling transformations.external.invoice_stats (./src/external/invoice_stats.sql)
Compiling transformations.internal.users_per_domain (./src/internal/users_per_domain.sql)
Compiling transformations.internal.users_per_org (./src/internal/users_per_org.sql)
Compiling transformations.external.org_invoice_stats (./src/external/org_invoice_stats.sql)
Compiling transformations.internal.avg_invoice_amt (./src/internal/avg_invoice_amt.sql)
Compiling transformations.internal.invoice_payment_delay (./src/internal/invoice_payment_delay.sql)
Compiling transformations.internal.most_frequent_payer (./src/internal/most_frequent_payer.sql)
Compiling transformations.internal.total_revenue_per_org (./src/internal/total_revenue_per_org.sql)
Working set 1 report file, 1 .sdf file
Reporting sdf.reports.tables_with_pii (./reports/tables_with_pii.sql)
Finished 12 models [12 succeeded], 1 report [1 succeeded] in 1.636 secs
Finished 12 models [12 succeeded], 1 report [1 succeeded] in 1.573 secs

Report sdf.reports.tables_with_pii
+----------------------------------------------+-------------------------+-----------+
Expand Down Expand Up @@ -155,7 +155,7 @@ Report sdf.reports.tables_with_pii
Working set 12 model files, 3 .sdf files
Working set 1 report file, 1 .sdf file
Reporting sdf.reports.tables_with_pii (./reports/tables_with_pii.sql)
Finished 12 models [12 reused], 1 report [1 succeeded] in 1.405 secs
Finished 12 models [12 reused], 1 report [1 succeeded] in 1.321 secs

Report sdf.reports.tables_with_pii
+----------------------------------------------+--------------+-------------------------+-----------+
Expand Down Expand Up @@ -194,19 +194,19 @@ Report sdf.reports.tables_with_pii
Working set 12 model files, 3 .sdf files
Working set 2 report files, 1 .sdf file
Reporting sdf.reports.pii_datatypes (./reports/pii_datatypes.sql)
Finished 12 models [12 reused], 2 reports [1 succeeded, 1 reused] in 1.415 secs
Finished 12 models [12 reused], 2 reports [1 succeeded, 1 reused] in 1.334 secs

Report sdf.reports.tables_with_pii
+----------------------------------------------+--------------+-------------------------+-----------+
| table_id | column_name | description | dialect |
+----------------------------------------------+--------------+-------------------------+-----------+
| transformations.external.invoice_stats | name | | snowflake |
| payment.public.users | name | DDL for the users table | snowflake |
| transformations.internal.most_frequent_payer | email | | snowflake |
| transformations.external.invoice_stats | email | | snowflake |
| payment.public.users | email | DDL for the users table | snowflake |
| payment.public.users | phone | DDL for the users table | snowflake |
| transformations.internal.users_per_domain | email_domain | | snowflake |
| transformations.external.invoice_stats | name | | snowflake |
| payment.public.users | name | DDL for the users table | snowflake |
| transformations.internal.most_frequent_payer | email | | snowflake |
+----------------------------------------------+--------------+-------------------------+-----------+
7 rows.

Expand Down
6 changes: 3 additions & 3 deletions docs/guide/data-quality/tests.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -156,7 +156,7 @@ table:
Working set 1 model file, 1 test file, 2 .sdf files
Running tests_workspace.pub.raw_inapp_events (./src/raw_inapp_events.sql)
Testing tests_workspace.pub.test_raw_inapp_events (./.sdfcache/dbg/tests/tests_workspace/pub/test_raw_inapp_events.sql)
Finished 1 model [1 succeeded], 1 test [1 passed] in 0.727 secs
Finished 1 model [1 succeeded], 1 test [1 passed] in 0.618 secs
[Pass] Test tests_workspace.pub.test_raw_inapp_events

</code>
Expand Down Expand Up @@ -237,7 +237,7 @@ ORDER BY reason;
<code className='language-error'>
Running tests_workspace.pub.raw_inapp_events (./src/raw_inapp_events.sql)
Testing tests_workspace.pub.test_raw_inapp_events (./.sdfcache/dbg/tests/tests_workspace/pub/test_raw_inapp_events.sql)
Finished 1 model [1 succeeded], 1 test [1 failed] in 0.715 secs, for details see below.
Finished 1 model [1 succeeded], 1 test [1 failed] in 0.615 secs, for details see below.
[Fail] Test tests_workspace.pub.test_raw_inapp_events
+-----------------------------------------------------+
| reason |
Expand All @@ -247,7 +247,7 @@ ORDER BY reason;
1 rows.

-------
Summary 1 model [1 succeeded], 1 test [1 failed] in 0.715 secs.
Summary 1 model [1 succeeded], 1 test [1 failed] in 0.615 secs.
-------

</code>
Expand Down
1 change: 0 additions & 1 deletion docs/guide/install.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,6 @@ Commands:
stats Statistics for your data
report Report code quality
check Check code quality
ai Infer metadata like classifiers and add them optionally to the workspace
lineage Display lineage for a given table and/or column
push Push a local workspace to the SDF Service
system System maintenance, install and update
Expand Down
4 changes: 2 additions & 2 deletions docs/guide/setup/io.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,7 @@ Let's try these options. Start by creating a new SDF workspace with a sample pro
Created lineage/src/sink.sql
Created lineage/src/source.sql
Created lineage/workspace.sdf.yml
Finished new in 0.199 secs
Finished new in 0.104 secs

</code>
</pre>
Expand Down Expand Up @@ -104,7 +104,7 @@ Working set 4 model files, 1 .sdf file
Compiling lineage.pub.middle (./src/middle.sql)
Compiling lineage.pub.knis (./src/knis.sql)
Compiling lineage.pub.sink (./src/sink.sql)
Finished 4 models [4 succeeded] in 0.678 secs
Finished 4 models [4 succeeded] in 0.600 secs

</code>
</pre>
Expand Down
48 changes: 24 additions & 24 deletions docs/integrations/snowflake/basic-materialization.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@ When installing the Cybersyn dataset, make sure to grant the Snowflake role you'
Working set 3 model files, 1 .sdf file
Downloading tech__innovation_essentials.cybersyn.domain_characteristics (schema)
Compiling sdf_snowflake.cybersyn_tech_innovation.active_ai_domains (./src/sdf_snowflake/cybersyn_tech_innovation/active_ai_domains.sql)
Finished 2 models [1 succeeded, 1 downloaded] in 2.269 secs
Finished 2 models [1 succeeded, 1 downloaded] in 2.066 secs

Schema sdf_snowflake.cybersyn_tech_innovation.active_ai_domains
┌─────────────┬───────────┬────────────┬─────────────┐
Expand Down Expand Up @@ -164,7 +164,7 @@ Schema sdf_snowflake.cybersyn_tech_innovation.active_ai_domains
Working set 4 model files, 1 .sdf file
Downloading tech__innovation_essentials.cybersyn.github_repos (schema)
Compiling sdf_snowflake.staging.latest_repo_name (./src/sdf_snowflake/staging/latest_repo_name.sql)
Finished 2 models [1 succeeded, 1 downloaded] in 2.194 secs
Finished 2 models [1 succeeded, 1 downloaded] in 2.101 secs

Schema sdf_snowflake.staging.latest_repo_name
┌─────────────┬────────────────┬────────────┬─────────────┐
Expand Down Expand Up @@ -206,23 +206,23 @@ Schema sdf_snowflake.staging.latest_repo_name
Working set 4 model files, 1 .sdf file
Downloading tech__innovation_essentials.cybersyn.github_repos (schema)
Running sdf_snowflake.staging.latest_repo_name (./src/sdf_snowflake/staging/latest_repo_name.sql)
Finished 2 models [1 succeeded, 1 downloaded] in 6.314 secs
Finished 2 models [1 succeeded, 1 downloaded] in 7.371 secs

Table sdf_snowflake.staging.latest_repo_name
+-------------------------------------------+-----------+
| repo_name | repo_id |
+-------------------------------------------+-----------+
| Shahdev32/RESTFULL_API | 816029978 |
| ValeryEgorova/RPJ_paper | 816005045 |
| Rock257/MovieApp | 815781589 |
| minder-smoke-tests/smoke-test-python-7769 | 815939449 |
| direwolf-github/ephemeral-ci-8badbef5 | 815763023 |
| dropmode/springbootdemo | 815808238 |
| minder-smoke-tests/smoke-test-go-7652 | 815902724 |
| cypher3107/blogs.github.io | 815797222 |
| iGNSS/GNSS-INS | 815464452 |
| manikanta569/Responsive_website | 815995997 |
+-------------------------------------------+-----------+
┌───────────────────────────────────────────────────────────────┬───────────┐
repo_name repo_id
╞═══════════════════════════════════════════════════════════════╪═══════════╡
│ Juan-Ayme/sistema-ventas ┆ 816051657 │
│ samaresh77/Authentication ┆ 815944720 │
│ devhub-blue-sea-sa-east-1/org-public-empty-csc-repo-sa-east-1 ┆ 816009773 │
│ barbartoto03/ak7 ┆ 815932878 │
│ minder-smoke-tests/smoke-test-rust-11913 ┆ 815971978 │
│ Dejanimitrijevic/silver-dejan-test ┆ 816021943 │
│ egeoztass/Product-Service-API ┆ 643674560 │
│ amitrajputfff/Insect-Catching-Game ┆ 816035221 │
│ CatBoxs/Cat_tv ┆ 815754969 │
│ nasrindbd/reg ┆ 815943253 │
└───────────────────────────────────────────────────────────────┴───────────┘
10 rows.

</code>
Expand Down Expand Up @@ -270,7 +270,7 @@ Table sdf_snowflake.staging.latest_repo_name
Working set 5 model files, 1 .sdf file
Downloading tech__innovation_essentials.cybersyn.github_events (schema)
Compiling sdf_snowflake.staging.push_events (./src/sdf_snowflake/staging/push_events.sql)
Finished 2 models [1 succeeded, 1 downloaded] in 2.216 secs
Finished 2 models [1 succeeded, 1 downloaded] in 2.247 secs

Schema sdf_snowflake.staging.push_events
┌─────────────┬────────────────┬────────────┬─────────────┐
Expand Down Expand Up @@ -334,20 +334,20 @@ Schema sdf_snowflake.staging.push_events
<pre style={{ fontFamily: 'monospace' }} className='language-shell'>
<code className='language-shell'>
Working set 6 model files, 1 .sdf file
Downloading tech__innovation_essentials.cybersyn.uspto_contributor_index (schema)
Downloading tech__innovation_essentials.cybersyn.github_stars (schema)
Downloading tech__innovation_essentials.cybersyn.github_repos (schema)
Downloading tech__innovation_essentials.cybersyn.uspto_patent_contributor_relationships (schema)
Downloading tech__innovation_essentials.cybersyn.github_events (schema)
Downloading tech__innovation_essentials.cybersyn.uspto_patent_index (schema)
Downloading tech__innovation_essentials.cybersyn.domain_characteristics (schema)
Downloading tech__innovation_essentials.cybersyn.github_repos (schema)
Downloading tech__innovation_essentials.cybersyn.uspto_patent_contributor_relationships (schema)
Downloading tech__innovation_essentials.cybersyn.uspto_contributor_index (schema)
Compiling sdf_snowflake.staging.latest_repo_name (./src/sdf_snowflake/staging/latest_repo_name.sql)
Compiling sdf_snowflake.cybersyn_tech_innovation.most_starred_repos (./src/sdf_snowflake/cybersyn_tech_innovation/most_starred_repos.sql)
Compiling sdf_snowflake.staging.push_events (./src/sdf_snowflake/staging/push_events.sql)
Compiling sdf_snowflake.cybersyn_tech_innovation.all_nvidia_patents (./src/sdf_snowflake/cybersyn_tech_innovation/all_nvidia_patents.sql)
Compiling sdf_snowflake.cybersyn_tech_innovation.active_ai_domains (./src/sdf_snowflake/cybersyn_tech_innovation/active_ai_domains.sql)
Compiling sdf_snowflake.staging.latest_repo_name (./src/sdf_snowflake/staging/latest_repo_name.sql)
Compiling sdf_snowflake.staging.push_events (./src/sdf_snowflake/staging/push_events.sql)
Compiling sdf_snowflake.cybersyn_tech_innovation.events_by_repo (./src/sdf_snowflake/cybersyn_tech_innovation/events_by_repo.sql)
Finished 13 models [6 succeeded, 7 downloaded] in 2.399 secs
Finished 13 models [6 succeeded, 7 downloaded] in 2.274 secs

</code>
</pre>
Expand Down
8 changes: 4 additions & 4 deletions docs/integrations/snowflake/incremental-materialization.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ When installing the Cybersyn dataset, make sure to grant the Snowflake role you'
Working set 3 model files, 1 .sdf file
Downloading tech__innovation_essentials.cybersyn.domain_characteristics (schema)
Compiling sdf_snowflake.cybersyn_tech_innovation.active_ai_domains (./src/sdf_snowflake/cybersyn_tech_innovation/active_ai_domains.sql)
Finished 2 models [1 succeeded, 1 downloaded] in 2.323 secs
Finished 2 models [1 succeeded, 1 downloaded] in 2.244 secs

Schema sdf_snowflake.cybersyn_tech_innovation.active_ai_domains
┌─────────────┬───────────┬────────────┬─────────────┐
Expand Down Expand Up @@ -128,7 +128,7 @@ Working set 4 model files, 1 .sdf file
Downloading sdf_snowflake.staging.datafusion_push_events (exists_remotely)
Downloading tech__innovation_essentials.cybersyn.github_events (schema)
Compiling sdf_snowflake.staging.datafusion_push_events (./src/sdf_snowflake/staging/datafusion_push_events.sql)
Finished 2 models [1 succeeded, 1 downloaded] in 3.258 secs
Finished 2 models [1 succeeded, 1 downloaded] in 3.231 secs

Schema sdf_snowflake.staging.datafusion_push_events
┌────────────────────────────────┬────────────────┬────────────┬─────────────┐
Expand Down Expand Up @@ -350,12 +350,12 @@ Schema sdf_snowflake.staging.datafusion_push_events
<pre style={{ fontFamily: 'monospace' }} className='language-shell'>
<code className='language-shell'>
Working set 5 model files, 1 .sdf file
Downloading sdf_snowflake.staging.github_push_events (exists_remotely)
Downloading sdf_snowflake.cybersyn_tech_innovation.top_datafusion_contributors (exists_remotely)
Downloading sdf_snowflake.staging.github_push_events (exists_remotely)
Downloading tech__innovation_essentials.cybersyn.github_events (schema)
Compiling sdf_snowflake.staging.datafusion_push_events (./src/sdf_snowflake/staging/datafusion_push_events.sql)
Compiling sdf_snowflake.cybersyn_tech_innovation.top_datafusion_contributors (./src/sdf_snowflake/cybersyn_tech_innovation/top_datafusion_contributors.sql)
Finished 3 models [2 succeeded, 1 downloaded] in 3.552 secs
Finished 3 models [2 succeeded, 1 downloaded] in 3.182 secs

Schema sdf_snowflake.cybersyn_tech_innovation.top_datafusion_contributors
┌─────────────────────┬────────────────┬────────────┬─────────────┐
Expand Down
Loading

0 comments on commit 7091664

Please sign in to comment.