Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HOT FIX: example notebook update #584

Merged
merged 10 commits into from
Aug 8, 2022
Merged

HOT FIX: example notebook update #584

Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
629ddb7
test
taylorfturner Jul 19, 2022
7d93643
test
taylorfturner Jul 19, 2022
87e179b
test
taylorfturner Jul 19, 2022
d2c8496
test
taylorfturner Jul 19, 2022
50dee4e
test
taylorfturner Jul 19, 2022
11abfe3
test
taylorfturner Jul 19, 2022
9bdb4d4
notebook update
taylorfturner Aug 8, 2022
dc8e71d
clear cell output
taylorfturner Aug 8, 2022
8637054
typo
taylorfturner Aug 8, 2022
2a75360
rename
taylorfturner Aug 8, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
39 changes: 36 additions & 3 deletions examples/merge_profile_list_example.ipynb → examples/merge_profile_list.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,11 +1,23 @@
{
"cells": [
{
"cell_type": "markdown",
"id": "60af5256",
"metadata": {},
"source": [
"# Overview\n",
"\n",
"This is an example of a new utils in the dataprofiler for distributed merging of profile objects. This assumes the user is providing a list of profile objects to the utils function for merging all the profiles together."
]
},
{
"cell_type": "markdown",
"id": "7eee37ff",
"metadata": {},
"source": [
"# Imports"
"# Imports\n",
"\n",
"Let's start by importing the necessary packages..."
]
},
{
Expand Down Expand Up @@ -47,7 +59,10 @@
"id": "410c3c4d",
"metadata": {},
"source": [
"This section shows the basic example of the Data Profiler. A CSV dataset is read using the data reader, then the Data object is given to the Data Profiler to detect sensitive data and obtain the statistics."
"This section shows the basic example of the Data Profiler. \n",
"\n",
"1. Instantiate a Pandas dataframe with dummy data\n",
"2. Pass the dataframe to the `Profiler` and instantiate two separate profilers in a list"
]
},
{
Expand All @@ -63,6 +78,14 @@
"list_of_profiles = [dp.Profiler(df), dp.Profiler(df)]"
]
},
{
"cell_type": "markdown",
"id": "350502eb",
"metadata": {},
"source": [
"Take a look at the list of profiles... "
]
},
{
"cell_type": "code",
"execution_count": null,
Expand All @@ -78,7 +101,9 @@
"id": "4ed4fc12",
"metadata": {},
"source": [
"## Run Merge on List of Profiles"
"## Run Merge on List of Profiles\n",
"\n",
"Now let's merge the list of profiles into a `single_profile`"
]
},
{
Expand All @@ -91,6 +116,14 @@
"single_profile = merge_profile_list(list_of_profiles=list_of_profiles)"
]
},
{
"cell_type": "markdown",
"id": "0aa88720",
"metadata": {},
"source": [
"And check out the `.report` on the single profile:"
]
},
{
"cell_type": "code",
"execution_count": null,
Expand Down