Privacy 2024 queries

[max-ostapenko]

Analysis plan details

Queries

Bounce tracking:

• number_of_websites_with_bounce_tracking.sql

CNAME

• most_common_cname_domains.sql

IAB consent frameworks:

• most_common_countries_for_iab_tcf_v2.sql
• most_common_referrer_policy.sql
• most_common_strings_for_iab_usp.sql
• number_of_websites_with_iab.sql

GPC prevalence:

• number_of_websites_with_gpc.sql

CMPs presence

• most_common_cmps_for_iab_tcf_v2.sql

ads.txt & sellers.json:

• ads_and_sellers_graph.sql
• ads_lines_amount.sql
• ads_seller_accounts_by_type.sql
• common_ads_variables.sql
• top_direct_sellers.sql

Privacy Sandbox:

• number_of_websites_with_related_origin_trials.sql
• privacy-sandbox-adoption-by-third-parties-by-publishers.sql
• number_of_privacy_sandbox_attested_domains.sql
• number_of_ara_destinations_registered_by_third_parties_and_publishers.sql
• top_ara_destinations_registered_by_most_publishers.sql
• top_ara_destinations_registered_by_most_third_parties.sql

CCPA:

• ccpa_most_common_phrases.sql
• ccpa_prevalence.sql

Fingerprinting:

• fingerprinting_most_common_apis.sql
• fingerprinting_most_common_scripts.sql
• fingerprinting_script_count.sql

Cookies:

• cookies_top_first_party.sql
• cookies_top_third_party.sql

Other:

• number_of_websites_with_dnt.sql
• most_common_client_hints.sql
• number_of_websites_per_tracking_technology.sql
• number_of_websites_with_client_hints.sql
• number_of_websites_with_privacy_service.sql
• number_of_websites_with_referrerpolicy.sql
• number_of_websites_with_related_origin_trials.sql
• number_of_websites_with_whotracksme_trackers.sql
• easylist_tracker_detection.sql

Functions

• httparchive.fn.DECODE_ORIGIN_TRIAL
• httparchive.fn.PARSE_ORIGIN_TRIAL

Scripts

• ads_parser.py - Parse and evaluate Google's ads.txt that weights >=100 MB
• populate_easylist_adserver.py
• whotracksme_trackers.py updated

[max-ostapenko]

@hadiamjad Could you achieve the same result with native functions:

LOGICAL_OR(INSTR(url, domain) > 0) AS should_block

[max-ostapenko]

@hadiamjad I think this got lost in discussions, let's update this.

[max-ostapenko]

@hadiamjad could you please add a query you used to create Disconnect reports.
Did you update easylist-tracker-detection.sql for this?

[bstandaert-wustl]

@max-ostapenko RE your review request, I don't have time to review all the queries; is there something specific you want me to look at?

[max-ostapenko]

@bstandaert-wustl sure, please take a look at bounce tracking, CNAME and something from Privacy Sandbox.