Add crawler detection page #22
Conversation
There was a problem hiding this comment.
Very neat! Could you please add a link to this page from https://github.com/duckduckgo/privacy-test-pages/blob/gh-pages/index.html ? We probably need "Other" category because it doesn't seem to fit anywhere else.
BTW see https://github.com/duckduckgo/privacy-test-pages#how-to-create-a-new-test
crawler/index.html
Outdated
| <title>Headless detector</title> | ||
| </head> | ||
|
|
||
| <body> |
There was a problem hiding this comment.
Can you please add breadcrumbs and a description like we have on other pages?
Sth like "This page collects various tests for detecting headless browsers."
crawler/index.html
Outdated
| displayResult('plugins', navigator.plugins.length == 0, navigator.plugins.length); | ||
| displayResult('languages', navigator.languages == "", navigator.languages); | ||
| displayResult('webdriver', !!navigator.webdriver, navigator.webdriver) | ||
| displayResult('window.chrome', !window.chrome || !window.chrome.runtime, JSON.stringify(window.chrome)) |
There was a problem hiding this comment.
FYI there is no window.chrome.runtime in Chrome Canary (90) and my plugins are in fact empty. Probably not a big deal, but shows that those tests are somehow not reliable.
There was a problem hiding this comment.
The articles around this also stress that some of these methods only work with certain versions. Having this also as a webpage means we can also test against normal chrome, and remove tests which no longer pass for real browsers.
crawler/index.html
Outdated
| listEntry.querySelector('.value').textContent = result ? 'fail' : 'pass'; | ||
| ul.appendChild(listEntry) | ||
| if (result) { | ||
| fetch(`./fail.json?test=${test}&${detectValue}`); |
There was a problem hiding this comment.
I like this :) I'd add a note that this is used for easy access to test results from the crawler's output.
|
Thanks @kdzwinel - sorry I missed the docs on making a new page. I've updated the page to match the template and address your other comments. |
Basic test page to allow tracker-radar-collector to test if it can be detected as a crawler.