Skip to content

Commit

Permalink
pattern update. address issue #263
Browse files Browse the repository at this point in the history
  • Loading branch information
deedeeh committed Jul 15, 2024
1 parent 536ef9f commit 7c59bab
Show file tree
Hide file tree
Showing 8 changed files with 95 additions and 39 deletions.
4 changes: 4 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,9 @@
# Changelog

## [5.1.13](https://github.com/omrilotan/isbot/compare/v5.1.12...v5.1.13)

- [Pattern] Recognise [Owler (Open Web Search Project)](https://openwebsearch.eu/owler/) as a bot

## [5.1.12](https://github.com/omrilotan/isbot/compare/v5.1.11...v5.1.12)

- [Pattern] Pattern updates: [Project LightSpeed](https://engineering.fb.com/2020/03/02/data-infrastructure/messenger/) browsers are not bots
Expand Down
2 changes: 2 additions & 0 deletions fixtures/crawlers.yml
Original file line number Diff line number Diff line change
Expand Up @@ -533,6 +533,8 @@ Other Site Monitor Bots:
- LogicMonitor SiteMonitor/1.0
Outbrain:
- Mozilla/5.0 (Java) outbrain
Owler:
- Owler (ows.eu/owler)
Pageburst:
- Mozilla/5.0 (iPad; CPU OS 9_1 like Mac OS X) AppleWebKit/601.1 (KHTML, like Gecko; compatible; pageburst) CriOS/79.0.3945.117 Mobile/13B143 Safari/601.1.46
- Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; pageburst) Chrome/109.0.5414.101 Safari/537.36
Expand Down
2 changes: 1 addition & 1 deletion fixtures/downloaded/downloaded
Original file line number Diff line number Diff line change
@@ -1 +1 @@
Wed, 26 Jun 2024 12:40:55 GMT
Mon, 15 Jul 2024 12:20:22 GMT
1 change: 1 addition & 0 deletions fixtures/downloaded/matomo-org.json
Original file line number Diff line number Diff line change
Expand Up @@ -731,6 +731,7 @@
"MeltwaterNews www.meltwater.com",
"Owler@ows.eu/1",
"OWLer/0.1 (built with StormCrawler; https://ows.eu/owler; owl@ow-s.eu",
"Owler (ows.eu/owler)",
"Page Monitor (https://confluence.dev.bbc.co.uk/display/men/Page+Monitor)",
"BBC-Forge-URL-Monitor-Twisted",
"ClaudeBot",
Expand Down
120 changes: 84 additions & 36 deletions fixtures/downloaded/myip.ms.json

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "isbot",
"version": "5.1.12",
"version": "5.1.13",
"description": "🤖/👨‍🦰 Recognise bots/crawlers/spiders using the user agent string.",
"keywords": [
"bot",
Expand Down
2 changes: 1 addition & 1 deletion src/index.ts
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,7 @@ export const isbotMatches = (userAgent?: string | null): string[] =>
*/
export const isbotPattern = (userAgent?: string | null): string | null =>
userAgent
? list.find((pattern) => new RegExp(pattern, "i").test(userAgent)) ?? null
? (list.find((pattern) => new RegExp(pattern, "i").test(userAgent)) ?? null)
: null;

/**
Expand Down
1 change: 1 addition & 0 deletions src/patterns.json
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@
"^navermailapp",
"^netsurf",
"^offline",
"^owler",
"^postman",
"^python",
"^rank",
Expand Down

0 comments on commit 7c59bab

Please sign in to comment.