Actions
Feature #14160
open
Add Search Engine Group in feeds
Status:
New
Priority:
Low
Assignee:
-
Category:
pfBlockerNG
Target version:
-
Start date:
Due date:
% Done:
0%
Estimated time:
Plus Target Version:
Description
It would be good to get a search engine feed so you can either block them or use them as a whitelist. I have included links so people can check my research is valid.
Here are some to start the group:
- Googlebot https://developers.google.com/search/apis/ipranges/googlebot.json
- Bingbot https://www.bing.com/toolbox/bingbot.json
- DuckDuckBot https://help.duckduckgo.com/duckduckgo-help-pages/results/duckduckbot/
If anyone has any other search engines or crawlers, please add them here
Updated by Jon Brown almost 2 years ago
This is so we can whitelist search engines "Search Engines IPv4", "Search Engines IPv6"
Actions