|
As technology continues to progress, bots have become more prevalent across the internet, and PastPerfect Online sites are no exception. Bots are simply tools that can carry out tasks automatically rather than a person needing to physically repeat those actions; they are not inherently good or bad. Search engines like Google use bots to crawl web pages and index that information for its search results, instead of a team of humans whose job is to manually review hundreds of billions of webpages. On the opposite end of the spectrum, spam emails are often the work of bots as well, designed to quickly send the same message to many people.
Throughout the years, we have identified and blocked individual sources of traffic to PPO which have exceeded the use that would come from a legitimate web visitor. Recently, however, there has been a spike in bot traffic, causing occasional periods when sites loaded very slowly or, in a few instances, not at all.
Due to the increase and negative impact of this traffic, we implemented an additional tool last month to automatically detect high-volume or suspicious activity and prevent too many requests from the same IP address. Over the weeks this has been in place, our servers have been running without issue and there has been no unexpected downtime.
The majority of web visitors will not be impacted by this change, but there are some situations where genuine traffic may be blocked. Examples of behaviors that may inadvertently appear as suspicious or malicious include:
- A group of people, such as a classroom or board meeting, all opening your site at once while on the same network
- External services, like accessibility evaluation tools or uptime monitors, requesting the same page too often
- Repositories, such as DPLA hubs, that we have not worked with before trying to harvest your records for inclusion
If you believe a service you use for PastPerfect Online or an IP address within your network has been blocked, please contact us. We may need to unblock your IP range or work with you and your vendor to reduce the number of requests received in a set time period.
|