March 28, 2016 By Douglas Bonderud 2 min read

Humans are taking back the Internet — that’s the good news from Distil Networks’ annual report on bot traffic. As noted by SecurityWeek, over 54 percent of Web traffic in 2015 came from human users, while 46 was produced by bots.

The bad news? About 18 percent of those were bad bots. What’s more, 88 percent were advanced persistent bots (APBs), which can mimic human behavior, hide their presence and resist attempts to limit their impact. Simply put? While the bad bot footprint isn’t so deep, it comes with a bigger kick.

Evolving Attack Vectors

According to Marketing Land, the rise of bad bots is tied in part to the increasing complexity of websites. As noted by Distil CEO Rami Essaid, “A lot of previous bots were written for specific purposes and script-driven.”

But with Web apps becoming more powerful and Internet traffic critical to the success or failure of major brands, bot-makers have adapted. Rather than writing massive amounts of easily blocked code, they’re trending toward persistent bots that aren’t so easy to detect or disarm.

So what does an APB look like? In addition to acting like humans on the Web, these bad bots can load JavaScript and other external assets, spoof IP addresses, take a bite out of cookies and initiate browser automation. They’re also able to avoid detection using dynamic IP rotation, Tor networks and peer-to-peer proxies.

Distil’s report found that 73 percent of these bots used multiple IP addresses, and 36 percent used two or more agents to obfuscate their origins. Additionally, 20 percent leveraged more than 100 IP addresses to carry out their work, according to SecurityWeek.

When it comes to ultimate purpose, some bad bots are designed to simply spin up endless executables and gobble CPU resources while others scrape and then repurpose website content. Although good bots — such as search engine crawlers and legitimate advertising bots — do exist, it’s hard to tell helpful from harmful at first glance.

Battling Bad Bots

So how do companies fight back against bad bots? According to ReadWrite, one option is a blockade: Don’t let any bots execute on a website. But this kind of wall-building comes with a potentially massive downside. If search engine and SEO bots can’t crawl a site, companies get none of the ranking benefits.

Another option is bot management. Think of it like the app management uptick that accompanied widespread BYOD adoption. Instead of trying to block every bot or app on the network and forcing IT professionals to become full-time gatekeepers, the right management strategy lets companies gain both visibility and control over malicious bots. By slowing them down or feeding them false information, companies can lower their value to malicious actors and limit their impact.

Bottom line? There are fewer bad bots out there than last year. But they’re more sophisticated than ever — intelligent, persistent and pervasive. While businesses can’t kick all bots to the curb, it’s possible to find a better balance with an agile management posture.

More from

Unpacking the NIST cybersecurity framework 2.0

4 min read - The NIST cybersecurity framework (CSF) helps organizations improve risk management using common language that focuses on business drivers to enhance cybersecurity.NIST CSF 1.0 was released in February 2014, and version 1.1 in April 2018. In February 2024, NIST released its newest CSF iteration: 2.0. The journey to CSF 2.0 began with a request for information (RFI) in February 2022. Over the next two years, NIST engaged the cybersecurity community through analysis, workshops, comments and draft revision to refine existing standards…

What should Security Operations teams take away from the IBM X-Force 2024 Threat Intelligence Index?

3 min read - The IBM X-Force 2024 Threat Intelligence Index has been released. The headlines are in and among them are the fact that a global identity crisis is emerging. X-Force noted a 71% increase year-to-year in attacks using valid credentials.In this blog post, I’ll explore three cybersecurity recommendations from the Threat Intelligence Index, and define a checklist your Security Operations Center (SOC) should consider as you help your organization manage identity risk.The report identified six action items:Remove identity silosReduce the risk of…

Obtaining security clearance: Hurdles and requirements

3 min read - As security moves closer to the top of the operational priority list for private and public organizations, needing to obtain a security clearance for jobs is more commonplace. Security clearance is a prerequisite for a wide range of roles, especially those related to national security and defense.Obtaining that clearance, however, is far from simple. The process often involves scrutinizing one’s background, financial history and even personal character. Let’s briefly explore some of the hurdles, expectations and requirements of obtaining a…

Topic updates

Get email updates and stay ahead of the latest threats to the security landscape, thought leadership and research.
Subscribe today