Unique information is a target for competitors, intermediaries and intruders. The databases of
online services for cartography and navigation systems, product characteristics in internet shops as
well as advertisements on digital trading platforms are particularly popular. However, manual
copying of content is costly, exhausting and unproductive. The automated download (exfiltration)
systems of content are developed and used to save time and resources. The specifically configured
software performs website crawling – it automatically downloads the web pages, analyses the content,
finds the links to other sections and recursively copies the entire content of the website.
Problems generated by web-scraping:
Attacked websites are deprived of unique content and lose their positions in the organic search
Automatic correction of stolen texts makes it difficult to find duplicates even with the help of
Automatic downloading of data creates a serious parasitic load; it disrupts the stable operation
of the website and may lead to a denial of service to legitimate visitors;
An automatically created copy of the website can be used for phishing attacks when by using
authorization forms, intruders steal en masse users’ account data.
In its turn, legal methods of protection against web-scraping have limited abilities.
Copying of information from public sources is not as legally protected as copying and use of
personal data by the Directive 95/46/EC is. For that reason, technological methods of protection of
information from copying are also in demand.
With the help of Active Bot Protection, the Variti platform can filter out relevant requests,
preventing unauthorized copying of content and reducing the load on the client’s infrastructure.
Smart migration of web scrappers on pages of goods in e-store exfiltratiing current price list
Active Bot protection as a fraud preventing solution
About click fraud
Click fraud refers to one of the types of online scams. Interested parties, such as competitors
or intruders, make false clicks on advertising links (Pay Per Click) and spend the advertising
budget. There are manual and automatic click frauds, the latter occurs, when actions of clickers
are imitated through special programs.
Examples of click fraud can be as follows:
Technical clicks – the search engines follow the links for indexing the website’s content;
Clicks from advertisers – the advertisers click on their own contextual ads to increase
their click-through-rate (CTR);
Clicks from competitors – the competitors follow the links from contextual ads for reducing
the advertising budget;
Clicks from unscrupulous webmasters – the users and automated programs follow the links to
commercial ads to increase the profitability of their own advertising platforms;
Fraudulent clicks – network fraudsters alter the results of online voting systems and
increase the counters on the website.
Protection from click fraud is required for:
Advertising and marketing agencies – the filtering of false clicks will help to collect
reliable marketing information and reduce the reputational risks;
Advertising companies – the protection of ads from clickers saves the budget in the
Website owners – the protection from automatic increase of votes guarantees exact results of
voting systems on the website.
Bot traffic may reach 80-90% out of total infrastructure capacity or/and application perfomance
Clickfraud e-commerce adds
Prevention from periodical web-scraping of client's media resource