fantomas spiderSpy™
Crawlbot Database

OEM Service

Being the world's largest database of search engine and other spiders, updated every six hours, seven days a week, the fantomas spiderSpy™ botBase Service is an indispensable backend tool for search engine optimization software developers and service agencies alike. It is also a must have for server stats analysis tools and services to ascertain reliable spider access traffic data.

Taking the headache out of keeping up-to-date

With our worldwide net of human monitored spider traps, server logs access and proprietary spider catching technology, you won't find a more comprehensive and reliable database of verified search engine and other spiders (whackers, snoopbots, email harvesters, etc.) anywhere.

Seamless integration into your search engine related applications, your search engine submission service or stats analysis products guaranteed. Updated every six hours, seven days a week. Customized automatic download facilities or server push back end provided.

Features
  • list of world wide search engine spider IPs, User Agents and domain names
  • with over 9,000 entries probably the world's most comprehensive botBase (appr. 880 spiders verified and referenced for Inktomi alone!)
  • Check popup for list of currently supported engines
  • SQL database is processed and updated every 6 hours
  • served to your system in realtime or in accord with your scheduling preferences
  • no manual online maintenance required
  • fully configurable and customizable lists
  • available in four standard formats: HTML, ZIP/TGZ, XML and CSV
  • customizable list formats supported
  • full online access to our search engine database 24 hours a day, 7 days a week
  • free monitoring of your server logs for optimized spider detection (optional)
  • free spider verification service: send us your log excerpts, IPs and/or UserAgent data and we will determine whether your site was visited by a search engine spider
  • submit your own established spider lists for verification and integration in the botBase
  • full access to our special, subscribers only support forum at SearchEngineBase with its regular announcements of new additions to our botBase and other spider related topics

Request Quote

fantOon See our weekly SEO cartoon here!
fantomas Products
fantomas spiderSpy™
Crawlbot Database

Search Engine Spiders, Whackers, and more

Read More »
fantomas shadowSniper™
IP Delivery Engine

Web Page Cloaking & Stealth Technology

Read More »
Hit Connector™
Instant Traffic Machine

Stand alone Dedicated Traffic Generator

Read More »
LinkTopper™
Web Visibility Booster Service

Link Popularity Program

Read More »
fantomas subFrog PRO™
Submission Engine

Server Based Search Engine Submission Module

Read More »
fantomas keyMixer™
Keyword Density Generator

Server Based Automatic KD Generator Module

Read More »
fantomas blockFrog™
Simple IP Blocker

Blocks one predefined IP or IP range from site access

Read More »
fantomas multiBlocker™

Heavy Duty Snoop, Spam and Online Fraud Protector

Read More »
fantomas logFrog™
Log Analysis Engine

Cross Server Log Extractor & Report Generator

Read More »
fantomas statsReaper™
Logs Customizer

Adapts access logs to users' own needs

Read More »
fantomas trackerJack™
Site Exit Monitor

Tracks external links and clients leaving site

Read More »
fantomas dateDirector™
Content Delivery Engine

Automatic Periodic Content Feeder

Read More »
fantomas mailShield™
Anti Spam Email Protector

Protects web site email addresses from harvesters

Read More »
fantomas shadowCoder™
Page Code Protector

Protects entire web pages from code napping

Read More »
Future Development
fantomas Competitive Intelligence Index™
Service

Competitor Web Visibility Watch

Read More »
fantomas spiderFactory™
Crawlbot Generator

User Defined Customized Spiders & Crawlers

Read More »

All our programs are available in:

English versions available English versions available Deutsche Versionen verfügbar
  1. English and
  2. German versions
fantomInfo About Us Mission Statement Privacy Policy Contact Office Hours

At fantomaster.com we are committed to aiding internet and Web professionals in achieving their goals in today's and tomorrow's increasingly competitive technological environment.

fantomNews Weblog siteFlash: What's New Here? Archive

Read the latest info on our products and services in our fantomNews™ online newsletter focusing on IP delivery (cloaking), search engine optimization, webmaster tricks, etc

fantomProducts Overview Downloads TechSpecs Manuals Price List

Check out our fine product line of webmaster software, Perl and CGI scripts, many of them world time firsts in their class. See our documentation and test our demo versions in real time.

fantomTips FAQs Tutorials Cloaking and IP Delivery Resources Free Content

Our information gold mine: search engine positioning, IP delivery, cloaking technology, search engine spider IPs, FAQs, link popularity, resources and links to boost your web presence.

fantomServices Overview spiderSpy™ Anti-Spam Anti Code Napping Anti-Fraud

Profit from our research and development efforts! Get the world's most comprehensive database of search engine spiders for top notch search engine optimization and traffic analysis.

fantomFreestuff Overview Services Downloads FAQs Tutorials

Giving back to the community: our free cutting edge applications for webmasters and IT professionals. With thousands of downloads per year, we're helping to make the Web a better place.

fantomOrders Overview Ordering Online PayPal Ordering Offline Price List Special Deals

Need we say more?

We offer the industry's widest variety of secure options for payment, download and registration of our products and services. Order online via our state-of-the-art SSL-secured enhanced Apache server or via PayPal

Alternatively, you may order by fax, by email, by phone or by snail mail.

fantomCrew™ Affiliates Overview FAQ Links & Banners Terms Join Up! Member Login

Teaming up with success: excellent established products, lifetime commissions, zero setup fee, enlightened support — if you can make web professionals listen, speak with us and join up!

fantomTech™ OEM Program Overview Contact

The fantomTech™ Mighty Engines OEM Licensing Program offers cutting edge power engines and value added services for software developers and service providers. Full support available.

fantomMedia™ Center Press Releases

Media workers: stay informed and up-to-date by reading our fantomNews™ online newsletter, special press releases and digests. Consult with our world renowned experts.
Interview inquiries welcome.