If you own a web site with imporant information, this software is the only product available today (to the best of our knowledge) that can secure your data from spidering programs. This software is made as plugin for IIS and can be used with any scripting language supported by Microsoft IIS server. SpiderArmor makes your pages visible to users but not available for spidering programs that will make your data safe from scrapping by others!

iis plugin, scrappers protection, data protection, html protection, iis security, spiders protection, web site security, web site protection, web protection, isapi filter, internet security

Build a custom web spider / web crawler using web data extraction / screen scraping technology. Use the web extract for web data mining of contact lists, product catalogs, government databases, real estate listings, or build a custom email extractor. Creating your own web grabber that can Screen Scrape the data to a database or Excel has never been easier. The website spider / crawlers can even sort and filter the webpages while spidering.

website spider, web grabber, web extract, crawlers, screen scraper, web spider, web crawler, email extractor, screen scraping, spidering

QuidProQuo automatically scans through your site to locate your link partners and spiders through your link partners sites to verify reciprocal links back to you. It will find the link cheaters (those to whom you are linking but are not returning the favor). With multi-threading it allows you to speed up the process by spidering multiple sites at the same time.

confirmation, reciprocal link checker, verification, quidproquo, link exchange software, reciprocal linking, checking

Crawl a website with this free ActiveX spidering component. Advanced features include caching, "avoid" patterns, and robots.txt compliance.

internet, intelligence, spider, activex, data mining, component, freeware, probe, robot, download

Spider and download images on web sites. Tell the spiders where to start, where to go from there, which images to look for and what to do with those images, once they are downloaded. The application is designed to spider sites with millions of pages and millions of images. It can run for days without supervision. Progress can be saved in case you want to continue spidering a web site at a later time. Uses multiple threads.

website, spider, download, image

QuadSucker/Web is a multithreaded website downloader. It is optimized for downloading images, and includes built in support for viewing GIF and JPEG files. Other types of files are also downloaded, including sound, applications, and text/html. Automatically spiders and downloads entire sites. Setup options allow limits on spidering depth and types of files to download. Built in duplicate database and duplicate remembering. Very easy to use.

website downloader, website, web downloader, download websites