Home » Python » Scripts » Python Web Crawler

• Visit:
• Hits:
• Views:
• Platform(s):
• Database(s):
• License:
• Price:
• Version:
• Script Added:
• Last Updated:
• Developer:
• Script Link:
• Tags:

• Python Web Crawler
• 81
• 1151
• N/A
• N/A
• Commercial License
• $9.99
• 1.0.1
• 26/06/2011
• 26/06/2011
• Juan Manuel García
• http://www.binpress.com/app/python-web-cra...
• crawler  link  python  webs  searcher 

Description:
Python Web Crawler is a program that searches for links on the web and save them in a MySql data base.

Features:

Multi-processed crawling to improve speed
MySql database to save the links
Easy to extend
Clean and readable Pythonic code
Url validator via regular expressions