HTDark | Underground Hacking Forum and Cybersecurity Community
  • Earn real money by being active: Hello Guest, earn real money by simply being active on the forum — post quality content, get reactions, and help the community. Once you reach the minimum credit amount, you’ll be able to withdraw your balance directly. Learn how it works.

GoSpider: Fast web spider written in Go

Status
Not open for further replies.
itsMe

itsMe

*KillmeMories*
Staff member
Administrator
Super Moderator
Hacker
Specter
Crawler
Shadow
Joined
Jan 8, 2019
Messages
56,623
Solutions
2
Reputation
32
Reaction score
100,456
Points
2,313
Credits
32,750
‎6 Years of Service‎
 
76%
gospiders-768x399.png


GoSpider

GoSpider – Fast web spider wrote in Go

Features

    Fast web crawling
    Brute force and parse sitemap.xml
    Parse robots.txt
    Generate and verify link from JavaScript files
    Link Finder
    Find AWS-S3 from response source
    Find subdomains from response source
    Get URLs from Wayback Machine, Common Crawl, Virus Total, Alien Vault
    Format output easy to Grep
    Support Burp input
    Crawl multiple sites in parallel
    Random mobile/web User-Agent

To see this hidden content, you must like this content.
 
Status
Not open for further replies.
Back
Top