- Joined
- Jan 8, 2019
- Messages
- 56,623
- Solutions
- 2
- Reputation
- 32
- Reaction score
- 100,456
- Points
- 2,313
- Credits
- 32,750
6 Years of Service
76%

GoSpider – Fast web spider wrote in Go
Features
Fast web crawling
Brute force and parse sitemap.xml
Parse robots.txt
Generate and verify link from JavaScript files
Link Finder
Find AWS-S3 from response source
Find subdomains from response source
Get URLs from Wayback Machine, Common Crawl, Virus Total, Alien Vault
Format output easy to Grep
Support Burp input
Crawl multiple sites in parallel
Random mobile/web User-Agent
Changelog v1.1.3
c59ef01 Upgrade v1.1.3
7b01017 Merge pull request #27 from rayhan0x01/patch-1
20f8238 removing lower case conversion of paths and parameters
656e12f Fix typo in -q options
9d7a0df Update release
To see this hidden content, you must like this content.