• Earn real money by being active: Hello Guest, earn real money by simply being active on the forum — post quality content, get reactions, and help the community. Once you reach the minimum credit amount, you’ll be able to withdraw your balance directly. Learn how it works.

Universal Reddit Scraper v3.1 - Scrape Subreddits, Redditors, and comments on posts

Status
Not open for further replies.

itsMe

*KillmeMories*
Staff member
Administrator
Super Moderator
Hacker
Specter
Crawler
Shadow
Joined
Jan 8, 2019
Messages
56,623
Solutions
2
Reputation
32
Reaction score
100,456
Points
2,313
Credits
32,750
‎6 Years of Service‎
 
76%
help.png


Universal Reddit Scraper

This is a universal Reddit scraper that can scrape Subreddits, Redditors, and comments on posts.

Scrape speeds will be determined by the speed of your internet connection.

Changelog v3.1
New in 3.1.0:


    Scrapes will now be exported to the scrapes/ directory within a subdirectory corresponding to the date of the scrape. These directories are automatically created for you when you run URS.
    Added log decorators that record what is happening during each scrape, which scrapes were ran, and any errors that might arise during runtime in the log file scrapes.log. The log is stored in the same subdirectory corresponding to the date of the scrape.
    Replaced bulky titles with minimalist titles for a cleaner look.
    Added color to terminal output.
    Improved naming convention for scripts.
    Integrating Travis CI and Codecov.
    Updated community documents located in the .github/ directory: BUG_REPORT, CONTRIBUTING, FEATURE_REQUEST, PULL_REQUEST_TEMPLATE, and STYLE_GUIDE
    Numerous changes to README. The most significant change was splitting and storing walkthroughs in docs/.


To see this hidden content, you must like this content.
 
Last edited by a moderator:
Status
Not open for further replies.
Back
Top