• Earn real money by being active: Hello Guest, earn real money by simply being active on the forum — post quality content, get reactions, and help the community. Once you reach the minimum credit amount, you’ll be able to withdraw your balance directly. Learn how it works.

twint v2.1 An Advanced Twitter Scraping Tool

Status
Not open for further replies.

itsMe

*KillmeMories*
Staff member
Administrator
Super Moderator
Hacker
Specter
Crawler
Shadow
Joined
Jan 8, 2019
Messages
56,623
Solutions
2
Reputation
32
Reaction score
100,456
Points
2,313
Credits
32,750
‎6 Years of Service‎
 
76%
68747470733a2f2f692e696d6775722e636f6d2f45454a7142386e2e706e67


Twint is an advanced Twitter scraping tool written in python that allows for scraping Tweets and pictures from Twitter profiles without using Twitter’s API.

Twint utilizes Twitter’s search operators to let you scrape Tweets from specific users, scrape Tweets relating to certain topics, hashtags & trends, or sort out sensitive information from Tweets like e-mail and phone numbers. I find this very useful, and you can get really creative with it too.

Twint also makes special queries to Twitter allowing you to also scrape a Twitter user’s followers, Tweets a user has liked, and who they follow without any authentication, API, Selenium, or browser emulation.

Benefits

Some of the benefits of using Tweep vs Twitter API:
    Can fetch almost all Tweets (Twitter API limits to last 3200 Tweets only)
    Fast initial setup
    Can be used anonymously and without Twitter sign up
    No rate limitations

Changelog v2.1
New features:


    added user_rt: name of the user at the time which retweeted
    extended user_rt_id to any retweet and not just specific ones
    added retweet_id
    added reply_to: list of {user_id, username} of users which you’d reply to


Basic Examples and Combos.

Code:
    python3 twint.py -u username – Scrape all the Tweets from user‘s timeline.
    python3 twint.py -u username -s pineapple – Scrape all Tweets from the user‘s timeline containing pineapple.
    python3 twint.py -s pineapple – Collect every Tweet containing pineapple from everyone’s Tweets.
    python3 twint.py -u username --year 2014 – Collect Tweets that were tweeted before 2014.
    python3 twint.py -u username --since 2015-12-20 – Collect Tweets that were tweeted since 2015-12-20.
    python3 twint.py -u username -o file.txt – Scrape Tweets and save to file.txt.
    python3 twint.py -u username -o file.csv --csv – Scrape Tweets and save as a csv file.
    python3 twint.py -u username --fruit – Show Tweets with low-hanging fruit.
    python3 twint.py -s "Donald Trump" --verified --users – List verified users that Tweet about Donald Trump.
    python3 twint.py -g="48.880048,2.385939,1km" -o file.csv --csv – Scrape Tweets from a radius of 1km around a place in Paris and export them to a csv file.
    python3 twint.py -u username -es localhost:9200 – Output Tweets to Elasticsearch
    python3 twint.py -u username -o file.json --json – Scrape Tweets and save as a json file.
    python3 twint.py -u username --database tweets.db – Save Tweets to an SQLite database.
    python3 twint.py -u username --followers – Scrape a Twitter user’s followers.
    python3 twint.py -u username --following – Scrape who a Twitter user follows.
    python3 twint.py -u username --favorites – Collect all the Tweets a user has favorited
To see this hidden content, you must like this content.
 
Status
Not open for further replies.
Back
Top