A scraping library for Twitter that doesn't use the Twitter API.
Questions tagged [twint]
62 questions
0
votes
2 answers
Collecting old tweets between a specific time period
I am trying to collect tweets using tweepy. The resources I have checked all use the parameters since and until which has not worked so far. I also tried twint and GetOldTweets3 to no success.
The search I tried on tweepy:
tweets =…
dekaottoman
- 53
- 7
0
votes
1 answer
Why does Twints "since" & "until" not work?
I'm trying to get all tweets from 2018-01-01 until now from various firms.
My code works, however I do not get the tweets from the time range. Sometimes I only get the tweets from today and yesterday or from mid April up to now, but not since the…
VaKt
- 35
- 4
0
votes
1 answer
How to fix Twint to get all tweets through a specified date range?
Currently, I am trying to scrape the all tweets between '2015-02-01 00:00:00' and '2022-05-04 00:00:00' with word criteria from twitter using python. However, my output starts at 2022-05-03 23:58:59 and ends at 2022-04-25 13:15:04.
import…
Zane Cantrell
- 247
- 3
- 9
0
votes
3 answers
How to wrap JSON file into array?
I am currently developing a project which uses the Twint python library for web-scraping Twitter.
The problem is, the way it saves the scraped data to is invalid in regards to JSON Formatting standards. All of the scraped tweets are saved as objects…
Mvvvxie
- 1
- 1
0
votes
0 answers
Twint to Kafka -> Dont receive any events in my topic
i'm trying to load some tweets via TWINT into a kafka topic with the confluent-kafka[avro]
Producer. I don't get any errors but my topic wont receive any events from twint. I even get succes msg, when debugging(with try and except).
My Code:
import…
Hansanho
- 295
- 1
- 3
- 13
0
votes
1 answer
How to scrape tweets with english language only in twint?
I have tried the following syntax:
c>lang = 'en'
But it still fetches non-english tweets as well.
0
votes
0 answers
Failed to install Twint on Windows
I could not install twint on command prompt. I tried with pip install twint and the following error message came up:
Building wheels for collected packages: cchardet
Building wheel for cchardet (setup.py) ... error
error:…
Yannik Dobler
- 1
- 2
0
votes
1 answer
problem with twint while using specific time
we are trying to get data from 2021 and we have a problem with the month, which is we can't get the all month in 2021, but we only got the recent month and it just few of tweets. (sorry for my bad english)
import twint
import…
0
votes
3 answers
No more data! Scraping will stop now. - Cannot fetch more tweets using twint
Based on twint official documentation, it should not be hard to fetch 3200 tweets from a specific user. However, my problem is: after I run the config code, I only get the most recent 20-60 tweets. Something must be wrong and hope to get some.
I…
Rieder
- 1,125
- 1
- 11
- 18
0
votes
2 answers
Error when loading .csv file into pandas dataframe
I'm using Twint to create a .csv file with ten results. But whenever I try to load it into a pandas dataframe, I get an error. Can someone help me to understand what is going on?
Traceback (most recent call last):
File "k:\Documents\Visual Studio…
Kynan E
- 41
- 1
- 4
0
votes
1 answer
How do I use the since and until parameters in twint?
Im using the twint package to get all tweets in english since 2016-01-01 until 2021-01-01 for the search btc and save it as a csv file. My code looks as follow (im using a jupyter notebook)
import nest_asyncio
nest_asyncio.apply()
import…
Beltran Rovira
- 3
- 2
0
votes
1 answer
How do I gather a list of who a specific twitter user is following using twint?
I am trying to gather a list of users that follow a specific main user using twint in pycharm. I keep getting these errors when I run my code though.
CRITICAL:root:twint.get:User:'NoneType' object is not…
tyrell d
- 1
- 1
0
votes
0 answers
api data to json file split per day, then merged
The code suppose to pull results from api, split it by day, and store each day’s results as distinct json file.
Why it doesn't create json files?
twint_loop splits the date range into a series of days and calls twint_search to do the searching for…
user16133525
0
votes
0 answers
Python Twint Twitter API ValueError - Time Data
I'm using twint package and i'm trying to get user's posts, and until now I succeeded,
but for some reason today it stopped working because of the following error:
(ValueError("time data '2021-07-02 08:55:46 ???? ??? ???????' does not match format…
Tomer Shein
- 1
- 1
0
votes
1 answer
pywren and twint - Tweet download
The following code takes a username and scrapes their twitter history from a given date
import pandas as pd
import twint
import pywren
def scrape_user(username):
c = twint.Config()
c.Username = username
c.Lang = 'es'
c.Since =…
Javier
- 332
- 1
- 4
- 14