Stack Overflow
Stack Overflow

Questions tagged [gdelt]

The Global Database of Events, Language and Tone (GDELT) project provides 40+ Years of News from worldwide sources.

The GDELT dataset is a vast archive, dating back to 1979.

Further reference:

42 questions
1
vote
1 answer

GDELT Instability Query

I wondering if it possible to query the GDELT instability data from Big Query. I know you can go to the GDELT site for the data, but is it possible to query it directly from big query. And if it is possible to access more than 180 days of it.…
fletchr
  • 646
  • 2
  • 8
  • 25
1
vote
1 answer

Finding the maximum distance between events in a group in gdelt-bq.full dataset, BigQuery

I need to find the longest distance across all the event points for each country in gdelt-bq.full:events dataset. For having information about countries make groups there is a join with gdelt-bq:extra.countryinfo. So now I have this table: SELECT…
Anastasia Manokhina
  • 98
  • 1
  • 1
  • 7
1
vote
1 answer

Tables truncated when using bigquery api (buffer size issue?)

I am running the following: bq query --format=csv SELECT GKGRECORDID, DATE,SourceCommonName,DocumentIdentifier, V2Persons, V2Tone, TranslationInfo, from [gdelt-bq:gdeltv2.gkg_partitioned]where V2Persons like "%Orban%" and _PARTITIONTIME >=…
Samuel Markson
  • 97
  • 1
  • 2
  • 8
1
vote
0 answers

Is one day (20140319.export.CSV.zip) of data missing from the GDELT event files?

I am dealing with GDELT data using R and the {GDELTtools} package. When downloading the GDELT database using GetAllOfGDELT() or through a web browser, it appears that one file (20140319.export.CSV.zip) is missing. This causes GetAllOfGDELT() to…
Jonathan
  • 65
  • 1
  • 7
0
votes
1 answer

Understanding GDELT

I'm new to Gdelt world and i try to understand 3 databases, namely events, Mentions, GKG. they can be combined to each other through their ID. but my question is regarding Mentions database. where were these articles mentioned actually? as…
Mostafa Bouzari
  • 9,207
  • 3
  • 16
  • 26
0
votes
1 answer

AssertionError: group argument must be None for now in a python library

I'm trying to use a library called gdelt which simply downloads data from gdelt website or from Google Query i'm not sure. for installing and other info pls visit or pip install gdeltPyR You can also install directly from github bash pip install…
Mostafa Bouzari
  • 9,207
  • 3
  • 16
  • 26
0
votes
1 answer

Sending a parameter to GDELT API is not returning the expected result

I'm trying to connect to Gdelt Doc API and so far I can send all the query parameters except for one of them. Before I get to the problem I want you to see the code. So if you call this method it will send a request to gdelt API (Doc API) and return…
Mostafa Bouzari
  • 9,207
  • 3
  • 16
  • 26
0
votes
1 answer

How to scrape data from GDELT

I am struggling to scrape data from GDELT. http://data.gdeltproject.org/events/index.html I aim to write code that automatically downloads, unzips, and merges files during specific periods, but despite numerous attempts, I have failed to do…
Injae Jeon
  • 83
  • 4
0
votes
0 answers

Looking for a news dataset/database that updates daily news from around the world, besides GDELT

Looking for a news dataset/database that updates daily news from around the world, besides GDELT I'm trying to crawl news from various countries using shared keywords. Right now I'm using Gdelt, but when I input a keyword for searching, it returns…
Yooshinhee
  • 25
  • 4
0
votes
1 answer

How to allow (accept) multiple Date formats?

I have some Date formats that i can accept YYYYMMDDHHMMSS or YYYYMMDDHHMM or YYYYMMDDHH or YYYYMMDD. I want to check if the Date is in these formats, otherwise print an Error message or catch some error. I tried the achieving this using RegEx. It…
Mostafa Bouzari
  • 9,207
  • 3
  • 16
  • 26
0
votes
1 answer

Whole text or title of news from the GDELT query

I'm currently working on fetching data from the GDELT project using Google BigQuery. While exploring various tables, I haven't come across any that include the complete text or title of news articles. It appears that the tables primarily contain…
Vahid Shams
  • 103
  • 1
  • 3
0
votes
1 answer

Adding GDELT to BigQuery

I've been trying to add GDELT events data to BigQuery with no success so far.. I use the link below in my attmpets; clicking view dataset >> create table >> add arbitrary table name >> create table and then I get this error: You are missing…
maor ankri
  • 51
  • 3
0
votes
1 answer

How to get TONE from GDELT GKG table from Google BigQuery?

SELECT DATE, EXTRACT(YEAR FROM DATE) AS year, FIPS as Country, LOCATIONS, AVG(TONE) as Avg_Tone, AVG(Positive Score) as PositiveS, AVG(Negative Score) as NegativeS, COUNT(*), From `gdelt-bq.gdeltv2.gkg_partitioned`, `gdelt-bq.extra.sourcesbycountry`…
janeluyip
  • 17
  • 5
0
votes
1 answer

How to search GDELT data filtering country actors in big query?

I want to search GDELT data using big query since the analysis service on gdelt official website is updating. So the idea is I need to select data with specific country actors (eg. Actor1 is US and Actor2 is China). I tried something like…
Jenny
  • 1
  • 1
0
votes
0 answers

Attribute error while scraping gdelt data

I am scraping data from GDELT [https://www.gdeltproject.org]. It is a pretty cool project that checks ~100,000 news sites each day, labels all the articles, and makes them available. I am getting attribute error while extracting the data. The code…
shan
  • 553
  • 2
  • 9
  • 25
1
2
3