The Global Database of Events, Language and Tone (GDELT) project provides 40+ Years of News from worldwide sources.
The GDELT dataset is a vast archive, dating back to 1979.
Further reference:
Questions tagged [gdelt]
42 questions
0
votes
1 answer
bigquery and gdelt database: how to count the number of event and number of mentions
Is count(*) code the number of event.
But in my data the are the same as count(NumMentions) as Mentions,
In fact, mentions may be more than events.
what's wrong with my code
SELECT
YEAR,
ACTOR1COUNTRYCODE as Country1,
Actor2CountryCode as…
janeluyip
- 17
- 5
0
votes
1 answer
Counting number of events (protests) from GDELT database
My goal is to get the monthly number of protests in Mexico reported between the years 2004 and 2020. I am using Google BigQuery to get this data from the GDELT database.
My problem is that I am getting different results when running the same query…
Arturo Sbr
- 5,567
- 4
- 38
- 76
0
votes
1 answer
partition big query LIMIT over date range
I'm quite new to SQL & big query so this might be simple. I'm running some queries on the public dataset GDELT in BQ and have a question regarding the LIMIT. GDELT is massive (14.4 TB) and when I query for something, in this case a person, I could…
Jh123
- 83
- 8
0
votes
2 answers
big Query adding a month to a search
looking to add a month to a search in gdelt.
If I use only the year the code work great;
but if I looking for a month (like 2019-11) the result is empty.
tnx for your help!
SELECT
person,
SUM(count_of_mentions) AS all_mentions
FROM
…
0
votes
1 answer
Extract URL of theme or text from the GDELT query
I am trying to extract the news related to cryptocurrency from GDELT. I am using the following query:
select date(_partitiontime) date, count(theme) occurences
from `gdelt-bq.gdeltv2.gkg_partitioned`, unnest(split(themes,';')) as theme
where…
Asim
- 1,430
- 1
- 22
- 43
0
votes
0 answers
Knowing GDELT databases and tables
I'm a bit lost when I have to write the FROM statement in Google BigQuery because i do not know which databases and tables are available out there to query. I've seen some queries like these:
...
FROM `gdelt-bq.gdeltv2.gkg_partitioned`
...
FROM…
juanmac
- 121
- 1
- 12
0
votes
0 answers
GDELT get counts of theme in country year pairs
I'm wanting to use GDELT to obtain a CSV containing a count of the number of articles containing a specific theme for all countries for a given number of years. Please note it's not quite the same as the events database, I'm specifically interested…
thehand0
- 1,123
- 4
- 14
0
votes
1 answer
Strange results for BigQuery/GDELT. How to correctly parse dates?
I'm wanting to run a query on the global database for events, language and tone (GDELT) using BigQuery. I am specifically searching for key terms (e.g. like bribery or corruption) and grouping the count of the results by year (2010,2011,2012 etc). I…
thehand0
- 1,123
- 4
- 14
0
votes
1 answer
How to add a particular country for specified words counts search using google bigquery for GDELT gfg
I am using GDELT with Google Bigquery. I want to search for a specific word such as "economy" and "unemployment" for a particular country such as Canada. The sample codes are given below. I add ToLinkURL like '%canada%' to WHERE. However, it does…
shafi Q
- 77
- 8
0
votes
1 answer
Fixing "Resources exceeded" in BigQuery and making it run faster
GDELT's Kalev Leetaru had this problem - the following query will run in BigQuery when analyzing a full month, but it won't run when going over a whole year.
SELECT Source, Target, count, RATIO_TO_REPORT(count) OVER() Weight
FROM (
SELECT a.name…
Felipe Hoffa
- 54,922
- 16
- 151
- 325
-1
votes
2 answers
Solution to Mongodb compass interior hyphen error?
I'm attempting to import a large CSV file into mongodb using mongodb compass. The data originally came from BigQuery via GDELT, then was dumped into 40+csv files.
Over half of the files are not able to be imported as they get partially through and…
cogijl
- 59
- 6