-1

I’m looking at -and trying to retrieve- data for a specific search query on the full archive (premium) search API (V1) but I’m getting a weird "hole" of about 9 days of data from 7 to 16 January. Results for the rest of January up until now are apparently ok.

Parameters passed to the search endpoint are:

    'query' => '<a longish query string about 750 characters>',
    'fromDate' => '202301070000',
    'toDate' => '202301140830',
    'maxResults' => '500'

but apparently the data is missing from the count endpoint as well, since this is what I’m getting with a bucket=day granularity (this covers all of Jan up to now):

{
    "results": [{
        "timePeriod": "202301010000",
        "count": 525
    },
    
    >>>>> ...EVERYTHING FINE UP TO HERE <<<<<<
    
    {
        "timePeriod": "202301070000",
        "count": 15 <--- THIS IS A PARTIAL RESULT
    }, {
        "timePeriod": "202301080000",
        "count": 0
    }, {
        "timePeriod": "202301090000",
        "count": 0
    }, {
        "timePeriod": "202301100000",
        "count": 0
    }, {
        "timePeriod": "202301110000",
        "count": 0
    }, {
        "timePeriod": "202301120000",
        "count": 0
    }, {
        "timePeriod": "202301130000",
        "count": 0
    }, {
        "timePeriod": "202301140000",
        "count": 0
    }, {
        "timePeriod": "202301150000",
        "count": 0
    }, {
        "timePeriod": "202301160000",
        "count": 195 <--- ALSO A PARTIAL RESULT 
    }, 
    
    {
        "timePeriod": "202301170000",
        "count": 682
    }, 

    >>>>> ...FINE FROM HERE ON <<<<<<

],
    "totalCount": 10456,
    "requestParameters": {
        "bucket": "day",
        "fromDate": "202301010000",
        "toDate": "202301241720"
    }
}

for your enjoyment here is a chart of what I'm (not) getting.

enter image description here

I'm a bit weirded out -- also, premium API access is all but free and is paid upfront, you know.

qqg
  • 55
  • 7
  • Further datapoint: searches with a subset of keywords on search.twitter.com return the same date pattern in results, with [no results](https://twitter.com/search?q=until%3A2023-01-14%20since%3A2023-01-09%20(inflazione%20OR%20recessione)%20(spesa%20OR%20spese%20OR%20consumo%20OR%20consumi%20OR%20acquisto%20OR%20acquisti%20OR%20povert%C3%A0%20OR%20indigenza%20OR%20consumatori%20OR%20risparmio%20OR%20risparmi%20OR%20vendita%20OR%20vendite%20OR%20dettaglio%20OR%20shrinkflation)&src=typed_query&f=live) (highly unlikely) if within the 7-14 Jan timeframe. As if the tweets... just weren't there. – qqg Jan 24 '23 at 18:30

1 Answers1

0

From further research and consultation on the Twitter dev fora, this is platform-wide. There may be possibly be a reindexing in a few days but as of now all searches return no results in the 2nd week of January 2023.

qqg
  • 55
  • 7
  • Your answer could be improved with additional supporting information. Please [edit] to add further details, such as citations or documentation, so that others can confirm that your answer is correct. You can find more information on how to write good answers [in the help center](/help/how-to-answer). – Community Jan 30 '23 at 05:10