Questions tagged [noaa]

National Oceanic and Atmospheric Administration - A US government agency which monitors and researches the oceans and atmosphere.

The National Oceanic and Atmospheric Administration (NOAA) is a US government agency that monitors and researches the oceans and atmosphere.

NOAA has a public API that you can use to fetch climate data for your project.


Useful links


Related tags

146 questions
0
votes
1 answer

web scraping for sunrise and sunset data using National oceanic and atmospheric administration

I want to scrape data from NOAA (https://gml.noaa.gov/grad/solcalc/). The data I want to get is sunrise and sunset timings for various counties of the US in the last 3 years. I have the coordinates of those counties. Now the problem which I am…
0
votes
1 answer

How can I copy/move multiple objects from a S3 bucket within specified byte-ranges to another bucket?

Hey I am trying to copy multiple objects(200,000+) from a public weather forecast bucket (NOAA GFS) to my private S3 bucket. Each forecast file has its own index file that contains byte-ranges for different variables. From these 500 variables, only…
xerbbb
  • 3
  • 1
0
votes
0 answers

CFGRIB GFS APCP (Total Precipitation) problem getting data from Time:1

I'm trying to get data from a GFS APCP (Total Precipitation 'tp' accum), but only can access to time 2. Time 1 have the accumulated precipitation from RUN hour to the forecast hour. For example for 06Z , time 1 shows tha acumulated precipitation…
0
votes
0 answers

Convert NOAA JSON value to data frame in python

From NOAA API, I can get Boston hourly weather forecast information via JSON file. Here is the link: https://api.weather.gov/gridpoints/BOX/70,76 (This JSON file is too long to present comprehensively here, please kindly click the link to see it) I…
0
votes
1 answer

Using Python and Selenium to select a date range from a pop-up menu

I'm trying to automate a data pull from the NOAA website (I was using requests, but there seems to be a bug, so I'm trying to use Selenium to automate the pulling of reports). from selenium import webdriver from selenium.webdriver.support.ui import…
Litmon
  • 247
  • 3
  • 18
0
votes
2 answers

Python requests not pulling correct date range of data

I've been using requests to get station data for a few years now. I'm using the following code: url =…
Litmon
  • 247
  • 3
  • 18
0
votes
1 answer

Different numbers of commas between fields in CSV files, throwing errors with pd.readcsv

I'm using the NOAA weather dataset to build a machine learning model to predict weather data. Python cannot read in this data as there are: a.) commas in the fields, and b.) different numbers of commas between each field. Here are the headers and…
0
votes
1 answer

How do I ingest tide gauge data from the NOAA HTTP API into Thingsboard Professional?

NOAA provides tidal and weather data through their own http API, and I would like to be able to use their API to get data into ThingsBoard (Professional) every six minutes to overlay with my device data (their data are updated every 6 minutes). Can…
0
votes
2 answers

Downloading NOAA data

I'm trying to download NOAA data using the rnoaa package and I'm running into a bit of trouble. I took a vector from a dataframe and it looks like this: df <- dataframe$ghcnd Grabbing necessary column This gives me an output like: [1]…
0
votes
1 answer

Stream HTTP content but skip downloading some lines at all in Python

Edit- This is partially solved. The exact implementation details are not figured out yet, but the answer it to use HTTP range headers, as in Ezequiel's comment. In case my explanation is not clear enough, I am trying to replicate the procedure here:…
tomaszps
  • 66
  • 1
  • 6
0
votes
1 answer

Could not get data from the NOAA API calls

I am trying to get access to weather station data following the method mentioned on the website: https://towardsdatascience.com/getting-weather-data-in-3-easy-steps-8dc10cc5c859 I am using python for this. I am still learning python and I have no…
Summer
  • 11
  • 2
0
votes
1 answer

NOAA empty/missing data

Trying to pull hourly precipitation data from NOAA but get empty data sets {} for certain stations. I know there is data for the missing station because I can request it through the web page. The request r =…
0
votes
1 answer

Obtaining Weather Data From NOAA

I am trying to use the API to return data from the Chagrin Falls station in Ohio. I can get the data from the website so I know there is data, but the API does not return any values. I have a valid token and the examples in the documentation work,…
0
votes
2 answers

Extract monthly temperature data using coordinates an NC file

I am trying to read temperature data in R using a NOAA OI SST .nc file. I have temperature data per month, but, I am having trouble extracting the monthly average temperature data from the coordinates I want and putting it into a dataframe. I'm new…
loreniaolivas
  • 11
  • 1
  • 2
0
votes
1 answer

Calculating 30 year climate normal from gridded dataset in Python

I am trying to calculate the 30 year temperature normal (1981-2010 average) for the NARR daily gridded data set linked below. In the end for each grid point I want an array that contains 365 values, each of which contains the average temperature of…