Stack Overflow
Stack Overflow

Questions tagged [historical-db]

is for databases that store data in historical tables usually containing a timestamp and a value for each record (with a few ancillary fields), in a non-relational way.

Historical-DB is for databases that store historical data in tables usually containing a timestamp and a value for each record (with a few ancillary fields). They are used in historian applications, and can usually be queried with SQL, even though they are not relational databases.

Some Examples:

53 questions
14
votes
6 answers

Technological solutions for extremely long term data archiving?

Are there any good technical solutions for extremely long term archiving of data, for example for 25 to 100 years? Somehow I just don't have a lot of confidence that a SQL 2000 backup file will be usable in court cases or for historians in 25 to 100…
MatthewMartin
  • 32,326
  • 33
  • 105
  • 164
3
votes
0 answers

Historical data ingestion and querying in Time Series Insights

We're evaluating Azure Time Series Insights (Preview) for ingesting historical IoT telemetry data. We use device timestamp instead of event enqueued timestamp as Timestamp property (Non-default behavior) We've hit a snag around ingesting historical…
SuperManu
  • 77
  • 8
3
votes
2 answers

Yahoo Finance ValueError: zero-size array to reduction operation maximum which has no identity

I have been trying to pull data from Yahoo Finance and I keep getting this strange error. So I run this code : #Importing Modules/Libraries import pandas as pd pd.core.common.is_list_like = pd.api.types.is_list_like from pandas_datareader import…
DeepLearningBeast
  • 31
  • 2
3
votes
4 answers

Getting Stock Historical Data from API for a python project

I am making a stock analysis program, but for that, I need the NYSE stock historical data API. I have searched everywhere, but could not find helpful solutions (i.e. Yahoo/Google Finance APIs are down). I tried the Alpha Vantage API, but it did not…
Ayo
  • 81
  • 1
  • 1
  • 8
3
votes
1 answer

Python: How to set ticker in krakenex for fetching historical OHLC-data?

I am trying to load OHLC-data form Kraken with the API krakenex for my research project. But I can't figure out my mistake. I am using a modified version of https://github.com/veox/python3-krakenex/blob/master/examples/trades-history.py in python…
Tomatenmarc
  • 31
  • 3
2
votes
1 answer

Fail to draw historical data from TWS API

def get_IB_historical_data(self, ibcontract, tickerid, durationStr, barSizeSetting): historic_data_queue = finishableQueue(self.init_historicprices(tickerid)) self.reqHistoricalData( tickerid, # tickerId, ibcontract, #…
Ho Chuen Cheung
  • 23
  • 4
2
votes
1 answer

Need historic data + refresh data (Power BI)

I have been creating a report which needs to show the whole status for the products. For example raw data during the week 1. During week 2, after I refresh the raw data. What I need to show in BI report is in this way, I have did some research…
Nick
  • 71
  • 1
  • 5
2
votes
2 answers

How to store historical data using Django

I am new to Django and am trying to figure out how to store historical data and be able to reference any data point from a date in the past. Say I want to store data on a kids height change as he grows and be able to compare his height at day 400 to…
O. Davis
  • 45
  • 1
  • 5
2
votes
1 answer

Retaining volatile data in orders

Lets assume I have tables: customers and orders, I'd like to store order with unchangeable customer information (like address, name etc.) but do not want to copy all this information to orders table. There are three options: a) Mapping table for…
ololoken
  • 58
  • 4
1
vote
2 answers

Reporting on historical data - when to use current or historic data (warn user about changing the meaning of a record?)

This is similar to this question Basically I am writing the database and software for a building monitoring system. The system monitors things like temperature, humidity, pressure of units (such as fridges). When a report is generated for a…
Mark
  • 1,296
  • 13
  • 28
1
vote
2 answers

How to store historical server data?

I was looking for advice on how to store data in a database for historical data mining purposes. If I can get the state of an entity at a given time, what is the best way to store it so that I can historically mine that data, predicting what the…
s73v3r
  • 1,751
  • 2
  • 22
  • 48
1
vote
1 answer

For Cassandra, how should the historical data be taken care of?

Say I have a dozen CF/SCF and have the write traffic keeps coming (might have spikes). Over the time, a few of them will growing much faster (due to their own nature) than others and data table could be huge. At that stage, should they still be…
tom
  • 14,273
  • 19
  • 65
  • 124
1
vote
1 answer

backfill data using previous values in Snowflake

I have a table in Snowflake with data that updates at the end of the month as well as data that updates every day (t2). I've joined these tables and now I need to lag the data points that update monthly until the monthly filingDate is equal to…
naomitrina
  • 31
  • 3
1
vote
1 answer

How can I assign chronological order position or each customers purchase history using Python

I have a data set of all customers purchases made in the last 5 years with the below columns as an example. CUSTOMER ID | ORDER NUMBER | ORDER DATE (DateTime) | ITEM ID What I need to do is assign each individual customer order position (i.e…
RJL
  • 13
  • 3
1
vote
1 answer

KuCoin API error for historical data in python

I need to download 1min kline data from 2019 from Kucoin API. It allows to get 1500 data points per request, so I created a function to get the length I need in chunks. The problem is that for some chunks I get an error. KucoinAPIException(
John
  • 27
  • 5
1
2 3 4