Questions tagged [timescaledb]

An open-source time-series SQL database optimized for fast ingest and complex queries. Packaged as a PostgreSQL extension. QUESTIONS MUST BE ABOUT PROGRAMMING in order to be on-topic on Stack Overflow. Specifically, database administration is not on-topic for Stack Overflow.

TimescaleDB

TimescaleDB is an open-source database designed to make SQL scalable for time-series data. It is engineered up from PostgreSQL, providing automatic partitioning across time and space (partitioning key). It speaks full SQL and is correspondingly easy to use like a traditional relational database, yet scales in ways previously reserved for NoSQL databases.

Compared to the trade-offs demanded by these two alternatives (relational vs. NoSQL), TimescaleDB offers the best of both worlds for time-series data:

Features

Easy to Use

  • Full SQL interface for all SQL natively supported by PostgreSQL (including secondary indexes, non-time based aggregates, sub-queries, JOINs, window functions).
  • Connects to any client or tool that speaks PostgreSQL, no changes needed.
  • Time-oriented features, API functions, and optimizations.
  • Robust support for Data retention policies.

Scalable

  • Transparent time/space partitioning for both scaling up (single node) and scaling out (forthcoming).
  • High data write rates (including batched commits, in-memory indexes, transactional support, support for data backfill).
  • Right-sized chunks (two-dimensional data partitions) on single nodes to ensure fast ingest even at large data sizes.
  • Parallelized operations across chunks and servers.

Reliable

  • Engineered up from PostgreSQL, packaged as an extension.
  • Proven foundations benefiting from 20+ years of PostgreSQL research (including streaming replication, backups).
  • Flexible management options (compatible with existing PostgreSQL ecosystem and tooling).

Resources

691 questions
0
votes
1 answer

What should be optimal size for chunks inteval if I had 1 GB of data per hour

As I am using TimescaleDB I had 1 GB data per hour. I need to decide the optimal chunk time interval for the same so that performance will be maximum. Would that be 1 day or 1 hour or something else.
0
votes
0 answers

Multiple process fsync on single hdd stalls

fsync/fdatasync calls are expensive, but they are essential in databases as it allows for durability in ACID. As I've tested, when there is only one process do some writing and fsync periodically, every fsync takes about 50ms. But when there are…
Ju Piece
  • 249
  • 3
  • 9
0
votes
0 answers

Pre-loading TimescaleDB on Spilo container

I'm using the postgres operator with the Spilo build spilo-11:1.5-p7. How do I configure it to preload the timescaledb library? I've tried using sed to alter the config file like so: sed -i "s/bg_mon,/bg_mon,timescaledb,/"…
Andrew Matthews
  • 3,006
  • 2
  • 29
  • 42
0
votes
4 answers

(TimescaleDB) - How can I optimise a JOIN query on a dataset of ~2 billion rows. (too slow right now)

I have a database that sources a lot of sensor data (IOT like) - and I store this data in a table called events. (Structure below) Now users can also subscribe on changes of specific signals (by id) and they can request all signal events starting…
Navles
  • 90
  • 1
  • 6
0
votes
1 answer

postgres-11: extension not found while getting version

I added a new extension (timescaledb) like this: CREATE EXTENSION IF NOT EXISTS timescaledb CASCADE; Then execute below command to see list of extensions: select * from pg_extension; And then remove a row in pg_extension which was related to…
ArefehTam
  • 367
  • 1
  • 6
  • 20
0
votes
2 answers

postgresql timescaledb tutorial COPY and UPDATE speed

I'm following the tutorial: https://docs.timescale.com/v1.1/tutorials/tutorial-hello-nyc I'm curious to know how long it takes you to get the requests: "\COPY rides FROM nyc_data_rides.csv CSV" and UPDATE rides SET pickup_geom =…
ce.teuf
  • 746
  • 6
  • 13
0
votes
1 answer

PostgreSQL query to fetch data every day from 10 pm tonite to 6 am next day

I am new to PostgreSQL(timescaleDB) and writing the time series queries for my application. I am having a situation where I have to fetch the data for a selected time frame say (10 am to 6 pm) every day for a date range say (1st Dec to 26th…
Vishal Shetty
  • 1,618
  • 1
  • 27
  • 40
0
votes
0 answers

How to query PostgreSQL to get the total time by adding the date for all the available rows?

I am working on an energy application where we are monitoring Diesel Generator and Electric Meters of a factory. We are having this data in the database. Below are some records present in the DB. ip meter_id …
Vishal Shetty
  • 1,618
  • 1
  • 27
  • 40
0
votes
1 answer

Using Postgres's generate_series Function with ObjectionJS/KnexJS

I am trying to do advanced analytic queries to drive a web application. I am using Hapi, Objection, Knex, and Postgres with TimescaleDB. It all is working well for typical relational queries. However, I cannot figure out how to perform this…
technogeek1995
  • 3,185
  • 2
  • 31
  • 52
0
votes
3 answers

Optimize spike removal using PostgreSQL

I want to remove spikes directly from my data stored in a PostgreSQL-DB with TimescaleDB. My data is stored as values with an interval of 1 second, I want to get 5 minute averages calculated without spikes. I determine spikes using standard…
Tom
  • 91
  • 7
0
votes
2 answers

PostgreSQL - store real-time data of multiple subjects

Scenario: I'm trying to build a real-time monitoring webpage for ship operations I have 1,000 - 10,000 ships operating All ships are sending real-time data to DB, 24 hours - for 30 days Each new data inserted has a dimension of 1 row X 100 col When…
Eric Kim
  • 2,493
  • 6
  • 33
  • 69
0
votes
0 answers

Performance Optimization for inserts-only RDBMS with Queries

We have a postgres db with the timescaledb plugin to store time-based sensor data in the amounts of gigabytes and constantly growing. There are two tables in the db with indexes, foreign keys and everything as for a classic db for a customer…
OlliP
  • 1,545
  • 11
  • 22
0
votes
3 answers

Timescale not finding pg_config on AMI

I created a machine in AWS Cloud9 and I want to install timescale on that instance. I have previously installed and setup postgres 9.6 using yum. OS version is: Amazon Linux AMI release 2018.03 . When I run 'which pg_config', it is found here:…
Baub
  • 723
  • 4
  • 21
  • 36
0
votes
1 answer

panic: pq: password authentication failed for user "postgres" while adding the data into table through timescaledb-parallel-copy in hypertable

I am using PostgreSQL with Linux 16.04 version. I installed timescaledb in that. After words i am trying to insert huge data into the hypertable called new_observation through observation.csv it near by approx 5 GB data, while I copy by simply copy…
Bhavit
  • 21
  • 1
  • 2
0
votes
1 answer

Cannot succesfully install TimescaleDB on Postgres 10 (Windows Server 2016)

I am having trouble getting TimescaleDB to work on my windows server 2016 machine with Postgres 10. I open up a fresh windows server 2016 instance with AWS and I install Postgres using the windows GUI installer. (C:\Postgres). The installer…
Philip Nguyen
  • 871
  • 2
  • 10
  • 29
1 2 3
45
46