Questions tagged [pipelinedb]

Questions related to PipelineDB - A PostgreSQL extension for high-performance time-series aggregation

51 questions
0
votes
1 answer

How can SASL/PLAIN credentials be provided when connecting from pipelinedb to kafka?

We want to ingest data from Kafka through PipelineDB. Our Kafka setup requires SASL/PLAIN authentication. How can I configure the SASL user and password with the pipelinedb / pipeline_kafka PostgreSQL extension?
tekbe
  • 193
  • 1
  • 8
0
votes
0 answers

PipelineDB arrival_timestamp field does not appear

I'm using PipelineDB together with pgAdmin, and when I go to create a foreign table the "arrival_timestamp" field does not appear. Furthermore, when I create a continuous view, an error is generated: unidentified sw parameter. This is the guide I…
Zatchy
  • 1
0
votes
1 answer

AWS Aurora and PipelineDB

Wanted to know if PiplelineDB extension will work with AWS Aurora PostgreSQL-compatible DB. Does anyone know if there are plans on the road-map to support this?
Prasad
  • 11
0
votes
0 answers

Pipelinedb gets stuck under high load, worker process eats 100% CPU doing nothing

Note: I am looking for any hints on how to debug this issue, not necessarily a direct answer to this specific problem. I am measuring the performance of PipelineDB for use in our system. I have defined a few continuous views (Calculating sums, top-K…
Oren Shemesh
  • 1,538
  • 1
  • 8
  • 6
0
votes
1 answer

Django and Pipelinedb: Programming Error: column .location_id does not exist

I'm working on a project using Django and postgresdb with streaming data coming in using pipelinedb. A sync script is running this. Everything is Dockerized. The data is updated every 60 seconds on the test server. I added this field to the…
Nathan
  • 291
  • 2
  • 5
  • 17
0
votes
1 answer

relcache reference is not owned by resource owner TopTransaction

I created a continunue Trasformer in pipelinedb(base on postgresql 9.5.3) to capture data that the device status code changed. Then this CONTINUOUS TRANSFORM will call a function(trigger), In the function, the code calculates the time range of…
0
votes
1 answer

Is there a PipelineDB package for Laravel or Native PHP?

I was asking for PipelineDB if there is a package for laravel or Native PHP, so I can use it in my current project?
0
votes
1 answer

Sliding Windows vs TTL in PipelineDB

I am new in PipelineDB and stream analytics, I have these two SQL commands; CREATE CONTINUOUS VIEW timing_hashtags WITH (sw = '1 minutes') AS SELECT h, minute(arrival_timestamp) as minuteOfArrival, COUNT(*) as quantity FROM hashtag_stream GROUP BY…
Batuhan Tüter
  • 301
  • 1
  • 3
  • 14
0
votes
2 answers

Can table be used as a stream in PipelineDB

let's assume we have a table test_table like this create table test_table(x integer); Is it possible to create a continuous view from this table? Something like this: create continuous view test_view as select sum(x) as x_sum from test_table; When…
Josip Vujcic
  • 102
  • 1
  • 9
0
votes
1 answer

Can Continuous Views be reinitialized efficiently?

I'm new to PipelineDB and have yet to even experience it at runtime (installation pending ...). But I'm reading over the documentation and I'm totally intrigued. Apparently, PipelineDB is able to take set-based query representations and…
Jason Kleban
  • 20,024
  • 18
  • 75
  • 125
0
votes
1 answer

pipelinedb unrecognized node type: 5009

I have a problem creating Continuous Transform from any client but psql. Reproduce: OS: OSX EL Capitan 10.11.6 Docker version 17.09.0-ce, build afdb6d4 docker run -d -p 5432:5432 pipelinedb/pipelinedb Now, I connect to DB via PHPStorm 2017.2, it…
0
votes
1 answer

How do I build and install PL/Python against a custom Postgresql (e.g. PG_CONFIG)?

I am using PipelineDB, which is a customized, yet compatible fork of Postgresql. I want to install the plpythonu.control into it to be able to use the PL/Python for user-defined functions. I am supposed to "build" the plpythonu extension against…
Jason
  • 2,006
  • 3
  • 21
  • 36
0
votes
1 answer

Differences in PipelineDB and AWS Kinesis Analytics use of Reference data

I'm doing a comparison of AWS Kinesis Analytics to PipelineDB use of "reference" data in STREAM SQL. http://docs.aws.amazon.com/kinesisanalytics/latest/dev/limits.html http://docs.pipelinedb.com/joins.html#joins Question 1: JOIN on multiple…
Jason
  • 2,006
  • 3
  • 21
  • 36
0
votes
1 answer

How to Update kafka extension in Pipelinedb

Can anyone tell me how to do to update the kafka extension in PipelineDB, currently use old version, I want to upgrade to the latest version.
luiz kava
  • 187
  • 1
  • 2
  • 14
0
votes
1 answer

Default date for insert doesn't change in continuous transformation

I created the table below. create table foo ( ibutton text NULL, severidade int4 NULL, dt_insercao timestamptz NULL DEFAULT now() ) My insert: insert into foo (ibutton, severidade) values ('aa', 4); For any cases of the value of…
luiz kava
  • 187
  • 1
  • 2
  • 14