Stack Overflow
Stack Overflow

Questions tagged [data-stream]

In Connection-oriented communication, a data stream is a sequence of digitally encoded coherent signals (packets of data or data packets) used to transmit or receive information that is in the process of being transmitted.

In Connection-oriented communication, a data stream is a sequence of digitally encoded coherent signals (packets of data or data packets) used to transmit or receive information that is in the process of being transmitted.

In electronics and computer architecture, a data flow determines for which time which data item is scheduled to enter or leave which port of a systolic array, a Reconfigurable Data Path Array or similar pipe network, or other processing unit or block.

Often the data stream is seen as the counterpart of an instruction stream, since the von Neumann machine is instruction-stream-driven, whereas its counterpart, the Anti machine, is data stream driven.

The term "data stream" has many more meanings, such as by the definition from the context of systolic arrays.

Wikipedia: http://en.wikipedia.org/wiki/Data_stream

276 questions
0
votes
1 answer

Apache Flink join different DataStreams on specific key

I have two DataStreams, the first one called DataStream source which receive records from a message broker, and the second one is a SingleOutputOperator events, which is the result of mapping the source into Event.class. I have a uses…
Alter
  • 903
  • 1
  • 11
  • 27
0
votes
1 answer

Can I use Google analytics without setting up "data stream"?

Can I use Google analytics without setting up "data stream"? or is it required to use? Actually, Google analytics keeps showing this warning/error in Google analytics. In case, I use it. Would it be enough to explain in cookie consent that we are…
Prince Sodhi
  • 2,845
  • 2
  • 21
  • 35
0
votes
0 answers

Best way of handling streamed data in Python

I am currently working on a trading bot coded in Python. It listens to a websocket stream giving me a dict of OHLC data on 180 symbols (180 dicts of 7 values each second). Every minute I wanna calculate a bunch of indicators for each symbol. For…
moritz_gundelach
  • 1
  • 1
0
votes
1 answer

Python: dispatched on-line processing of high volume real-time datastreams

I have some high volume datastreams coming in on different websockets (sensor data - several TBs per month), for which I want to guarantee that all data is stored, even during high load. So I want to dispatch the data to my database and real-time…
hellovertex
  • 23
  • 5
0
votes
1 answer

Fraud Detection DataStream API tutorial questions

I am following the tutorial here. Q1: Why in the final application do we clear all states and delete timer whenever flagState = true regardless of the current transaction amount? I refer to this part of the code: // Check if the flag is set if…
Tessa
  • 127
  • 1
  • 7
0
votes
1 answer

How can i use Debezium connector with Apache Flink

I'm trying to create a table whit flink's table API that uses a Debezium source function, I found an implementation of these functions here https://github.com/ververica/flink-cdc-connectors, and used them like this on my code: val debeziumProperties…
whiteskull
  • 67
  • 9
0
votes
1 answer

Streaming data from the R&S rto oscilloscope - UnicodeDecodeError python3.6

I'm trying to get the signal data for a specific channel on the Rhode and Schwarz RTO oscilloscope . I'm using the vxi11 python(3.6) library to communicate with the scope. On my first try, I was able to extract all the data of the scope channel I…
has tau
  • 1
  • 2
0
votes
0 answers

Streaming with listen/notify Fails

I'm trying to use channels in postgresql to communicate a python script the values that are being inserted. The main goal is to stream data from postgresql to a python script. I have read that NOTIFY and LISTEN are a good way to do this, but I'm…
Pedro Pablo Severin Honorato
  • 377
  • 3
  • 16
0
votes
1 answer

Having trouble getting readAllBytes() method to work

Other students in my class have gotten this code to work, but I get an error. I am trying to use the readAllBytes() method for an assignment and I can't get it to work. My teacher there is another way he intended it to work using That method is not…
Constantine
  • 1
  • 1
  • 4
0
votes
0 answers

Netcat xxx.xxx.x.xx: inverse host lookup failed: h_errno 11004: NO_DATA

I am using netcat on Windows 10 to fetch a data stream from a data acquisition module. The command I'm using is: nc -u -l -vv -p 5168 > log.txt But then, looking at the verbose, I got: listening on [any] 5168 ... xxx.xxx.x.xx: inverse host lookup…
Calvin9
  • 1
  • 1
  • 2
0
votes
0 answers

Use records from S3 file to hit API endpoint

trying to gather ideas on how to design a system using only AWS resources. Basically, I have a file in S3 (tsv for the sake of the argument) with a variable number of records (1000s to millions) For each records (row) I will need to hit an API…
Alexander
  • 339
  • 3
  • 13
0
votes
1 answer

Could someone provide me with some tips of how I could implement a given algorithm for distributed streaming in Flink?

I'm trying to implement Algorithm 2 (page 4) from this scientific paper (https://www.cse.ust.hk/~yike/pods10-cdsample.pdf) in Flink and I would be glad if someone helped me with some tips on how to approach this task (which State should I use, maybe…
T.D.
  • 11
  • 4
0
votes
1 answer

How to load huge amount of data from spring boot to reactjs?

I have two applications, spring boot backend and react frontend. I need to load a lot of data (lets say 100 000 objects, each 3 Integer fields), and present it on a leaflet map. However i don't know which protocol should I use. I thought about two…
invictusqq
  • 51
  • 1
  • 5
0
votes
1 answer

How store streaming data from Amazon Kinesis Data Firehose to s3 bucket

I want to improve my current application. I am using redis using ElastiCache in AWS in order to store some user data from my website. This solution is not scalable and I want to scale it using Amazon Kinesis Data Firehose for the autoscale…
J.C Guzman
  • 1,192
  • 3
  • 16
  • 40
0
votes
1 answer

Finishing write stream in external module upon program error

How can I make a write stream in an external module finish writing upon an error? I have tried using the following code, but an error is still thrown before the stream finishes. I have also tried to pass a callback (containing throw err;) to the…
Daemon Beast
  • 2,794
  • 3
  • 12
  • 29
1 2 3
…
18 19