Stack Overflow
Stack Overflow

Questions tagged [data-stream]

In Connection-oriented communication, a data stream is a sequence of digitally encoded coherent signals (packets of data or data packets) used to transmit or receive information that is in the process of being transmitted.

In Connection-oriented communication, a data stream is a sequence of digitally encoded coherent signals (packets of data or data packets) used to transmit or receive information that is in the process of being transmitted.

In electronics and computer architecture, a data flow determines for which time which data item is scheduled to enter or leave which port of a systolic array, a Reconfigurable Data Path Array or similar pipe network, or other processing unit or block.

Often the data stream is seen as the counterpart of an instruction stream, since the von Neumann machine is instruction-stream-driven, whereas its counterpart, the Anti machine, is data stream driven.

The term "data stream" has many more meanings, such as by the definition from the context of systolic arrays.

Wikipedia: http://en.wikipedia.org/wiki/Data_stream

276 questions
2
votes
1 answer

What is the proper way of increasing the watermark when using a joinFunction in Flink?

I have two streams, stream A and stream B. Both streams contain the same type of event which has an ID and a timestamp. For now, all i want the flink job to do is join the events that have the same ID inside of a window of 1 minute. The watermark is…
Akula
  • 59
  • 7
2
votes
0 answers

How to read parquet files with Flink as Case Class (scala)?

With spark we can easily read parquet files and use it as a Case Class with the following code: spark.read.parquet("my_parquet_table").as[MyCaseClass] With Flink, I'm having a lot a trouble to do that. My Case Class comes from an Avro schema, so it…
Fray
  • 173
  • 6
2
votes
0 answers

Data stream clustering using scikit-multiflow

I have a CSV file data set as follows and I wrote my stream clustering algorithm. I wanna generate stream data to simulate the process. I found scikit-multiflow. I have a question that how can I do this? Now I pretend and use row by row.
Kimi
  • 21
  • 1
2
votes
1 answer

Mulesoft with Salesforce Streaming API using CDC

I am working on a Mule API flow testing out the Salesforce event streams. I have my connector set up and subscribed to a streaming channel. This is working just fine when I create / update / delete contact records, the events come through and I…
SBB
  • 8,560
  • 30
  • 108
  • 223
2
votes
1 answer

What is a data stream in DirectX 9?

I am practicing drawing in Direct3D9, and ran into a little problem. For example, the first parameter in d3ddev->SetStreamSource(1, NULL, 0, sizeof(CUSTOMVERTEX)); is to specify the "data stream", but I don't know what that is. I've got it drawing…
jacob
  • 35
  • 7
2
votes
1 answer

Parsing json from incoming datastream to perform simple transformations in Flink

I am using Apache Flink with AWS Kineses for the first time. Basically my objective is to transform incoming data from a Kinesis stream in such a way that I can perform simple transformations such as filtering and aggregating. I am adding the source…
observer0107
  • 21
  • 1
  • 2
2
votes
0 answers

How to fix " 'java.lang.NoClassDefFoundError: scala/Product$class' error while flatMapping DataStream to case class in Apache Flink "

Trying to consume twitter stream with Apache Flink and flatMap it to a case class, as soon as it tries to transform the tweet, fails with java.lang.NoClassDefFoundError:…
Vish
  • 21
  • 1
  • 5
2
votes
1 answer

How to set `--expected-size` option in `boto3.client('s3').upload_fileobj()`?

Since there is ability to set argument --expected-size in aws s3 cp in order to ensure files/data larger than 5GB is uploaded successfully, how can it be set in python version of it: boto3 upload_fileobj? I'm trying to upload database backup as data…
ritmas
  • 345
  • 1
  • 4
  • 9
2
votes
1 answer

How to find the rank of an element in a stream of numbers efficiently?

Recently I'm trying to find the median of a stream of numbers with the following conditions: 3-pass algorithm O(nlog(n)) time O(sqrt(n)) space The input is repeated 3 times, including n, the number of integers, followed by n integers a_i such…
Vincent Tsai
  • 23
  • 5
2
votes
3 answers

Optimal Way To Generate A Balanced Binary Search Tree From A Stream Of Sorted Numbers

I have an input stream of integers coming in an ascending order, my task is to create a balance binary search tree out of that stream, on the fly. I have gone through the link:BBST from a stream of integers and understood that we can make use of…
Prashanth Peddabbu
  • 92
  • 1
  • 1
  • 11
2
votes
1 answer

Send video stream/images to a websocket server

I'm developing an application that processes images. Having a HTML front-end I have to capture images from the webcam (using video tag) and send them to the server continuously. Then images are going to be analyzed and when the objects are…
Kalatxori
  • 45
  • 1
  • 9
2
votes
1 answer

Github error while trying to push

So I have commit all my local changes successfully, but then when I try to use git push, it gives me the following error message: Error: inflate: data stream error (unknown compression method) fatal: loose object…
kdp
  • 21
  • 2
2
votes
0 answers

Index Sort: serialization of data stream based on index

I have two streams from where I am getting the data. I would like to output a stream sorted by indexes of two current stream. for simplicity here is sample code: While (1) { read.stream1(buffer1,size); read.stream2(buffer2,size); int index1 =…
user3217310
  • 144
  • 1
  • 17
2
votes
2 answers

Using terminal to record/save a data stream

I want to be able to save a data stream which i am returning using the curl command. I have tried using the cat command, and piping it the curl command, however i'm doing it wrong. The code im currently using is: cat > file.txt | curl…
jonhurlock
  • 1,798
  • 1
  • 18
  • 28
2
votes
1 answer

how to make Sliding window model for data stream mining?

we have a situation that a stream (data from sensor or click stream data at server) is coming with sliding window algorithm we have to store the last (say) 500 samples of data in memory. These samples are then used to create histograms, aggregations…
Zia
  • 345
  • 2
  • 5
  • 12
1 2
3
…
18 19