Questions tagged [data-stream]

In Connection-oriented communication, a data stream is a sequence of digitally encoded coherent signals (packets of data or data packets) used to transmit or receive information that is in the process of being transmitted.

In Connection-oriented communication, a data stream is a sequence of digitally encoded coherent signals (packets of data or data packets) used to transmit or receive information that is in the process of being transmitted.

In electronics and computer architecture, a data flow determines for which time which data item is scheduled to enter or leave which port of a systolic array, a Reconfigurable Data Path Array or similar pipe network, or other processing unit or block.

Often the data stream is seen as the counterpart of an instruction stream, since the von Neumann machine is instruction-stream-driven, whereas its counterpart, the Anti machine, is data stream driven.

The term "data stream" has many more meanings, such as by the definition from the context of systolic arrays.

Wikipedia: http://en.wikipedia.org/wiki/Data_stream

276 questions
0
votes
1 answer

Flink Tumbling Window labelling

I have a scenario with a flink application that receives data streams in the following format: { "event_id": "c1s2s34", "event_create_timestamp": "2019-03-07 11:11:23", "amount": "104.67" } I am using the following tumbling window to find the sum,…
observer0107
  • 21
  • 1
  • 2
0
votes
1 answer

Power BI: Add a chart from a streaming dataset to Power BI desktop report

I have created a Power BI reporting file (.pbix) with some pages and charts. One of the page has a few charts that show LIVE data, but the charts are from regular SQL Server VIEW datasets. I created a Push Streaming Dataset, and while I can create a…
Shahid Thaika
  • 2,133
  • 5
  • 23
  • 59
0
votes
1 answer

How to transform Flink Source [ Data Stream ] String value to Map?

Trying to convert Apache Flink Source String to Map using scala. My Source Streaming String : key1=value1key2=2000-12-17 00:00:00key3=Testkey4=08.89198key5=103.000 Code : val environment = StreamExecutionEnvironment.getExecutionEnvironment val out …
Thirunavukkarasu
  • 361
  • 1
  • 2
  • 13
0
votes
2 answers

Transferring a Large Collection of Small-size Files

The usual methods of transferring data (scp, http and ftp utilities such as curl or wget) work fine when your data is in the MB or even GB range, but when you have very large collections of small-size files (e.g 10KB) there, it will be very slow to…
0
votes
1 answer

Streaming data to .csv not showing results C#

I am attempting to stream data from a SQLServer DB to a .CSV file; However, after execution, the .csv is still blank. The first while loop is/was for testing purposes which executed correctly. I know I am doing something wrong in my Streaming…
Andrew
  • 61
  • 1
  • 6
0
votes
1 answer

What is the relation between Serialization and streaming?

Always when I find some articles or videos are talking about stream they're necessairly talking about serialization? what is the relation between those? or to be specific, Could we say that the data stream always needs serialization or could we…
HISI
  • 4,557
  • 4
  • 35
  • 51
0
votes
1 answer

How to get raw data from sensor(RFID)?

I need to get raw data from a set of RFID sensors. The sensor has a default application where I can see the data and they are continuously floating on the screen. Unfortunately, I can not feed the data to my program using input/output file handling…
Imtiaz E
  • 1
  • 1
0
votes
1 answer

SQL Server stored procedure to analyze live streaming data and reporting differences

I have a live data stream on a 2 minutes interval, that I wish to analyze in (near) real time. A snippet of this data is shown here: This data is getting stored in a SQL Server table. Now, I am trying to code a stored procedure in SQL Server 2008…
Suraj_j
  • 151
  • 2
  • 14
0
votes
1 answer

How to store dataset with protobuf

I need to store flexible data sets compactly and with ability to streaming. Data set contain tabular data, each rows contain same types. Whats better: - write one big proto-message with repeated proto-messages? - multiple proto messages writes…
gabba
  • 2,815
  • 2
  • 27
  • 48
0
votes
1 answer

Flink map stream csv file into Tuple

I am trying to map a CSV file, already consumed by Flink and produced by Kafka, into a Tuple4. My CSV file has 4 columns and I want to map each row into a Tuple4. The problem is that I do not know how to implement the map() and the csv2Tuple…
0
votes
1 answer

How does Waze validate a user inputs and make decisions based on it?

The Waze application receives explicit input from users referring to many issues: traffic, police traps, construction, speedcams, accidents, weather conditions, or any hazards along the way. How does Waze validate whether these inputs are true or…
0
votes
1 answer

How To read/iterate through a Datastream in Python

I have a stream created at port 9999 of my computer. I have to implement DGIM Algorithm on it. However I am not able to read the bits in the Data stream one by one. Below is my code: from pyspark import SparkContext from pyspark.streaming…
0
votes
0 answers

Install Kinesis Firehose on IBM AIX

I have multiple databases on IBM AIX and want to connect my databases to AWS Kinesis Firehose but the only way that I found is through Kinesis Agent which is not compatible with AIX. I saw on some webpage that they recommended modifying Kinesis…
0
votes
2 answers

separate stream of click events by minimum delay between each other with Rxjs

i have an issue when user click very fast on two buttons that update in firebase database same object and the same property. the issue that only one of the request save and the rest override. its happen in case user clicked on both button on the…
0
votes
2 answers

Streaming with Druid, Kafka, Superset

I am testing data streaming by using Kafka, Druid and SuperSet. I am at the point where I have some data in Druid (see 1. picutre). After that I am able to generate Druid datasource in Superset by option "Refresh Druid metadata" (see 2.pic) Problem…