Questions tagged [data-stream]

In Connection-oriented communication, a data stream is a sequence of digitally encoded coherent signals (packets of data or data packets) used to transmit or receive information that is in the process of being transmitted.

In Connection-oriented communication, a data stream is a sequence of digitally encoded coherent signals (packets of data or data packets) used to transmit or receive information that is in the process of being transmitted.

In electronics and computer architecture, a data flow determines for which time which data item is scheduled to enter or leave which port of a systolic array, a Reconfigurable Data Path Array or similar pipe network, or other processing unit or block.

Often the data stream is seen as the counterpart of an instruction stream, since the von Neumann machine is instruction-stream-driven, whereas its counterpart, the Anti machine, is data stream driven.

The term "data stream" has many more meanings, such as by the definition from the context of systolic arrays.

Wikipedia: http://en.wikipedia.org/wiki/Data_stream

276 questions
0
votes
0 answers

How do I merge audio streams into one file using javax.sound.sampled?

I've been learning Java to build what equates to an audio file merger/mixer. The idea is to insert voice files into a 4 minute music bed. I am able to create individual streams and output to different files, but I need to insert the data using an…
0
votes
0 answers

GIT - PHP - is it possible to read from GIT via API as data stream without saving into files first?

I need to read all files for a GIT branch (approx 10000 xml files) and then determine which has changed (since they have a Generated timestamp inside each file - I need to remove it first, then I'm able to identify if the file has changed or not…
0
votes
1 answer

Flink DataStream element not updating

I have a code like: DataStream stream = ... stream.map(x => { x.setVal(10); return x; }); // Sample class looks like this: class Sample { int val = 5; public void setVal(int val) { this.val = val; } } When I…
0
votes
1 answer

If i have large amount of data, should i create multi data stream instead of a single data stream

If the storage capacity is about several Trillionbyte, should i use a single data stream? like this: data stream aaa, contains index:aaa-2022.01.06-0001,aaa-2022.01.06-0002,aaa-2022.01.07-0003 or several data stream data stream one:…
Zephery Wen
  • 21
  • 1
  • 6
0
votes
1 answer

Dataflow job template fails for datastream to spanner

Datastream to Spanner Dataflow template fails, followed below doc: https://cloud.google.com/dataflow/docs/guides/templates/provided-streaming#datastream-to-cloud-spanner gcloud beta dataflow flex-template run ora2span1 \ …
0
votes
1 answer

put file into firehose data stream

Using this command, I can put data into my firehose stream. It automatically creates a file in the destination bucket and puts the data value in that file. The file has an unknown data type. aws firehose put-record --delivery-stream-name mystream…
user13067694
0
votes
1 answer

SteamedResponse not working in lumen on other server

I am using Lumen for a set of APIs. using streamedresponse built in library of symphony. use Symfony\Component\HttpFoundation\StreamedResponse; protected function getFileResponseHeaders($filename) { return [ 'Cache-Control' =>…
Shahid Rafiq
  • 669
  • 1
  • 12
  • 27
0
votes
1 answer

Flink streaming: Do the events get distributed to each task slots separately according to their keys?

So for example if I have events in order with key A and events in order with key B and a parallelism of 2. Do all the events with key A go to one task slot and key B ones go to the other task slot? What happens if i only get events in order with key…
0
votes
1 answer

Await the Completion of a Readable Stream ES8 TypeScript, fs

My code isn't working because the file hasn't unzipped before the next line executes. This is my function for unzipping: import { createGunzip } from 'zlib'; import { createReadStream, statSync, createWriteStream } from 'fs'; function…
SarahJessica
  • 473
  • 1
  • 7
  • 18
0
votes
1 answer

Flink streaming: when does a global window start?

When using a global window, does the window start from the moment the job starts up and we receive the first event or is it also starting from 00:00:00 1 January 1970 as per this answer: flink Windows, when do they start.
Akula
  • 59
  • 7
0
votes
0 answers

How to accumulate SQL data using websocket with sqlalchemy on python

I am using binance websocket to create sqlite database after closing of each candle on 1min interval. For this purpose I've create the following piece of code. import pandas as pd from binance.client import Client from binance import…
Keyvan Tajbakhsh
  • 103
  • 1
  • 10
0
votes
0 answers

What can I do to adjust the raw stream from Camlink 4K before writing it to a file? Can I use Bitstream filters to limit framerate and final bitrate?

Here's the setup, I have an Acer Aspire 5 (mobile Ryzen 3, integrated graphics) running Manjaro (don't ask) a 4Kp24/1080p60 mirrorless dslr camera and an Elgato Camlink 4K usb dongle. Understandably, the Acer cannot encode very well at all... so to…
0
votes
1 answer

Dataframe append and drop_duplicates problem

So, I have a dummy df like this and save it into csv: import pandas as pd import io old_data =…
0
votes
1 answer

Flink Datastreams Evictor

I'm using Flink DataStreams to join 2 streams (a Book stream and a Publisher stream). I'm trying to remove elements by using evictor in case they are deleted from the database, which is indicated with the variable deleted. When I run the code…
Diogo
  • 3
  • 1
  • 4
0
votes
1 answer

How Apacheflink's DataStream API supporting batch processing of events

My producer is apache Kafka and we want to listen batch of events to process them and write that processed events into the database. If I use stream/batch every event will hit one query to DB. I don't want to hit every event as one query. How can I…