Stack Overflow
Stack Overflow

Questions tagged [sliding-window]

In data analysis, sliding windows are advancing sub-lists inside lists which allow, e.g., computation of a record's change from the previous record or next record. In networking, a sliding window may refer to a flow control technique that maintains windows of sequential frames sent or received without a corresponding acknowledgement.

In data analysis, sliding windows are advancing sub-lists inside lists which allow, e.g., computation of a record's change from the previous record or next record. In SQL in particular, the analytic functions LEAD(), LAG(), and computations OVER() a changing subset of query results involve sliding windows.

In networking, a sliding window may refer to a flow control technique that maintains windows of sequential frames sent or received without a corresponding acknowledgement.

583 questions
6
votes
3 answers

Calculate median of a sliding window with awk

I need to produce a sliding window of millions of lines and to calculate the median of column 3. My data looks like this with column 1 always being the same, column 2 equaling the line number and column 3 being the information that I need the median…
acalcino
  • 315
  • 1
  • 4
6
votes
1 answer

Sliding window train/test split for time series data

I have a series that contains 36 data points and I would like to do a sliding window training and test on it. I've looked at TimeSeriesSplit() but it only does something like ('TRAIN:', array([0, 1, 2]), 'TEST:', array([3, 4, 5])) ('TRAIN:',…
Angie Li
  • 175
  • 3
  • 14
6
votes
1 answer

What are the differences between Kernel Buffer, TCP Socket Buffer and Sliding Window

Here's my understanding of incoming data flow in TCP/IP Kernel reads data to its buffer from network interface Kernel copy data from its buffer to TCP Socket Buffer, where Sliding Window works The program that is blocked by read() wakes up and copy…
asap diablo
  • 178
  • 2
  • 13
6
votes
2 answers

Fuzzy matching/chunking algorithm

Background: I have video clips and audio tracks that I want to sync with said videos. From the video clips, I'll extract a reference audio track. I also have another track that I want to synchronize with the reference track. The desync comes from…
Confluence
  • 1,331
  • 1
  • 10
  • 26
6
votes
2 answers

SlidingWindows for slow data (big intervals) on Apache Beam

I am working with Chicago Traffic Tracker dataset, where new data is published every 15 minutes. When new data is available, it represents records off by 10-15 minutes from the "real time" (example, look for _last_updt). For example, at 00:20, I…
tyron
  • 3,715
  • 1
  • 22
  • 36
6
votes
1 answer

Forecasting model predict one day ahead - sliding window

I'm struggeling with a problem. I'm using SparkR for time series forecasting, but this scenario can also transferred to normal R environment. Instead of using ARIMA model I want to use regression models such as Random Forest Regression etc. to…
Daniel
  • 552
  • 2
  • 9
  • 29
6
votes
1 answer

How to implement a better sliding window algorithm?

So I have been writing my own codes for HoG and its variant to work with depth images. However, I am stuck with testing my trained SVM in the detection window part. All that I've done right now is to first create image pyramids out of the original…
sub_o
  • 2,642
  • 5
  • 28
  • 41
6
votes
2 answers

Processing a large .txt file in python efficiently

I am quite new to python and programming in general, but I am trying to run a "sliding window" calculation over a tab delimited .txt file that contains about 7 million lines with python. What I mean by sliding window is that it will run a…
flz416
  • 61
  • 2
6
votes
2 answers

Minimum over a sliding window

Is there specific algorithm that allows me to maintain a min/max over a small/medium sized sliding window (typical size is 600, with all elements being integers)? The window is really the last N observations in a stream. So, I add a new observation…
KS1
  • 165
  • 1
  • 10
5
votes
1 answer

Apache Beam Performance Between Python Vs Java Running on GCP Dataflow

We have Beam data pipeline running on GCP dataflow written using both Python and Java. In the beginning, we had some simple and straightforward python beam jobs that works very well. So most recently we decided to transform more java beam to python…
Jie Zhang
  • 149
  • 10
5
votes
2 answers

Angular - http interceptors - http rate limiter - sliding window

I am having a use case where I need to limit the number of outgoing http requests. Yes, I do have rate limiter on the server-side but a limit on the number of active http requests is also need on the front end too.For that reason I am attempting to…
matcheek
  • 4,887
  • 9
  • 42
  • 73
5
votes
2 answers

Apache Flink KeyedStream after window operator behavior clarification

I'm requesting clarification on exactly how Apache Flink (1.6.0) handles events from KeyedStreams after the events have been sent through a window and some operator (such as reduce() or process()) has been applied. Assuming a single node cluster,…
John Stone
  • 187
  • 9
5
votes
1 answer

Sliding window minimum algorithm

This is a homework problem. Let A[] is an array of integers and integer K -- window size. Generate array M of minimums seen in a window as it slides over A. I found an article with a solution for this problem but did not understand why it has O(n)…
Michael
  • 41,026
  • 70
  • 193
  • 341
5
votes
2 answers

Non-Maximum Suppression on Detected Windows MATLAB

I am currently detecting heads in a CCTV image. I am using a HOG detector + SVM and I am using the sliding window technique to detect the heads. Of course, when I am scaling the image, I am having multiple detection/bounding boxes of the same head.…
user2541516
  • 79
  • 1
  • 9
5
votes
1 answer

Sliding window algorithm for activity recognition

I want to write a sliding window algorithm for use in activity recognition. The training data is <1xN> so I'm thinking I just need to take (say window_size=3) the window_size of data and train that. I also later want to use this algorithm on a…
csc
  • 61
  • 1
  • 4
1 2
3
…
38 39