Questions tagged [low-latency]

For questions pertaining to the measurement or improvement of latency in a system.

In computing terms, describe the time it takes to perform an action. Low latency implies this should be particularly short. It is usually in the range of timings which cannot be seen, only measured.

Low Latency implies that there is a measure for the latency of critical portions of the system and that it should meet this latency requirement a high percentage of the time e.g. 99%, 99.9%, 99.99% or worst case.

This could be any where from 10 nano-second to 100 milli-seconds depending on the context.

Questions which tag low latency should give measurable timings and percentage to reach that as the solution to follow is very dependant on these measures.

Without a latency measure to go by often the simplicity of the solution should be the target which will produce quick application with minimal complexity/effort.

416 questions
3
votes
1 answer

Node.js Live Streaming: Avoid buffering

I've written a small nodeJS server that outputs system audio captured by ffmpeg on Windows (using DirectShow) to the browser as a streaming MP3 file. The audio needs to be as live as possible, with minimum/no buffering, and a "skipping" effect in…
Shirish Kamath
  • 356
  • 4
  • 5
2
votes
3 answers

C# to Java latency sensitive class conversion, would TreeMap replace SortedList in my case?

Im replicating a C# class in Java. (Im a Java newbie.) My class needs to track int values associated with doubles. It then needs to create an Alerter(int) whenever a value crosses below or a above the doubles. Alerter.LatencySensitiveAction() ,…
jaybny
  • 1,026
  • 2
  • 13
  • 29
2
votes
1 answer

Implementing snapshot functionality for latency demanding program

We are developing program, that works on data located in shared memory. Program is latency demanding and processes huge amount of data. If program fails, we must return to last working state FAST. One way is to read and process data from transaction…
Marko Kevac
  • 2,902
  • 30
  • 47
2
votes
1 answer

How to achieve Spring boot p99 under 500 milliseconds for 1000 requests per second

Our spring boot application verion 2.5.10 has just a single api which reads from redis 6 times and does some calculations and there are no other IO operations such as database operations and is deployed in kubernetes with helm. Actual api execution…
2
votes
1 answer

How can I serve ML models quickly and with a low latency

Assume a user connects via a Websocket connection to a server, which serves a personalized typescript function based on a personalized JSON file So when a user connects, the personalized JSON file is loaded from an S3-lile bucket (around 60-100 MB…
tobias
  • 501
  • 1
  • 6
  • 15
2
votes
0 answers

Why is my interval of consecutive rdtsc calls periodic?

I am profiling interval of consecutive rdtsc calls as suggested by this talk by David Gross. My system is aws c5a.8xlarge instance, ubuntu 22.04 LTS server, no other user packages installed and there is no any other work load on it. Each data point…
Long Bu
  • 513
  • 4
  • 9
2
votes
4 answers

Latency accessing Google App Engine overseas

I am about to begin development of a web app in New Zealand for a NZ market for which scalability is a key requirement. I am contemplating using Google Apps Engine which I have used in the past for smaller projects where latency was not a big issue,…
Mike
  • 3,855
  • 5
  • 30
  • 39
2
votes
1 answer

Large dataset, ProcessPoolExecutor issues

PROBLEM - ProcessPoolExecutor hasn't increased speed. Confirmed by tqdm Learned enough about python to copy and/or write a program that works. each file takes ~40 seconds to load->filter->write. I have ~6,800 files to work through and want a better…
2
votes
0 answers

Multi region availability of user pools in aws cognito

I am working on SAAS Application, where the world wide users will authenticate to our system. We decided to use AWS Cognito as an identity platform. For greater availability and low latency for the authentication, we decided to replicate userpools…
2
votes
0 answers

Shared Memory between Julia and Python seems very slow (60 micros for round trip)

I am generating strings in Julia to use in Python. I would like to use Shared Memory (InterProcessCommunication.jl and Multiprocessing in Python). Currently, Julia generates strings then sends them to Python, which then reads the first number (so…
user3376601
  • 185
  • 6
2
votes
2 answers

what is a low-latency hardware algorithm to find the maximum value in an array

I need to build a low-latency, single-cycle hardware module to find the index and value of the maximum element in an array. Currently, I am using a comparator tree, but the latency is unsatisfactory. So are there any other algorithms that might have…
DBear
  • 312
  • 2
  • 9
2
votes
1 answer

Why does ZeroMQ recommend creating one Context for an application?

I've read the part of the guide that recommends creating one Context. My previous implementation of my application had multiple contexts that I created ad-hoc to get a subscription running. I've since changed it to using a single context for all…
ajoseps
  • 1,871
  • 1
  • 16
  • 29
2
votes
0 answers

ESP8266 latency via UDP

I create a simple setup of a master (ESP8266-12F) and a slave (ESP8266-01) and use UDP for data transmission. A message contains 4 bytes. I measured the time between the Master sends a request, and the Master gets the answer from the Slave via…
T Li
  • 31
  • 4
2
votes
0 answers

How could MQL4 communicate with python?

I want to communicate with each other the modes I wrote in the python programming language with MQL4, which is the fastest way to do this? Can there be another solution in this regard that zeromq seems difficult to install and use?
2
votes
1 answer

Is time.sleep() impacting the ZeroMQ poller.poll() response?

I'm getting results I can't explain when making a ZeroMQ REQ/REP request with polling. The elapsed time, taken by the poll()-method, is influenced by a time.sleep() elsewhere in the code. I have a server process which runs a command, and returns the…
Joe Watkins
  • 1,593
  • 4
  • 15
  • 25