Asynchronous Input/Output, in computer science, is a form of input/output processing that permits other processing to continue before the transmission has finished.
Questions tagged [aio]
177 questions
1
vote
1 answer
lio_listio: How to wait until all requests complete?
In my C++ program, i use the lio_listio call to send many (up to a few hundred) write requests at once. After that, I do some calculations, and when I'm done I need to wait for all outstanding requests to finish before I can submit the next batch of…
Krzysztof Kosiński
- 4,225
- 2
- 18
- 23
0
votes
0 answers
Clearing cache of aiocache from unit test
In FastAPI I have an endpoint:
from aiocache import Cache, cached
@router.get("/id/{user_id}/permissions")
@cached(ttl=30, cache=Cache.MEMORY)
async def get_permissions(user_id: UUID4) -> list[Permissions]:
And then in my unit test, I want to…
DUDANF
- 2,618
- 1
- 12
- 42
0
votes
0 answers
You may need an appropriate loader to handle this file type, currently no loaders are configured to process this file - Adobe AIO
After running npm install command I am trying to deploy the code using "aio app deploy" but I ended up with below error.
"stack": "ModuleParseError: Module parse failed: Unexpected token (1:0)\nYou may need an appropriate loader to handle this file…
ezhil
- 977
- 6
- 15
- 36
0
votes
0 answers
How to set ha-all policy when declare queue in python aio_pika?
I want to know how to declare queue with policy in python aiopika. I have trouble when I set ha-all policy in declare queue with python aio_pika. But, I couldn't declare policy in queue. I can only declare in feature arguments.
This picture is what…
Julia
- 51
- 4
0
votes
1 answer
aiomultiprocessing pool freezes and OSError: [Errno 24] Too many open files
I've looked at this question and have talked with chatGPT/bing (lol) and still can't figure this one out.
I am trying to execute ~7mn requests to an API on a machine with 32 CPUs, loading the data to postgres. I have my code essentially set up like…
Jhirschibar
- 215
- 1
- 3
- 16
0
votes
0 answers
FastAPI endpoint blocked until a message has been consumed with aio-pika
I am using a FastAPI endpoint to do some sort of long polling and also aiopika to wait messages that a client is publishing to rabbitmq connection/channel/exchange/queue.
My question: When I make a request to the endpoint it is blocked waiting for a…
galtis
- 1
0
votes
1 answer
Maven build error - can't deploy zip to S3
We're unable to deploy a zip file to the AWS S3 bucket. It was working and stopped suddenly, and no environment changed. We're getting the below build error.
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-deploy-plugin:2.7:deploy-file…
Ram
- 27
- 1
- 1
- 3
0
votes
1 answer
How to reject messages in aio_pika with dead letter exchange?
I am using aio_pika and having trouble with rabbitMQ subscribe worker when reject message from queue. I rejected the message from queue and exchanged to dead letter queue. Message reached to dead letter queue. But message from original queue doesn't…
Julia
- 51
- 4
0
votes
0 answers
asynchronous io is working but never ends in linux
In a previous question, I asked how to implement asynchronous I/O. This code now works, except that at the end it never stops. It seems that aio_read reads starting at offset, for length, and if it is past the end of the file, the operation…
Dov
- 8,000
- 8
- 46
- 75
0
votes
1 answer
io_uring_enter syscall: bad file descriptor
I wanted to send requests to a ring with io_uring_enter, however the syscall fails because of a bad file descriptor. I double checked that the correct fd was used.
#define _GNU_SOURCE
#include
#include
#include…
BitFriends
- 379
- 5
- 18
0
votes
1 answer
How to use aioboto3 & asyncio to download file from S3 aws - Python
I have the sync script which is running & working well, but i see some download files takes time, thought of using async approach here.
import json
import os
import io
import time
import gzip
import re
import logging
from logging.handlers import…
Satscreate
- 495
- 12
- 38
0
votes
1 answer
Java AIO concurrent blocking
If the channel is not closed, there will be a blocking problem, but the link cannot be reused by closing
test
C:\Users\hxm>ab -k -c100 -n1000 http://127.0.0.1:8080/
This is ApacheBench, Version 2.3 <$Revision: 1843412 $>
Copyright 1996 Adam Twiss,…
黑小马
- 1
0
votes
1 answer
aio_pika. Messages was random lost from queue
I have asyncronus generator for messeging consuming.
import asyncio
queue = asyncio.Queue()
async def consume_gen(
self,
consume_from,
prefetch_count,
priority=None
):
async with…
MrOldSir
- 616
- 3
- 9
- 28
0
votes
0 answers
Callbacks in AIO asynchronous I/O
I have found discussion on using callbacks in AIO asynchronous I/O on the internet. However, what I have found has left me confused. An example code is listed below from a site on Linux AIO. In this code, AIO is being used to read in the contents…
bob.sacamento
- 6,283
- 10
- 56
- 115
0
votes
1 answer
aiokafka: is lock required for processing message when considering consumer group rebalance for kafka
when initiating an aiokafka consumer with ConsumerRebalanceListener, we have a processing process for the batch of messages(getmany()) received from kafka. We add this processing process to on_partitions_revoked as well to make sure these processing…
JamesWang
- 1,175
- 3
- 14
- 32