Questions tagged [ulimit]

ulimit gets or sets the upper limit for resources available to the current shell.

356 questions
0
votes
1 answer

RabbitMQ in Linux randomly dropping connections in some deployment

In GNU/Linux I have an issue with an application I have made. It works in my development environment, most of the components running in dockers or natively, but it randomly (often, but not always) fails in the server environment where it needs to be…
xCovelus
  • 578
  • 1
  • 9
  • 20
0
votes
0 answers

Python resource module does not support "pipe size" and "virtual memory" resource limits

I have a requirement to measure the system resources on the host vm and compare it with the baseline limits. the resource module provides with most of the values but I am unable to get below 2 limits from resource module in comparison with ulimit…
Ameen Ali Shaikh
  • 409
  • 1
  • 3
  • 10
0
votes
2 answers

Got error of "Too many open file", what's the ulimit when running the program using ProcessBuilder()...start()?

I need to run a program after a Linux EC2 machine is provisioned on AWS. The following code will get "Too many open file" error. my_program will open a lot of files, maybe around 5000. string cmd = "my_program"; Process process = new…
ca9163d9
  • 27,283
  • 64
  • 210
  • 413
0
votes
0 answers

How can I using getrlimit to get normal user's nproc in c program

[root@api ~]# ulimit -u 3766 [zack@api ~]$ ulimit -u 5000 i cant fetch zack's nproc by using setuid(zackid) in program ,why? [root@api dbhome]# ./a zack UID:1000 EUID:1000 GID:1000 RLIMIT_NPROC cur:3766 // still root's nproc
zack
  • 1
0
votes
1 answer

Bash (WSL): Unable to limit the size of files written using ulimit -f

Good evening. I have a simple C++ program infinite_print.cpp that writes 400,000 lines of "abcde...xyz". Inside another bash script, script.sh, I executed said C++ code and redirected the output to output.txt, i.e. ./infinite_print.exe >…
nigel
  • 138
  • 5
0
votes
0 answers

Where can I find the default docker ulimit settings?

I have been trying to understand an issue I've had when running roribio16/alpine-sqs docker image on one of my machines. Whenever I try to run the image without specifying any other settings, docker run roribio16/alpine-sqs [xxxx@yyyy ~]$ docker run…
Hulatime
  • 1
  • 3
0
votes
0 answers

Too many open files vol. II

we are facing issue on our JBoss server "too many open files". Our ulimits for "appuser" are set to: core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size …
0
votes
1 answer

Issues with using ulimit to increase stack size for Node

I would like to increase the call stack limit for my node process so that I can create, parse and serialize a recursive object that's about 100,000 layers deep. If I had more time, I should represent this in a better format. But for a quick fix,…
petabyte
  • 1,487
  • 4
  • 15
  • 31
0
votes
1 answer

Increasing open files limit on elastic beanstalk EC2 instances for the webapp user

I am running into the open files limit for the webapp user for a server process (that spawns goroutines) on AWS Elastic Beanstalk. On my local environment, with an open FD limit of 8k, I'm able to handle this quite fine, but I'm unable to increase…
0
votes
0 answers

How to increase ulimit on AWS EMR with AutoScaling, dynamically?

I have a Spark application in Java, running on AWS EMR. I have implemented an AutoScaling policy based on the available yarn memory. For jobs which require higher memory, EMR brings up cluster up to 1+8 nodes. After a point of time in my job I keep…
0
votes
0 answers

How do I set locked memory limit as unlimited on Google Colab?

Is it possible to expand locked memory limit on Google Colab notebooks? It runs on a Ubuntu 18.04 VM. I'm running ulimit -l unlimited But I receive this in response ulimit: max locked memory: cannot modify limit: Operation not permitted This is…
mathigatti
  • 33
  • 6
0
votes
1 answer

How to solve MongoDB error "Too many open files" without root permission

Trying to insert several JSON files to MongoDB collections using shell script as following, #!/bin/bash NUM=50000 for ((i=o;i
0
votes
0 answers

Virtual Memory & ulimit experiment -> does not crash?

So I am experimenting with the memory limit and simulating afls memory limit right now, and for this purpose I implemented the following program: #include #include #include int LLVMFuzzerTestOneInput(const uint8_t…
Jo Bo
  • 136
  • 7
0
votes
1 answer

Can multiple RocksDB instances exceed the system's max_open_files value?

If a system's ulimit max_open_files is set to 1024 and there are 10 RocksDB instances running with max_open_files = 256, is it possible that RocksDB will exceed the system's ulimit? Should I configure each RocksDB instance with no more than 1/10th…
wrkyle
  • 529
  • 1
  • 13
  • 36
0
votes
1 answer

Why does mongo recommend a max scheduling priority of 30?

Mongo has a list of recommended ulimit pages for production servers on their homepage here. Most of these values make sense to me, but I'm curious why they recommend changing the scheduling priority (-e) to 30? Can anyone give me an idea why…
dsollen
  • 6,046
  • 6
  • 43
  • 84