Questions tagged [huge-pages]

Hugepages is a mechanism that allows the Linux kernel to utilize the multiple page size capabilities of modern hardware architectures.

Hugepages is a mechanism that allows the Linux kernel to utilize the multiple page size capabilities of modern hardware architectures. Linux uses pages as the basic unit of memory, where physical memory is partitioned and accessed using the basic page unit. The default page size is 4096 Bytes in the x86 architecture. Hugepages allows large amounts of memory to be utilized with a reduced overhead. Linux uses “Transaction Lookaside Buffers” (TLB) in the CPU architecture. These buffers contain mappings of virtual memory to actual physical memory addresses. So utilizing a huge amount of physical memory with the default page size consumes the TLB and adds processing overhead.

The Linux kernel is able to set aside a portion of physical memory to be able be addressed using a larger page size. Since the page size is higher, there will be less overhead managing the pages with the TLB. In the Linux 2.6 series of kernels, hugepages is enabled using the CONFIG_HUGETLB_PAGE feature when the kernel is built. Systems with large amount of memory can be configured to utilize the memory more efficiently by setting aside a portion dedicated for hugepages. The actual size of the page is dependent on the system architecture.

Source: http://linux.cloudibee.com/2007/09/linux-hugepages/

188 questions
0
votes
0 answers

Using 1GB transparent hugepages in Linux

I was wondering if there's any way to use the 1GB transparent hugepages in Linux without the need to recompile applications? I know that for using 2MB transparent hugepages, one only needs to do the following (I use SLES 12.3): echo always >…
Vahid Noormofidi
  • 748
  • 10
  • 17
0
votes
1 answer

why is hugepage not getting updated

I am getting this error EAL: No free hugepages reported in hugepages-1048576kB So, even after setting the nr_hugepages I am not able to see the updated/set value. What could be the reason root@vpp-dut:/opt/trs/vpp_src# cat…
Khrusos
  • 35
  • 6
0
votes
1 answer

User Application using Hugepage Shared Memory. Allocation error, why?

Trying to execute this sample: https://github.com/torvalds/linux/blob/master/tools/testing/selftests/vm/hugepage-shm.c but get: shmget: Cannot allocate memory shmget(0x2, 268435456, IPC_CREAT|SHM_HUGETLB|0600) = -1 ENOMEM (Cannot allocate…
dev
  • 1,119
  • 1
  • 11
  • 34
0
votes
0 answers

use hugepages in kernel driver

I refer to below two links to use huge page in my linux driver: Sequential access to hugepages in kernel driver http://nuncaalaprimera.com/2014/using-hugepage-backed-buffers-in-linux-kernel-driver Below is my code: #define PAGE_SHIFT_2M 21 pages =…
TseChun
  • 13
  • 5
0
votes
0 answers

Process Resident Set Size and huge pages

Does Process Resident Set Size (RSS) accounts for pages mapped as huge pages? For example on Centos 7 configured as (Transparent Huge Pages disabled, huge pages pool configured as min: 0, max 200000): [root@p]# cat…
Jacek Tomaka
  • 422
  • 7
  • 15
0
votes
1 answer

Disabling Java huge-pages system-wide on a RH machine

I know I can disable Java's use of huge-pages for a process by adding -XX:-UseLargePages to the process invocation line. However, I'd like to prevent every java application from using huge-pages, without me having to discover each process running…
howling cat
  • 41
  • 1
  • 9
0
votes
1 answer

Reservation of hugepages on a Linux system

My VMWare guest system details: Linux 2.6.32-358.el6.x86_64 (RH 6.4 - Santiago) # cat /proc/meminfo MemTotal: 8058796 kB MemFree: 5145692 kB Buffers: 32320 kB Cached: 291312 kB SwapCached: 0 kB Active: …
howling cat
  • 41
  • 1
  • 9
0
votes
1 answer

How can I use Hugepage memory from kernel space?

i need to be able to allocate 2MB or 4MB sized pages of memory in a kernel module.
Vinesh
  • 1
0
votes
1 answer

Larger number of hugepages causing bus error

I was trying to run dpdk timer app by setting 512 2MB hugepages but the application crashed with following error EAL: Detected 4 lcore(s) EAL: Probing VFIO support... Bus error (core dumped) If I reduce the number of hugepages to 256 it works…
Adhikari
  • 21
  • 2
0
votes
1 answer

how to enable hugetlb on mips32

Here is the problem I have: rx/tx packet in kernel driver. User space program need to access each of these packet. So, there are huge amount of data transfer between kernel and user space. (data stream: kernel rx -> user space process -> kernel…
IFQ
  • 169
  • 2
  • 6
0
votes
1 answer

Linux huge pages usage with Ignite for large physical memory

May Ignite benefit from Linux Huge pages (or Transparent Huge Pages)? Are there any recommendations (best practices?) for huge pages tuning for large physical memory size?
caccini
  • 21
  • 2
0
votes
3 answers

using puppet file_line to disable Transparent Huge Pages (THP)

I'm using the below code to disable THP Enabled using puppet file_line { 'disable-THP-enabled': ensure => present, path => '/sys/kernel/mm/transparent_hugepage/enabled', line => 'never', } But I get the below error message: Error: Could…
Sandeep Kanabar
  • 1,264
  • 17
  • 33
0
votes
1 answer

How does the memory behind statically allocated huge pages get distributed across NUMA nodes?

In my /etc/default/grub file I have explicitly set aside N huge pages with "hugepages=N". If I'm running on a box with 2 NUMA nodes, does N/2 huge pages get set aside for each node, or do they all go to node 0, or ....? Also is there a way on the…
Joseph Garvin
  • 20,727
  • 18
  • 94
  • 165
0
votes
1 answer

Transparent_hugepage - Disabling for memsql

I am using Ubuntu 14.04.4 LTS for memsql. I have tried to disable transparent_hugepage by adding line to grub I have change the GRUB_CMDLINE_LINUX_DEFAULT="console=tty1 console=ttyS0" to GRUB_CMDLINE_LINUX_DEFAULT="console=tty1 console=ttyS0"…
user4017080
0
votes
1 answer

Huge page support on GCE

I'm running a JBOSS application that we have successfully configured use Huge Pages/Large Pages on with other cloud platforms other than GCE. But I'm having problems on GCE. I'm seeing the error: Java HotSpot(TM) 64-Bit Server VM warning: Failed to…
Dale
  • 21
  • 1
  • 6
1 2 3
12
13