I currently have LibreNMS running on Proxmox and all was well until last week where LibreNMS can still monitor but no longer alert. On logging into the console and running ./validate.php I see an error advising to free some space
"
The stream or file "/opt/librenms/logs/librenms.log" could not be opened in append mode: failed to open stream: Permission denied
The exception occurred while attempting to log: SQLSTATE[HY000]: General error: 1021 Disk full (/tmp/#sql_50db_2.MAI); waiting for someone to free some space... (errno: 28 "No space left on device")
(SQL: SELECT TABLE_NAME, COLUMN_NAME, CHARACTER_SET_NAME, COLLATION_NAME
FROM information_schema.COLUMNS WHERE TABLE_SCHEMA = 'librenms' AND
( CHARACTER_SET_NAME != 'utf8mb4' OR COLLATION_NAME != 'utf8mb4_unicode_ci' );)
Context: {"exception":{"errorInfo":["HY000",1021,"Disk full (\/tmp\/#sql_50db_2.MAI); waiting for someone to free some space... (errno: 28 \"No space left on device\")"]}}
"
On checking with df -h I see /dev/mapper/nms1--irl2--vg-tmp using 100%
"
guest-admin@nms1-irl2:/$ df -h
Filesystem Size Used Avail Use% Mounted on
udev 7.9G 0 7.9G 0% /dev
tmpfs 1.6G 165M 1.5G 11% /run
/dev/mapper/nms1--irl2--vg-root 22G 15G 6.1G 71% /
tmpfs 7.9G 12K 7.9G 1% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 7.9G 0 7.9G 0% /sys/fs/cgroup
/dev/sda1 920M 83M 774M 10% /boot
/dev/mapper/nms1--irl2--vg-tmp 1.1G 1019M 0 100% /tmp
/dev/mapper/nms1--irl2--vg-home 9.1G 2.8M 8.6G 1% /home
/dev/mapper/nms1--irl2--vg-var 84G 7.3G 72G 10% /var
"
I have allocated further space via proxmox to this vm and can see it has allocated the extra space when I use the command lsblk. Where I am struggling is to add this extra space to tmp which is in partition sda5. I have tried mounting and remounting but always get an error (Please note the below is from the test server which is a clone of the one in production)
sudo mount -o remount, size=2G /sda/sda5/dev/mapper/nms1--irl2--vg-tmp mount: /sda/sda5/dev/mapper/nms1--irl2--vg-tmp: mount point does not exist. I have tried multiple variations of the path but none have worked for me
I have checked mount and see /dev/mapper/nms1--irl2--vg-tmp on /tmp type ext4 (rw,relatime)
I have also tried pfs and pfsresize which looks sucessful but doesnt actually change anything
If anyone can point me to where I can increase the partition size that would be great. When increasing/resizing in proxmox the size in sda changes without running an additional console command, I need this to go to sda5, ideally tmp, proxox only shows two harddrives, 130G and 5G
For reference lsblk shows me:
"
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 127G 0 disk
|-sda1 8:1 0 953M 0 part /boot
|-sda2 8:2 0 1K 0 part
-sda5 8:5 0 119.1G 0 part |-nms1--irl2--vg-root 254:0 0 22.5G 0 lvm / |-nms1--irl2--vg-swap 254:1 0 952M 0 lvm [SWAP] |-nms1--irl2--vg-home 254:2 0 9.3G 0 lvm /home |-nms1--irl2--vg-tmp 254:3 0 1.1G 0 lvm /tmp
-nms1--irl2--vg-var 254:4 0 85.3G 0 lvm /var
sdb 8:16 0 5G 0 disk
`-sdb3 8:19 0 5G 0 part
sr0 11:0 1 1024M 0 rom
"
Thanks