Bug #25525
Move consul_dir to /var/tmp
Description
A bit similar to #25161, along with collectd, i see consul generating constant writes to the disks/system pool - when the system is idle, every 5s the disks are hit by the temporary files generated in /var/db/system/consul.
Afaict, the 'default' consul config would be to put the temporary files under /var/tmp, which fortunately for us is a tmpfs:
root@grimsel:~ # grep consul_dir /usr/local/etc/rc.d/consul|head -2
# consul_dir (dir): Set dir to run consul in.
: ${consul_dir:="/var/tmp/consul"}
How about using the default instead of setting consul_dir to /var/db/system/consul in rc.conf ? Does it really need a permanent storage ? What's it usecase if no alert services are configured ?
As for collectd, im still able to patch collectd.conf to send its writes to a remote rrdcached, so that when i have no clients on the server, the disk i/o is zero (as it was the case in my previous freenas 9 setup..)
Associated revisions
History
#1
Updated by Dru Lavigne over 3 years ago
Updated by Dru Lavigne - Assignee changed from Release Council to Kris Moore
Over to Kris for consideration.
#2
Updated by Landry Breuil over 3 years ago
Updated by Landry Breuil Of course coming from #22184, there's not much justification for https://github.com/freenas/freenas/commit/5f772c5fb05adad3b4f82c15a3b9d7395773edcb in the ticket..
I'm still trying to understand why even with this disabled, i still get writes to daX devices, while top -m io or zpool iostat shows almost nothing when idle.. now to write dtrace scripts.
#3
Updated by Dru Lavigne over 3 years ago
- Category changed from Documentation to OS
#4
Updated by Kris Moore over 3 years ago
- Status changed from Unscreened to Fix In Progress
- Target version set to 11.0-U3
Yea, you are right. It looks like this is only for temp agent state, no reason to set that dir. I'll get it fixed.
#5
Updated by Kris Moore over 3 years ago
- Status changed from Fix In Progress to Needs Developer Review
- Assignee changed from Kris Moore to John Hixson
- Priority changed from No priority to Important
Fix is in master, over to John for review into -U3
#6
Updated by John Hixson over 3 years ago
Updated by John Hixson - Status changed from Needs Developer Review to Reviewed by Developer
- Assignee changed from John Hixson to Release Council
Looks good to me
#7
Updated by Vaibhav Chauhan over 3 years ago
Updated by Vaibhav Chauhan - Status changed from Reviewed by Developer to 47
- Assignee changed from Release Council to Joe Maloney
#8
Updated by Dru Lavigne over 3 years ago
- Subject changed from Consul causing constant disk writes to Move consul_dir to /var/tmp
#9
Updated by Joe Maloney over 3 years ago
Updated by Joe Maloney - Status changed from 47 to Ready For Release
- Needs QA changed from Yes to No
- QA Status Test Passes added
- QA Status deleted (
Not Tested)
root@bonniemini:/var/tmp # ls
.bootready
.PBI.5379
.PBI.5509
.rnd
.smartalert
.sync_disk_done
.vmwarelogin_fails
alert
consul
consul-notifications.log
firmware
freenas_config.md5
ixdiagnose_boot.log
minio
nginx
nomad
pbi-repo.rpo
rc.conf.freenas
sessionidcpk2g28rw253ke5xflp0t261rflj9wzu
sessionidqc7p9h1vwplbq3mdf2g471lq9sijtjes
vi.recover
root@bonniemini:/var/tmp # cd consul
root@bonniemini:/var/tmp/consul # ls
checkpoint-signature raft serf
root@bonniemini:/var/tmp/consul # ls la 1 root wheel 394 Aug 28 10:04 checkpoint-signature
total 5
drwxr-xr-x 4 root wheel 192 Aug 28 10:04 .
drwxrwxrwt 10 root wheel 1344 Aug 28 10:18 ..
-rw-r--r-
drwxr-xr-x 3 root wheel 192 Aug 28 10:03 raft
drwxr-xr-x 2 root wheel 128 Aug 28 10:03 serf
#10
Updated by Dru Lavigne over 3 years ago
- Assignee changed from Joe Maloney to Kris Moore
#11
Updated by Vaibhav Chauhan over 3 years ago
- Status changed from Ready For Release to Resolved