Project

General

Profile

Bug #25525

Avatar?id=14398&size=22x22

Move consul_dir to /var/tmp

Added by Landry Breuil over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Important
Assignee:
Kris Moore
Category:
OS
Target version:
Seen in:
Severity:
New
Reason for Closing:
Reason for Blocked:
Needs QA:
No
Needs Doc:
Yes
Needs Merging:
Yes
Needs Automation:
No
Support Suite Ticket:
n/a
Hardware Configuration:
ChangeLog Required:
No

Description

A bit similar to #25161, along with collectd, i see consul generating constant writes to the disks/system pool - when the system is idle, every 5s the disks are hit by the temporary files generated in /var/db/system/consul.

Afaict, the 'default' consul config would be to put the temporary files under /var/tmp, which fortunately for us is a tmpfs:

root@grimsel:~ # grep consul_dir /usr/local/etc/rc.d/consul|head -2
# consul_dir (dir):          Set dir to run consul in.
: ${consul_dir:="/var/tmp/consul"}

How about using the default instead of setting consul_dir to /var/db/system/consul in rc.conf ? Does it really need a permanent storage ? What's it usecase if no alert services are configured ?

As for collectd, im still able to patch collectd.conf to send its writes to a remote rrdcached, so that when i have no clients on the server, the disk i/o is zero (as it was the case in my previous freenas 9 setup..)

Associated revisions

Revision 071ed241 (diff)
Added by Kris Moore over 3 years ago

Don't need to set the consul_dir variable to persistent storage, the default of /var/tmp is fine, since its only for current state information. Ticket: #25525

Revision d4a79ab2 (diff)
Added by Kris Moore over 3 years ago

Don't need to set the consul_dir variable to persistent storage, the default of /var/tmp is fine, since its only for current state information. Ticket: #25525

Revision 78900294 (diff)
Added by Kris Moore over 3 years ago

Don't need to set the consul_dir variable to persistent storage, the default of /var/tmp is fine, since its only for current state information. Ticket: #25525

History

#1 Updated by Dru Lavigne over 3 years ago

  • Assignee changed from Release Council to Kris Moore

Over to Kris for consideration.

#2 Updated by Landry Breuil over 3 years ago

Of course coming from #22184, there's not much justification for https://github.com/freenas/freenas/commit/5f772c5fb05adad3b4f82c15a3b9d7395773edcb in the ticket..

I'm still trying to understand why even with this disabled, i still get writes to daX devices, while top -m io or zpool iostat shows almost nothing when idle.. now to write dtrace scripts.

#3 Updated by Dru Lavigne over 3 years ago

  • Category changed from Documentation to OS

#4 Avatar?id=14398&size=24x24 Updated by Kris Moore over 3 years ago

  • Status changed from Unscreened to Fix In Progress
  • Target version set to 11.0-U3

Yea, you are right. It looks like this is only for temp agent state, no reason to set that dir. I'll get it fixed.

#5 Avatar?id=14398&size=24x24 Updated by Kris Moore over 3 years ago

  • Status changed from Fix In Progress to Needs Developer Review
  • Assignee changed from Kris Moore to John Hixson
  • Priority changed from No priority to Important

Fix is in master, over to John for review into -U3

https://github.com/freenas/freenas/pull/272

#6 Updated by John Hixson over 3 years ago

  • Status changed from Needs Developer Review to Reviewed by Developer
  • Assignee changed from John Hixson to Release Council

Looks good to me

#7 Updated by Vaibhav Chauhan over 3 years ago

  • Status changed from Reviewed by Developer to 47
  • Assignee changed from Release Council to Joe Maloney

#8 Updated by Dru Lavigne over 3 years ago

  • Subject changed from Consul causing constant disk writes to Move consul_dir to /var/tmp

#9 Updated by Joe Maloney over 3 years ago

  • Status changed from 47 to Ready For Release
  • Needs QA changed from Yes to No
  • QA Status Test Passes added
  • QA Status deleted (Not Tested)

root@bonniemini:/var/tmp # ls
.bootready
.PBI.5379
.PBI.5509
.rnd
.smartalert
.sync_disk_done
.vmwarelogin_fails
alert
consul
consul-notifications.log
firmware
freenas_config.md5
ixdiagnose_boot.log
minio
nginx
nomad
pbi-repo.rpo
rc.conf.freenas
sessionidcpk2g28rw253ke5xflp0t261rflj9wzu
sessionidqc7p9h1vwplbq3mdf2g471lq9sijtjes
vi.recover
root@bonniemini:/var/tmp # cd consul
root@bonniemini:/var/tmp/consul # ls
checkpoint-signature raft serf
root@bonniemini:/var/tmp/consul # ls la
total 5
drwxr-xr-x 4 root wheel 192 Aug 28 10:04 .
drwxrwxrwt 10 root wheel 1344 Aug 28 10:18 ..
-rw-r--r-
1 root wheel 394 Aug 28 10:04 checkpoint-signature
drwxr-xr-x 3 root wheel 192 Aug 28 10:03 raft
drwxr-xr-x 2 root wheel 128 Aug 28 10:03 serf

#10 Updated by Dru Lavigne over 3 years ago

  • Assignee changed from Joe Maloney to Kris Moore

#11 Updated by Vaibhav Chauhan over 3 years ago

  • Status changed from Ready For Release to Resolved

Also available in: Atom PDF