Project

General

Profile

Bug #25153

No more processes when running terminal commands in jails

Added by Michael Binder about 3 years ago. Updated about 3 years ago.

Status:
Closed: Third party to resolve
Priority:
No priority
Assignee:
William Grzybowski
Category:
Middleware
Target version:
Seen in:
Severity:
New
Reason for Closing:
Reason for Blocked:
Needs QA:
Yes
Needs Doc:
Yes
Needs Merging:
Yes
Needs Automation:
No
Support Suite Ticket:
n/a
Hardware Configuration:
ChangeLog Required:
No

Description

Been getting this error since upgrading to FreeNAS 11. Not sure why but it is keeping from running any commands scripts in my jails.

History

#1 Updated by Michael Binder about 3 years ago

  • File debug-SparkNAS-20170715121035.txz added

#2 Updated by Dru Lavigne about 3 years ago

  • Status changed from Unscreened to Closed: User Config Issue

You have a lot of stuff running on that system and your pool is approaching 80%. The maxproc errors indicate that the hardware can't keep up. Have you been running this setup for awhile or is it a new system?

Couple of things to try:

- update to U1 (prob won't make a difference)
- add more capacity as ZFS performance starts to slow down around 80%
- offload some of the software processing to a client system
- try asking on the FreeBSD forums to see what luck other users have had using limits on their jails, there may be a combo of sysctls that will prevent one of your jails from hogging the system's resources

Bottome line: you either need beefier hardware or less apps running on this hardware.

#3 Updated by Michael Binder about 3 years ago

Dru Lavigne wrote:

You have a lot of stuff running on that system and your pool is approaching 80%. The maxproc errors indicate that the hardware can't keep up. Have you been running this setup for awhile or is it a new system?

Couple of things to try:

- update to U1 (prob won't make a difference)
- add more capacity as ZFS performance starts to slow down around 80%
- offload some of the software processing to a client system
- try asking on the FreeBSD forums to see what luck other users have had using limits on their jails, there may be a combo of sysctls that will prevent one of your jails from hogging the system's resources

Bottome line: you either need beefier hardware or less apps running on this hardware.

I have been running this set up for 2 years with no issues. I have even had more stuff running on here before. This all started after the latest update for me and has been going on for 2 weeks now.

#4 Updated by Michael Binder about 3 years ago

This also started after the zfs pool update that came out with my last update I did.

#5 Updated by Dru Lavigne about 3 years ago

  • Status changed from Closed: User Config Issue to Investigation
  • Assignee changed from Release Council to William Grzybowski

Passing over to William for further investigation to see if something besides overloaded hardware is at play here.

#6 Updated by Michael Binder about 3 years ago

I just got my capacity usage down to 75% from 80% and I am still having the exact same issue so I know it is not that.

#7 Updated by William Grzybowski about 3 years ago

  • Status changed from Investigation to Closed: Third party to resolve

/bin/sh /usr/sbin/service redis start

Thats the process that is being spawning over and over again.
I will assume its is one of the jails. I will advise you to start one jail at a time until you figure out which. Unfortunately there isn't much else we can do from our side.

#8 Updated by Michael Binder about 3 years ago

Thank you! That pointed me in the right direction. It was coming from a gitlab installation. I removed the jail and plugin all together and so far no issues.

#9 Avatar?id=14398&size=24x24 Updated by Kris Moore about 3 years ago

  • Seen in changed from Unspecified to N/A

#10 Updated by Dru Lavigne about 3 years ago

  • File deleted (debug-SparkNAS-20170715121035.txz)

#11 Updated by Dru Lavigne about 3 years ago

  • Target version set to N/A
  • Private changed from Yes to No

Also available in: Atom PDF