Project

General

Profile

Bug #69339

Add a semaphore for calls within the same connection

Added by Jean Aumont 6 months ago. Updated 6 months ago.

Status:
Done
Priority:
No priority
Assignee:
William Grzybowski
Category:
Middleware
Target version:
Severity:
Med High
Reason for Closing:
Reason for Blocked:
Needs QA:
Yes
Needs Doc:
No
Needs Merging:
No
Needs Automation:
No
Support Suite Ticket:
n/a
Hardware Configuration:
ChangeLog Required:
No

Description

Hi,
I have serious problem with the New Ui.
When I use the New Ui, it takes a very long time to respond (more than a few minutes).
I wish that you will be able to take a look a some logs (Attach Debug) to find the problem.

In the /var/log/middleware.log I can see thoses errors ...
root@Jumbo:/var/log # more middlewared.log
[2019/01/09 12:23:12] (WARNING) application.call_method():189 - Exception while calling vm.query(*[])
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 161, in call_method
result = await self.middleware.call_method(self, message)
File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1109, in call_method
return await self._call(message['method'], serviceobj, methodobj, params, app=app, io_thread=False)
File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1049, in _call
return await methodobj(*args)
File "/usr/local/lib/python3.6/site-packages/middlewared/schema.py", line 664, in nf
return await f(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/middlewared/service.py", line 266, in query
'datastore.query', self._config.datastore, [], datastore_options
File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1113, in call
return await self._call(name, serviceobj, methodobj, params, app=app, pipes=pipes, io_thread=True)
File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1063, in _call
return await run_method(methodobj, *args)
File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1009, in run_in_thread
return await self.loop.run_in_executor(executor, functools.partial(method, *args, **kwargs))
File "/usr/local/lib/python3.6/asyncio/base_events.py", line 639, in run_in_executor
return futures.wrap_future(executor.submit(func, *args), loop=self)
File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 123, in submit
self._adjust_thread_count()
File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 142, in _adjust_thread_count
t.start()
File "/usr/local/lib/python3.6/threading.py", line 846, in start
_start_new_thread(self._bootstrap, ())
RuntimeError: can't start new thread

Thanks,
Jean Aumont


Related issues

Related to FreeNAS - Bug #70149: New Gui Closed
Has duplicate FreeNAS - Bug #67836: Sentry responded with an API error: RateLimited(None)Closed
Copied to FreeNAS - Bug #70678: Remove unnecessary vm.query calls to middlewareDone

Associated revisions

Revision d22fa9b2 (diff)
Added by William Grzybowski 6 months ago

feat(middlewared): add a semaphore for calls within the same connection

Allow up to 10 calls to happen concurrently with a hard limit of 20
(calls above that start getting refused).

Ticket: #69339

Revision cce1e5c2 (diff)
Added by William Grzybowski 6 months ago

feat(middlewared): add a semaphore for calls within the same connection

Allow up to 10 calls to happen concurrently with a hard limit of 20
(calls above that start getting refused).

Ticket: #69339

Revision 2c05e511 (diff)
Added by William Grzybowski 6 months ago

feat(middlewared): add a semaphore for calls within the same connection

Allow up to 10 calls to happen concurrently with a hard limit of 20
(calls above that start getting refused).

Ticket: #69339

Revision d07c5255 (diff)
Added by William Grzybowski 6 months ago

feat(middlewared): add a semaphore for calls within the same connection

Allow up to 10 calls to happen concurrently with a hard limit of 20
(calls above that start getting refused).

Ticket: #69339

Revision c73d8bd7 (diff)
Added by William Grzybowski 6 months ago

feat(middlewared): add a semaphore for calls within the same connection

Allow up to 10 calls to happen concurrently with a hard limit of 20
(calls above that start getting refused).

Ticket: #69339

History

#1 Updated by Dru Lavigne 6 months ago

  • Status changed from Unscreened to Blocked
  • Private changed from No to Yes
  • Reason for Blocked set to Need additional information from Author

Jean: this could be the result of a slow or dying boot device. Please try a fresh install on a different stick and leave a comment on this ticket whether or not that resolves the issue.

#2 Updated by Jean Aumont 6 months ago

Hi again,

I have changed the usb key twice now and the GUI is still very slow.

I get a lot of message of this type .... Hope this trace can help to debug.

info
Unable to run alert source 'VolumeStatus' Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/alert.py", line 358, in run_source alerts = (await alert_source.check()) or [] File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/../alert/source/volume_status.py", line 15, in check for pool in await self.middleware.call("pool.query"): File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1113, in call return await self._call(name, serviceobj, methodobj, params, app=app, pipes=pipes, io_thread=True) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1049, in call return await methodobj(*args) File "/usr/local/lib/python3.6/site-packages/middlewared/schema.py", line 664, in nf return await f(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/middlewared/service.py", line 266, in query 'datastore.query', self._config.datastore, [], datastore_options File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1113, in call return await self._call(name, serviceobj, methodobj, params, app=app, pipes=pipes, io_thread=True) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1063, in _call return await run_method(methodobj, *args) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1009, in run_in_thread return await self.loop.run_in_executor(executor, functools.partial(method, *args, **kwargs)) File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 56, in run result = self.fn(*self.args, **self.kwargs) File "/usr/local/lib/python3.6/site-packages/middlewared/schema.py", line 668, in nf return f(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/datastore.py", line 175, in query select=options.get('select'), File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/datastore.py", line 90, in __queryset_serialize self.middleware, i, extend=extend, field_prefix=field_prefix, select=select File "/usr/local/lib/python3.6/site-packages/middlewared/utils/_init.py", line 58, in django_modelobj_serialize data = middleware.call_sync(extend, data) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1139, in call_sync return fut.result() File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 425, in result return self.__get_result() File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 384, in get_result raise self._exception File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1063, in call return await run_method(methodobj, *args) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1009, in run_in_thread return await self.loop.run_in_executor(executor, functools.partial(method, *args, **kwargs)) File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 56, in run result = self.fn(*self.args, **self.kwargs) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/pool.py", line 257, in pool_extend pool['topology'] = self._topology(zpool['groups']) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/pool.py", line 236, in _topology x[key] = self._topology(x[key], False) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/pool.py", line 239, in _topology x[i] = self._topology(x[i], False) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/pool.py", line 236, in _topology x[key] = self._topology(x[key], False) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/pool.py", line 239, in _topology x[i] = self._topology(x[i], False) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/pool.py", line 230, in _topology device = self.middleware.call_sync('disk.label_to_dev', path[5:], geom_scan) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1139, in call_sync return fut.result() File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 425, in result return self._get_result() File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 384, in _get_result raise self._exception File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1063, in _call return await run_method(methodobj, *args) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1009, in run_in_thread return await self.loop.run_in_executor(executor, functools.partial(method, *args, **kwargs)) File "/usr/local/lib/python3.6/asyncio/base_events.py", line 639, in run_in_executor return futures.wrap_future(executor.submit(func, *args), loop=self) File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 123, in submit self._adjust_thread_count() File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 142, in _adjust_thread_count t.start() File "/usr/local/lib/python3.6/threading.py", line 846, in start _start_new_thread(self._bootstrap, ()) RuntimeError: can't start new thread
Wed, 16 Jan 2019 03:01:08 GMT
info
Unable to run alert source 'ZpoolCapacity' Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/alert.py", line 358, in __run_source alerts = (await alert_source.check()) or [] File "/usr/local/lib/python3.6/site-packages/middlewared/alert/base.py", line 96, in check return await self.middleware.run_in_thread(self.check_sync) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1009, in run_in_thread return await self.loop.run_in_executor(executor, functools.partial(method, *args, **kwargs)) File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 56, in run result = self.fn(*self.args, **self.kwargs) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/../alert/source/zpool_capacity.py", line 18, in check_sync for pool in self.middleware.call_sync("pool.query") File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1139, in call_sync return fut.result() File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 425, in result return self.
_get_result() File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 384, in _get_result raise self._exception File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1049, in _call return await methodobj(*args) File "/usr/local/lib/python3.6/site-packages/middlewared/schema.py", line 664, in nf return await f(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/middlewared/service.py", line 266, in query 'datastore.query', self._config.datastore, [], datastore_options File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1113, in call return await self._call(name, serviceobj, methodobj, params, app=app, pipes=pipes, io_thread=True) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1063, in _call return await run_method(methodobj, *args) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1009, in run_in_thread return await self.loop.run_in_executor(executor, functools.partial(method, *args, **kwargs)) File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 56, in run result = self.fn(*self.args, **self.kwargs) File "/usr/local/lib/python3.6/site-packages/middlewared/schema.py", line 668, in nf return f(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/datastore.py", line 175, in query select=options.get('select'), File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/datastore.py", line 90, in __queryset_serialize self.middleware, i, extend=extend, field_prefix=field_prefix, select=select File "/usr/local/lib/python3.6/site-packages/middlewared/utils/_init
.py", line 58, in django_modelobj_serialize data = middleware.call_sync(extend, data) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1139, in call_sync return fut.result() File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 425, in result return self.__get_result() File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 384, in _get_result raise self._exception File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1063, in _call return await run_method(methodobj, *args) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1009, in run_in_thread return await self.loop.run_in_executor(executor, functools.partial(method, *args, **kwargs)) File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 56, in run result = self.fn(*self.args, **self.kwargs) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/pool.py", line 257, in pool_extend pool['topology'] = self._topology(zpool['groups']) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/pool.py", line 236, in _topology x[key] = self._topology(x[key], False) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/pool.py", line 239, in _topology x[i] = self._topology(x[i], False) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/pool.py", line 236, in _topology x[key] = self._topology(x[key], False) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/pool.py", line 239, in _topology x[i] = self._topology(x[i], False) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/pool.py", line 230, in _topology device = self.middleware.call_sync('disk.label_to_dev', path[5:], geom_scan) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1139, in call_sync return fut.result() File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 425, in result return self._get_result() File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result raise self._exception File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1063, in _call return await run_method(methodobj, *args) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1009, in run_in_thread return await self.loop.run_in_executor(executor, functools.partial(method, *args, **kwargs)) File "/usr/local/lib/python3.6/asyncio/base_events.py", line 639, in run_in_executor return futures.wrap_future(executor.submit(func, *args), loop=self) File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 123, in submit self._adjust_thread_count() File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 142, in _adjust_thread_count t.start() File "/usr/local/lib/python3.6/threading.py", line 846, in start _start_new_thread(self._bootstrap, ()) RuntimeError: can't start new thread
Wed, 16 Jan 2019 02:58:02 GMT
Clear All Alerts
Closed
Unable to run alert source 'VolumeVersion' Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/alert.py", line 358, in __run_source alerts = (await alert_source.check()) or [] File "/usr/local/lib/python3.6/site-packages/middlewared/alert/base.py", line 96, in check return await self.middleware.run_in_thread(self.check_sync) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1009, in run_in_thread return await self.loop.run_in_executor(executor, functools.partial(method, *args, **kwargs)) File "/usr/local/lib/python3.6/asyncio/base_events.py", line 639, in run_in_executor return futures.wrap_future(executor.submit(func, *args), loop=self) File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 123, in submit self._adjust_thread_count() File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 142, in _adjust_thread_count t.start() File "/usr/local/lib/python3.6/threading.py", line 846, in start _start_new_thread(self._bootstrap, ()) RuntimeError: can't start new thread
Wed, 16 Jan 2019 03:00:00 GMT
Re-Open All Alerts

#3 Updated by Jean Aumont 6 months ago

Most the time that the New Freenas Gui becomes unresponsive is after that I have created new zfs volume or dataset and then a VM.

When the New Freenas Gui becomes unresponsive, the page to manage VM is unusable ... just loading the page can take 2 minutes ...

I then need to reboot the server, than the New Gui works fine.

#4 Updated by Jean Aumont 6 months ago

Even more errors ...

Unable to run alert source 'VolumeStatus' Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/alert.py", line 358, in run_source alerts = (await alert_source.check()) or [] File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/../alert/source/volume_status.py", line 15, in check for pool in await self.middleware.call("pool.query"): File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1113, in call return await self._call(name, serviceobj, methodobj, params, app=app, pipes=pipes, io_thread=True) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1049, in call return await methodobj(*args) File "/usr/local/lib/python3.6/site-packages/middlewared/schema.py", line 664, in nf return await f(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/middlewared/service.py", line 266, in query 'datastore.query', self._config.datastore, [], datastore_options File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1113, in call return await self._call(name, serviceobj, methodobj, params, app=app, pipes=pipes, io_thread=True) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1063, in _call return await run_method(methodobj, *args) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1009, in run_in_thread return await self.loop.run_in_executor(executor, functools.partial(method, *args, **kwargs)) File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 56, in run result = self.fn(*self.args, **self.kwargs) File "/usr/local/lib/python3.6/site-packages/middlewared/schema.py", line 668, in nf return f(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/datastore.py", line 175, in query select=options.get('select'), File "/usr/local/lib/python3.6/site-packages/middlewared/plugins/datastore.py", line 90, in __queryset_serialize self.middleware, i, extend=extend, field_prefix=field_prefix, select=select File "/usr/local/lib/python3.6/site-packages/middlewared/utils/_init.py", line 58, in django_modelobj_serialize data = middleware.call_sync(extend, data) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1139, in call_sync return fut.result() File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 425, in result return self.__get_result() File "/usr/local/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result raise self._exception File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1063, in _call return await run_method(methodobj, *args) File "/usr/local/lib/python3.6/site-packages/middlewared/main.py", line 1009, in run_in_thread return await self.loop.run_in_executor(executor, functools.partial(method, *args, **kwargs)) File "/usr/local/lib/python3.6/asyncio/base_events.py", line 639, in run_in_executor return futures.wrap_future(executor.submit(func, *args), loop=self) File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 123, in submit self._adjust_thread_count() File "/usr/local/lib/python3.6/concurrent/futures/thread.py", line 142, in _adjust_thread_count t.start() File "/usr/local/lib/python3.6/threading.py", line 846, in start _start_new_thread(self._bootstrap, ()) RuntimeError: can't start new thread
Wed, 16 Jan 2019 04:15:57 GMT

#5 Updated by Jean Aumont 6 months ago

  • File FreeNas.tar.bz2 added

Please take a look at the upload file which includes the messages and middleware files from the /var/log directory
Thanks

#6 Updated by Dru Lavigne 6 months ago

#7 Updated by Dru Lavigne 6 months ago

  • Status changed from Blocked to Unscreened
  • Assignee changed from Release Council to William Grzybowski
  • Reason for Blocked deleted (Need additional information from Author)

#9 Updated by William Grzybowski 6 months ago

  • Status changed from Unscreened to Blocked
  • Target version changed from Backlog to 11.2-U3
  • Severity changed from New to Med High
  • Reason for Blocked set to Need additional information from Author

Jean, could you please try to describe exact steps on how you are able to reproduce the issue?

Something is triggering infinite new threads on the backend and we are not sure what.

#10 Updated by Jean Aumont 6 months ago

  • File FREENAS_VAR_LOG.tar.gz added

Hi William,

Thanks for helping me !

To start clean I rebooted the servers and I was able reproduce the problem just by playing around the New Gui.

Here are the steps that I did ...
I tried to "echo" a message starting with "DEBUG JAUMONT" in the /var/log/middleware.log file before each steps,
so that way I tought that you coud may be see what steps is causing the problem.

root@Jumbo:/var/log # grep JAUMONT middlewared.log
DEBUG: JAUMONT - START LOGGING IN FREENAS
DEBUG: JAUMONT - OPENING STORAGE POOL
DEBUG: JAUMONT - OPENING VIRTUAL MACHINE TAB
DEBUG: JAUMONT - STOPPING VM CephMimicN01
DEBUG: JAUMONT - EDIT VM CephMimicN01 DEVICE - check cdrom
DEBUG: JAUMONT - OPENING VIRTUAL MACHINE TAB
DEBUG: JAUMONT - START VM CephMimicN01
DEBUG: JAUMONT - STOP VM CephMimicN01
DEBUG: JAUMONT - ADD NIC TO VM CephMimicN01
DEBUG: JAUMONT - START VM CephMimicN01
DEBUG: JAUMONT - TOOL A LOT OF TIME TO GET POWER OVERCOMMIT PROMPT
DEBUG: JAUMONT - POWER ON VM CephMimicN01
DEBUG: JAUMONT - NOT GETTING GREEN POWER BUTTON
DEBUG: JAUMONT - AFTER 2 MINUTES STILL NOT GETTING GREEN POWER BUTTON
DEBUG: JAUMONT - START FOR A SECOND TIME
DEBUG: JAUMONT - CONNECT TO VNC
DEBUG: JAUMONT - POWER OFF VM CephMimicN01
DEBUG: JAUMONT - SELECT POOL
DEBUG: JAUMONT - TAKE A VERY LONG TIME TO GET RESPONSE TO POOL
DEBUG: JAUMONT - SELECT VIRTUAL MACHINES
DEBUG: JAUMONT - AFTER 2MINUTES STILL NO VIRTUAL MACHINES PAGES
DEBUG: JAUMONT - AFTER 4MINUTES STILL NO VIRTUAL MACHINES PAGES
DEBUG: JAUMONT - AFTER 5MINUTES STILL NO VIRTUAL MACHINES PAGES
DEBUG: JAUMONT - LET GO VIEW THE STORAGE?POOL PAGE
DEBUG: JAUMONT - THE GUI IS NOT RESPONDING TO ANYTHING
DEBUG: JAUMONT - LET GO VIEW THE DASHBARD PAGE
DEBUG: JAUMONT - DASBOARD IS SUPER SLOW
DEBUG: JAUMONT - LET GO VIEW THE STORAGE?POOL PAGE
DEBUG: JAUMONT - THE GUI IS NOT RESPONDING TO ANYTHING
DEBUG: JAUMONT - THE GUI IS NOT RESPONDING TO ANYTHING
DEBUG: JAUMONT - THE GUI IS NOT RESPONDING TO ANYTHING
DEBUG: JAUMONT - THE PROBLEM IS REPRODUCE
root@Jumbo:/var/log #

Please find in atachment the file FREENAS_VAR_LOG.tar.gz, it contains all the file
from the /var/log/ directories.

The most important file is probably the middlewared.log file.

Thanks for your help again.

Jean Aumont

#11 Updated by William Grzybowski 6 months ago

Hello, thanks for the feedback.

Unfortunately I am still unable to reproduce this.

Any way we can schedule a TeamViewer session so we can debug this live?

#12 Updated by Jean Aumont 6 months ago

Hi William,

Hi am so happy that you want to help me by doing a TeamViewer session.

What would be the best day and time for you ?
In which time zone are you ? I am located in Montreal, Canada.

You can also communicate with me directly at
Do you have a direct email address ?

Thanks,

Jean Aumont

#13 Updated by William Grzybowski 6 months ago

Hi,

I am currently at GMT-2.

I can make room for anything between the next 3 hours or so if that works for you?

I am also free tomorrow pretty much during all business hours of my timezone.

My email is william at ixsystems com

Thanks!

#14 Updated by Jean Aumont 6 months ago

Hi William,

I just sent you an email to your personnal email address with my contact information.

I am ready to do a teamviewer session.

Thanks,

Jean Aumont

#15 Updated by William Grzybowski 6 months ago

Jean Aumont wrote:

Hi William,

I just sent you an email to your personnal email address with my contact information.

I am ready to do a teamviewer session.

Thanks,

Jean Aumont

Hi,

I did not receive the email

william at ixsystems dot com

#16 Updated by William Grzybowski 6 months ago

  • Status changed from Blocked to Screened
  • Reason for Blocked deleted (Need additional information from Author)

After the debugging session I found that this is both a middleware and UI issue.

UI is stacking multiple vm.query calls one on top of another, which eventually will overload middleware.
Middleware should not allow that to happen.

We will try to provide a fix shortly.

#17 Updated by Dru Lavigne 6 months ago

  • Target version changed from 11.2-U3 to 11.2-U2

#18 Updated by Jean Aumont 6 months ago

Hi William,

Thanks for your help, greatly appreciated.

Since you did not received my email at your personnal email addresse,
please send me one to from it and I will reply to it.

If you need more time or help debugging this on my server,
do not hesitate to contact me.

Thanks,

Jean Aumont

#19 Updated by William Grzybowski 6 months ago

  • Copied to Bug #70678: Remove unnecessary vm.query calls to middleware added

#20 Updated by Bug Clerk 6 months ago

  • Status changed from Screened to In Progress

#21 Updated by Bug Clerk 6 months ago

  • Status changed from In Progress to Ready for Testing

#22 Updated by Dru Lavigne 6 months ago

  • File deleted (FreeNas.tar.bz2)

#23 Updated by Dru Lavigne 6 months ago

  • File deleted (FREENAS_VAR_LOG.tar.gz)

#25 Updated by William Grzybowski 6 months ago

  • Status changed from Ready for Testing to Done
  • Needs QA changed from Yes to No

This will be tested in related ticket.

#26 Updated by Dru Lavigne 6 months ago

  • Subject changed from New Ui Unresponsive everywhere to Add a semaphore for calls within the same connection
  • Status changed from Done to Ready for Testing
  • Needs QA changed from No to Yes
  • Needs Doc changed from Yes to No
  • Needs Merging changed from Yes to No

#27 Updated by Dru Lavigne 6 months ago

  • Status changed from Ready for Testing to Done
  • Private changed from Yes to No

#28 Updated by William Grzybowski 6 months ago

  • Has duplicate Bug #67836: Sentry responded with an API error: RateLimited(None) added

Also available in: Atom PDF