Project

General

Profile

Bug #10273

Download of updates aborts after ~210MiB

Added by Markus Kuhn about 5 years ago. Updated about 3 years ago.

Status:
Closed: Cannot reproduce
Priority:
No priority
Assignee:
Jordan Hubbard
Category:
OS
Target version:
Seen in:
Severity:
New
Reason for Closing:
Reason for Blocked:
Needs QA:
Yes
Needs Doc:
Yes
Needs Merging:
Yes
Needs Automation:
No
Support Suite Ticket:
n/a
Hardware Configuration:
ChangeLog Required:
No

Description

I tried several times to get updates through the WebGUI of FreeNAS 9.3. Each try aborted silently.
A colleague of mine then tried by other means, but found the problem to be on your side. Finally he succeeded with a 'wget'.

With the command line tool:
  1. freenas-update check
    TryGetNetworkFile(http://update.freenas.org/FreeNAS/FreeNAS-9.3-STABLE/LATEST)
    TryGetNetworkFile(http://update.freenas.org/FreeNAS/FreeNAS-9.3-STABLE/LATEST): Read 8264 bytes total
    TryGetNetworkFile(https://web.ixsystems.com/updates/ix_crl.pem)
    TryGetNetworkFile(https://web.ixsystems.com/updates/ix_crl.pem): Read 1028 bytes total
    Verify command = ['/usr/local/libexec/verify_signature', '-K', '/usr/local/share/certs/freenas-update.pem', '-C', '/usr/local/share/certs/iX-CA.pem', '-S', u'vyGYLIEaec4Sa1wUUze+gcQIEfcNDCLgkrXVI7wqx49cvtq0nf8OuHqX/sNEHoQeIek4ISpM0b0c7kkpMpH6bvwNz65/mt0P0YuVAyQEJqD4bLGrVqHI3rRMH/OddWSu6bSds1XcdiNzIEtfEWiTeH6ZWhnLLf+tmtiJz/io4oKEZ378NTmIcPS1D9TI4HqXvWlvIx1v5aZeBxCwRh+6xvRW4RStlxhQijSkzk9i0WVX0GhjwKtk0DqbsMcnj8kzjaUlCc3RlTUDALDkXjII/JqqXEd/t5Jn99KN1NZU0jUSynTsFsD+oJ9yCU0iVWgXuLziuBGx6kz+C6O6VG29xQ==', '-R', '/tmp/tmpcObMRj.pem']
    Signature check succeeded
    Removing invalid or incomplete cached update
    DownloadUpdate: diffs = {'Packages': [(<freenasOS.Package.Package object at 0x8069bb490>, 'upgrade', <freenasOS.Package.Package object at 0x80645f190>), (<freenasOS.Package.Package object at 0x8069bb250>, 'upgrade', <freenasOS.Package.Package object at 0x80645f1d0>), (<freenasOS.Package.Package object at 0x8069bb910>, 'upgrade', <freenasOS.Package.Package object at 0x80645f110>), (<freenasOS.Package.Package object at 0x8069bb8d0>, 'upgrade', <freenasOS.Package.Package object at 0x8069bbb90>), (<freenasOS.Package.Package object at 0x8069bba10>, 'upgrade', <freenasOS.Package.Package object at 0x8069bbbd0>)], 'Reboot': True, 'Sequence': (u'FreeNAS-9.3-STABLE-201504100216', u'FreeNAS-9.3-STABLE-201506162331')}
    DownloadUpdate: Will upgrade package base-os
    DownloadUpdate: Will upgrade package freebsd-pkgdb
    DownloadUpdate: Will upgrade package FreeNASUI
    DownloadUpdate: Will upgrade package freenas-pkg-tools
    DownloadUpdate: Will upgrade package docs
    Update does seem to require a reboot
    Searching for base-os-9.3-STABLE-47b35fb-14e08f2-cee4950.tgz
    TryGetNetworkFile(http://update.freenas.org/FreeNAS/Packages/base-os-9.3-STABLE-47b35fb-14e08f2-cee4950.tgz)
    TryGetNetworkFile(http://update.freenas.org/FreeNAS/Packages/base-os-9.3-STABLE-47b35fb-14e08f2-cee4950.tgz): Read 1048576 bytes

... {OUTPUT ABBREVIATED} ...

TryGetNetworkFile(http://update.freenas.org/FreeNAS/Packages/base-os-9.3-STABLE-47b35fb-14e08f2-cee4950.tgz): Read 218103808 bytes
TryGetNetworkFile(http://update.freenas.org/FreeNAS/Packages/base-os-9.3-STABLE-47b35fb-14e08f2-cee4950.tgz): Read 219152384 bytes
TryGetNetworkFile(http://update.freenas.org/FreeNAS/Packages/base-os-9.3-STABLE-47b35fb-14e08f2-cee4950.tgz): Read 220200960 bytes
Got exception [Errno 54] Connection reset by peer
Traceback (most recent call last):
File "/usr/local/bin/freenas-update", line 194, in <module>
sys.exit(main())
File "/usr/local/bin/freenas-update", line 121, in main
rv = Update.DownloadUpdate(train, download_dir)
File "/usr/local/lib/freenasOS/Update.py", line 513, in DownloadUpdate
pkg_file = conf.FindPackageFile(pkg, save_dir = directory, handler = get_handler)
File "/usr/local/lib/freenasOS/Configuration.py", line 1040, in FindPackageFile
reason = "DownloadPackageFile",
File "/usr/local/lib/freenasOS/Configuration.py", line 552, in TryGetNetworkFile
raise e
socket.error: [Errno 54] Connection reset by peer

History

#1 Updated by Markus Kuhn about 5 years ago

  • File ixdiagnose.tgz added

#2 Updated by Sean Fagan about 5 years ago

  • Status changed from Unscreened to 15

That's a networking problem -- "connection reset by peer" means that it failed midway.

You can try doing "fetch http://update.freenas.org/FreeNAS/Packages/base-os-9.3-STABLE-47b35fb-14e08f2-cee4950.tgz" manually and see if it works; if so, the update should work.

I just tried it and it works, so I suspect the networking problem is closer to your end, but I can't guarantee that.

#3 Updated by Markus Kuhn about 5 years ago

We tried a fetch from the FreeNAS console, a wget from another Linux host, and several browser downloads from desktop PCs running Windows. The systems were located in Aachen/Germany, Munich/Germany, London/UK and San Jose/US, using different Internet connections of our corporate network and private DSL accounts.

All abort after 210 MB, no matter what download speed they achieve (varies by location from avg. 60KB/s to 500KB/s).
The one successful download was from a private 75mbps line, which is not repeatable.

#4 Updated by Sean Fagan about 5 years ago

  • Assignee set to Jordan Hubbard

Jordan, I have no clue about this.

#5 Updated by Jordan Hubbard about 5 years ago

  • Status changed from 15 to Closed: Cannot reproduce

It works within United States so I can only point the finger at some piece of infrastructure outside our control

#6 Updated by Markus Kuhn about 5 years ago

Jordan Hubbard wrote:

It works within United States so I can only point the finger at some piece of infrastructure outside our control

It definitely does not work for us from NVIDIA headquarters in Santa Clara, CA. Download speed is better, but it also aborts after 210MB. And it did work for my office in Germany for an earlier installation on different hardware, although this does not look like a hardware issue to me.

If you have no further hints, I have to give up on this and look for an alternative.

#7 Updated by Sean Fagan about 5 years ago

I live in San Jose, and have two network connections at home (sonic.net and comcast). Both work.

#8 Updated by Jordan Hubbard about 5 years ago

Given that we can't reproduce it from here, and the update server itself is up and serving files to many (MANY) other people, I can only suspect some kind of weird VPN issue or a routing loop at NVIDIA or who knows what else - networking is hard, let's go shopping! :)

Alternatives might be to just go to http://download.freenas.org/9.3/latest/x64/ and grab the ISO or manual update images and just use those!

#9 Updated by Sean Fagan about 5 years ago

I did notice some overloading of teh web server, and wonder if that's it.

#10 Updated by Markus Kuhn about 5 years ago

Ok guys, we found it.

Our firewalls disconnected the downloads, as it was detected to be a threat to the 'Microsoft Indexing Service UTF-7 Cross-Site Scripting Vulerability'.

Contacting firewall vendor for a fix.

Thank you for your effort put into this!

#11 Avatar?id=14398&size=24x24 Updated by Kris Moore about 4 years ago

  • Seen in changed from Unspecified to N/A

#12 Updated by Dru Lavigne about 3 years ago

  • File deleted (ixdiagnose.tgz)

#13 Updated by Dru Lavigne about 3 years ago

  • Target version set to N/A
  • Private changed from Yes to No

Also available in: Atom PDF