Project

General

Profile

Bug #25293

SMB Large files

Added by fee heiner about 3 years ago. Updated almost 3 years ago.

Status:
Closed: User Config Issue
Priority:
No priority
Assignee:
John Hixson
Category:
OS
Target version:
Seen in:
Severity:
New
Reason for Closing:
Reason for Blocked:
Needs QA:
Yes
Needs Doc:
Yes
Needs Merging:
Yes
Needs Automation:
No
Support Suite Ticket:
n/a
Hardware Configuration:
ChangeLog Required:
No

Description

Freenas Server Fujitsu RX300S6 with 2x4 Core Intel Xeon Prozessor X5640, 98Gb Ram, Intel 10Gb-Ethernet, 12x2TBHDs Raidz-2 with up-to-date Freenas.
Compress and Dedup is on.
Reading with 300Mb/s, writing with up to 220Mb/s. On large files (800Gb vhdx-file) the transfer stopped after a while for 30 to 500s. The transfer is from a windows 2012 server to Freenas via robocopy. With some robocopy adjustments (very low transfer rate and repeat after failure) the file is copied. At the end the transfer rate is in average very very low at 25Mb/s!
the system is doing only backups at the weekend and snapshots. Dedup is important, because of many big vhdx-files (backups from many server).

The CPU is doing nearly nothing and for the other things I don't understand yet(see attachments).
Thank you.


Related issues

Related to FreeNAS - Bug #25294: SMB Large FilesClosed: Duplicate2017-07-25

History

#1 Updated by fee heiner about 3 years ago

  • File debug-LirosNas-20170725143815.txz added

#2 Updated by fee heiner about 3 years ago

  • File fn.pdf added

#3 Updated by Dru Lavigne about 3 years ago

  • Assignee changed from Release Council to John Hixson
  • Seen in changed from Unspecified to 11.0-U2

#4 Updated by Dru Lavigne about 3 years ago

#5 Updated by John Hixson about 3 years ago

  • Status changed from Unscreened to Screened
  • Target version set to 11.0-U3

#6 Updated by John Hixson about 3 years ago

  • Status changed from Screened to 15

Would it be possible for you to crank up debugging to 10? (services->smb->debug). If you can do this and do this copy again (and transfer stops), this will help. The log file will be quite large, so we will probably have to arrange some other means of getting it to me. Let me know if this is doable.

#7 Updated by fee heiner about 3 years ago

John Hixson wrote:

Would it be possible for you to crank up debugging to 10? (services->smb->debug). If you can do this and do this copy again (and transfer stops), this will help. The log file will be quite large, so we will probably have to arrange some other means of getting it to me. Let me know if this is doable.

Thank you for the fast response.
Yes, I will start this. I can't find 10 in smb services, I change log level from minimum to debug.

The copy yesterday night with the updates and the reboot were quicker (60Mb/s)??

#8 Updated by fee heiner about 3 years ago

  • File debug-LirosNas-20170726121046.tgz added

I startet a copy of a 850GB file with the windows explorer and stopped it 45min later.
Where can I find the log?

Also with this copy I think it is quicker than last week with the 11.0-U1. In general also the webgui seems to be faster??

Enclosed the debug file.

#9 Updated by John Hixson about 3 years ago

fee heiner wrote:

I startet a copy of a 850GB file with the windows explorer and stopped it 45min later.
Where can I find the log?

The relevant samba log is in /var/log/samba4/log.smbd. It is included in the debug, however it is truncated to 10k lines and in cases like this the entire log is useful ;-)

Also with this copy I think it is quicker than last week with the 11.0-U1. In general also the webgui seems to be faster??

Enclosed the debug file.

#10 Updated by John Hixson about 3 years ago

So, can you do this again , with logging turned up to debug, and get me the entire smbd.log and tell me the name of the file you are copying?

#11 Updated by fee heiner about 3 years ago

I'am in holiday now and will be back in the end of August.

#12 Updated by John Hixson about 3 years ago

  • Status changed from 15 to Screened
  • Target version changed from 11.0-U3 to 11.1

John Hixson wrote:

So, can you do this again , with logging turned up to debug, and get me the entire smbd.log and tell me the name of the file you are copying?

ok, we can talk then. Until then, moving this to 11.1.

#13 Updated by fee heiner about 3 years ago

  • File log.zip added

Hi John,
back home again, I copied the big file (LIROSDYN-1.VHDX). Enclosed the log.
Best Regards
Heiner

#14 Updated by John Hixson about 3 years ago

  • Status changed from Screened to 15

fee heiner wrote:

Hi John,
back home again, I copied the big file (LIROSDYN-1.VHDX). Enclosed the log.
Best Regards
Heiner

Thanks. I missed the fact you are using dedup here. This is most likely the problem. Can you try this without dedup?

#15 Updated by fee heiner almost 3 years ago

Its working without Dedup.
The computer is equipped with 98GB ram and a 12-core CPU, is it not enough?
We need dedup because we need a history of the vms.

#16 Updated by fee heiner almost 3 years ago

the memory size of the vms: 2.5 TB

#17 Updated by John Hixson almost 3 years ago

fee heiner wrote:

Its working without Dedup.
The computer is equipped with 98GB ram and a 12-core CPU, is it not enough?
We need dedup because we need a history of the vms.

dedup is a beast. It has pretty big requirements. Here are some links to better understand this:

http://www.oracle.com/technetwork/articles/servers-storage-admin/o11-113-size-zfs-dedup-1354231.html
https://www.reddit.com/r/zfs/comments/5ox2wv/zfs_dedup_on_a_pure_backup_server_ram/
http://constantin.glez.de/blog/2011/07/zfs-dedupe-or-not-dedupe

There are many more, however, this should give you an idea of how to see the memory requirements.

#18 Updated by fee heiner almost 3 years ago

Thank you.
I know about the lot of ram I need, but I thought 98Gb RAM for 20TB HDs is enough?

#19 Updated by John Hixson almost 3 years ago

fee heiner wrote:

Thank you.
I know about the lot of ram I need, but I thought 98Gb RAM for 20TB HDs is enough?

I provided these links so that you could figure out your requirements. I do not know your environment. You need to consider several factors here, how large your VM's are, how many of them there are, etc etc etc. Asking if a 20TB hard drive and 98Gb of ram is enough is meaningless without any information. My gut tells me that no, this is not enough. especially considering this works with dedup turned off.

#20 Updated by John Hixson almost 3 years ago

  • Status changed from 15 to Closed: User Config Issue

I'm closing this out. I'm 99% certain you just don't have the hardware requirements to support deduplication. My suggestions to you are to beef up your hardware or lower your requirements if you want to use dedup, otherwise just use compression. If you can prove to me otherwise feel free to open a new ticket with the new details.

#21 Updated by Dru Lavigne almost 3 years ago

  • File deleted (debug-LirosNas-20170725143815.txz)

#22 Updated by Dru Lavigne almost 3 years ago

  • File deleted (fn.pdf)

#23 Updated by Dru Lavigne almost 3 years ago

  • File deleted (debug-LirosNas-20170726121046.tgz)

#24 Updated by Dru Lavigne almost 3 years ago

  • File deleted (log.zip)

#25 Updated by Dru Lavigne almost 3 years ago

  • Target version changed from 11.1 to N/A
  • Private changed from Yes to No

#26 Updated by fee heiner almost 3 years ago

Okay, thank you very much for your support.
The 25 to 80 MB/s are ok for me. I thought that there are some tricks to make it faster.

Also available in: Atom PDF