Apache has a 2GB file limit on a CIFS network drive?

Question

Setup:

A Windows and a Ubuntu Server are hosted in VMware ESXi
I have a a 6GB file on a Windows share
The Windows share is mount on Ubuntu with smbmount
A symlink pointing to the 6GB file is created in a public_html directory, which is readable by Apache

The problem:

wget gets an error Connection closed at byte 2130706432. Retrying. after downloading 2130706432 bytes (exactly 2032 MiB, and is the same every time)
Apache returns 206 Partial Content without showing any errors in the log
Same error even if I download from localhost
Similar error when Firefox is used instead of wget
No error if I md5sum or cp the file on Ubuntu, suggesting that smbmount and the Windows Server are OK with 6GB files.
No error if Apache serve a 6GB file from the local disk, suggesting that Apache has no problems handling 6GB files.

Any ideas why Apache/symlink/smbmount/Windows would cause an error when used together? How can I fix the problem?

Software used:

VMware ESXi 4 Update 1
Windows Server 2008 R2
Ubuntu 8.04 Server, vmxnet3
Apache 2.2.8
mount.cifs 1.10-3.0.28a (as returned by smbmount -V)

Edit: If I use CentOS 4.8 x64 instead of Ubuntu 8.04, Apache will disconnect at byte 2147483647 (2GiB - 1byte) instead of 2130706432 (2GiB - 16MiB).

What if you mount the share within the Web tree instead of using the symlink? — Warner, Mar 24 '10 at 05:06
@Warner: Thanks for you suggestion, unfortunately the same error occurs — netvope, Mar 27 '10 at 03:14
@Zephyr: No, they are not. SMB is the old deprecated protocol that eventually become CIFS. In any modern Linux distro, smbmount will actually call mount.cifs, so it may appear they are the same, but they are not. — Dan Andreatta, Mar 27 '10 at 07:06

score 1 · Accepted Answer · answered Apr 05 '10 at 21:55

1

I had a similar problem where I worked, check out this bug report. The issue seems to be with EnableSendfile, so put this in your Apache config for the virtual host or global config:

EnableSendfile Off

answered Apr 05 '10 at 21:55

Natalie Adams

745
1
6
16

score 0 · Answer 2 · answered Mar 26 '10 at 23:13

0

I'm pretty sure it's actually a problem with your Windows share, you need to set the block size to 4k and allow it to share it in a way that can be interpreted correctly by a client. Unfortunately this may require a volume reformat sorry.

answered Mar 26 '10 at 23:13

Chopper3

101,299
9
108
239

The NTFS block size is 4KB on my Windows share. Is that what you're talking about? – netvope Mar 27 '10 at 03:05

score 0 · Answer 3 · answered Mar 31 '10 at 01:53

0

Why don't you use a different method of distributing a file? 6GiB is a lot, and without a MD5sum check, it could be error proned. Is delivery via a distributed system possible in this case?

answered Mar 31 '10 at 01:53

Kyle

562
2
5
16

score 0 · Answer 4 · answered Mar 31 '10 at 01:55

0

You mentioned smbmount as how the cifs share is mounted. smbmount and mount.cifs are 2 different animals. smbmount has a 2GB limit on files for one. But smbmount is old way of doing it and has been replaced by mount.cifs.

answered Mar 31 '10 at 01:55

3dinfluence

12,449
2
28
41

When I run `smbmount -V`, I got `mount.cifs version: 1.10-3.0.28a`, so I think my version of smbmount is already using `mount.cifs`. Also note that md5sum and cp have no problem reading the 6GB file via smbmount. – netvope Mar 31 '10 at 02:35
I guess they must be symlinking smbmount to mount.cifs nowadays. – 3dinfluence Mar 31 '10 at 03:30

Apache has a 2GB file limit on a CIFS network drive?

4 Answers4