plik icon indicating copy to clipboard operation
plik copied to clipboard

Large file upload >4GB broken

Open walmis opened this issue 8 years ago • 7 comments

It seems that currently uploading files larger than 4GB seems to be broken. Also web interface shows negative file sizes for files > 2GB

walmis avatar Jul 02 '17 19:07 walmis

Hello, can you provide us more detail, like the version that you are you running ? The os and architecture might also be of interest if you are not running the server on GNU/Linux x86_64. What backend are you using, if it's file what filesystem 4GB reminds me of some FAT32 limitations. Logs or screenshot might also help. I uploaded a 35GB iso this weekend without no trouble but I might have missed the bug you are talking about.

camathieu avatar Jul 02 '17 20:07 camathieu

Yeah, sorry I should have provided that in the first place :)

I'm running Plik 1.2 armhf from debian repository at mir.root.gg (jessie version) System is ARM Cortex-A53, Kernel 3.4.39, Ubuntu Xenial (16.04) Filesystem: ext4 Backend: file

when uploading files larger than 4GB they usually hang, Plik timeouts and shows an empty alert dialog with "close" on the web interface.

Interesting excerpt from the log (6GB) file, usually hangs at 51%~: [07/02/2017 21:56:38][WARNING ][[127.0.0.1][JfNJpJ1mgMkKBdLB][1NLsdH0kMKAtln3p][Untitled Clip 02.mpeg]] Unable to read data from request body : multipart: Part Read: unexpected EOF

and apache reverse proxy configuration:

<VirtualHost *:80>
ServerName xxx
ServerAlias yyy
ProxyPreserveHost On
ProxyRequests on
ProxyPass / http://localhost:8200/
</VirtualHost>

Screenshot

walmis avatar Jul 03 '17 05:07 walmis

I've done more testing and it seems the reverse proxy was the culprit for the failed uploads. But the filesizes are still negative after refreshing the file list after upload.

walmis avatar Jul 03 '17 07:07 walmis

It appears the adding Timeout 0 to apache configuration solves the issue of cutting the upload short. I suggest adding this to the readme. Negative file sizes are an issue though.

walmis avatar Jul 03 '17 07:07 walmis

Yes definitely I'll add this to the FAQ.

For the negative file sizes it might be related to the ARM architechture, I don't see this behaviour on x86 event with large files.

camathieu avatar Jul 21 '17 14:07 camathieu

Err… What is the current file size limit on plik.root.gg?

sergeevabc avatar Feb 23 '19 11:02 sergeevabc

It's 10G on this instance

bodji avatar Feb 23 '19 14:02 bodji