minio icon indicating copy to clipboard operation
minio copied to clipboard

Download server too slow (location: germany)

Open ozgur-yalcin opened this issue 5 years ago • 36 comments

Ekran Resmi 2020-06-16 16 15 39

Are you aware of this issue which has been going on for months ?

ozgur-yalcin avatar Jun 16 '20 13:06 ozgur-yalcin

We will check it's hosted ok DigitalOcean we will see why is that the case .

@aead do you see this on your end?

harshavardhana avatar Jun 16 '20 14:06 harshavardhana

@harshavardhana I've been seeing this as well as @vadmeste - it runs very fast and then suddenly slows down.

klauspost avatar Jun 16 '20 15:06 klauspost

@harshavardhana I've been seeing this as well as @vadmeste - it runs very fast and then suddenly slows down.

Hmm not sure why DigitalOcean would be throttling..

harshavardhana avatar Jun 16 '20 16:06 harshavardhana

yes, noticed last couple weeks, when need to download client, speed varies a lot.

testing from various locations of central and eastern EU.

kotso avatar Jun 17 '20 08:06 kotso

Hm interesting. For me it starts quite slow (~200 KiB/s) but after a 15/20s or so it becomes quite fast > 10 MiB/s. After about 15% it starts speeding up..

aead avatar Jun 17 '20 12:06 aead

Yeah, it is very intermittent. Sometimes starts fast, stuck at 40% for minutes, then suddenly resumes.

klauspost avatar Jun 17 '20 12:06 klauspost

I tested from a dedicated server in France and it works fine.. but seeing the issue while using my local machine.

ping -c 30 dl.min.io can show mdev value.. High mdev value means less quality transferring datay

vadmeste avatar Jun 17 '20 14:06 vadmeste

I have blocked an IP which was hogging the network on a continuous basis. Please let us know if the issue persists.

harshavardhana avatar Jun 18 '20 18:06 harshavardhana

I have same issue in the UK. Limiting me to kb/s

jamescorbett avatar Jul 13 '20 19:07 jamescorbett

Exploring if it's possible to move to a different server or a different public IP @jamescorbett

harshavardhana avatar Jul 14 '20 22:07 harshavardhana

I'm located in Australia and have seen the same very slow downloads (initially when I downloaded it a few months ago). I didn't think much of it at the time until one of my staff commented to me about a week ago about the same issue. Just tested it again and still very slow.

brendanbbbb avatar Jul 18 '20 12:07 brendanbbbb

This issue has been automatically marked as stale because it has not had recent activity. It will be closed after 15 days if no further activity occurs. Thank you for your contributions.

stale[bot] avatar Aug 30 '20 23:08 stale[bot]

Screen Shot 2020-09-28 at 4 21 06 pm

I'm also seeing very slow downloads in Australia 😞

jaimem88 avatar Sep 28 '20 06:09 jaimem88

curl --output minio.RELEASE.2020-10-09T22-55-05Z  http://dl.min.io/server/minio/release/linux-amd64/minio.RELEASE.2020-10-09T22-55-05Z
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 49.4M  100 49.4M    0     0  3375k      0  **0:00:15**  0:00:15 --:--:-- 3826k

Download speed from Germany. Not that much time spent

torblerone avatar Oct 10 '20 09:10 torblerone

Download takes 2-3 min for me aswell so i guess this issue still isn't solved.

JanHolger avatar Nov 20 '20 21:11 JanHolger

Downloading from spain also too slow 2min for downloading 19Mb

pleclech avatar Feb 06 '21 18:02 pleclech

@minio Server admins: Why not just use some servers from Hetzner Cloud, netcup, other providers who don't really throttle and build download replica servers. Just let them sync and have this problem gone. They are fast and cheap.

As a hint for the other, axel is your friend. Building 50+ connections to download one file speeds up things on our end (located in Germany). https://github.com/axel-download-accelerator/axel

DerDanilo avatar Feb 07 '21 20:02 DerDanilo

Another workaround might be downloading the docker image tarball from DockerHub and extracting the minio binary. We ended up mirroring it locally instead. The easiest official solution would be uploading artifacts with releases on GitHub. GitHub's azure servers are sometimes terrible aswell but still way better than waiting 15 minutes for a 30mb file.

JanHolger avatar Feb 09 '21 08:02 JanHolger

Ran into this while trying to download minio to a GitLab CI pipeline on France (OVH). I had to use Alpine edge and download their release.

amyspark avatar Mar 19 '21 01:03 amyspark

--2021-05-12 13:09:55--  (try:14)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

--2021-05-12 13:10:37--  (try:15)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

--2021-05-12 13:11:18--  (try:16)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

Really frustrating.

tholu avatar May 12 '21 13:05 tholu

--2021-05-12 13:09:55--  (try:14)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

--2021-05-12 13:10:37--  (try:15)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

--2021-05-12 13:11:18--  (try:16)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

Really frustrating.

We will be moving to GitHub for downloads from our own infrastructure this is currently a work in progress.

harshavardhana avatar May 12 '21 15:05 harshavardhana

--2021-05-12 13:09:55--  (try:14)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

--2021-05-12 13:10:37--  (try:15)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

--2021-05-12 13:11:18--  (try:16)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

Really frustrating.

We will be moving to GitHub for downloads from our own infrastructure this is currently a work in progress.

finally good news !

ozgur-yalcin avatar May 12 '21 15:05 ozgur-yalcin

@harshavardhana Any ETA on this change? I have meanwhile rehosted the binary on our own CDN for internal use.

tholu avatar May 12 '21 16:05 tholu

@harshavardhana Any ETA on this change? I have meanwhile rehosted the binary on our own CDN for internal use.

@tholu there is no set ETA yet as it requires some refactoring of our download infrastructure and release management to start using GitHub for our releases.

harshavardhana avatar May 12 '21 16:05 harshavardhana

Is this a good idea? Since GitHub was bought by Microsoft and at least parts of the infrastructure have been migrated into azure cloud, I started to get problems with downloading files from GitHub and accessing GitHub Pages aswell and i've spoken to several people who had similar experiences. I mean it's probably better than the current servers but even sending out pigeons would be faster. At the moment we are pulling the docker image and extracting the executable so we don't need to wait 30 minutes for a 30 mb download from the official server everytime we update.

JanHolger avatar May 14 '21 18:05 JanHolger

minio 27%[====> ] 15,45M 11,1KB/s ETA 11m 54s

This has been terrible for years. First only from single ISPs, now since a year from all ISPs I am trying. Please get rid of whoever is hosting this.

chotaire avatar Jun 10 '21 02:06 chotaire

Hi,

Located in Australia

This is consistently taking over 5 minutes to download https://dl.min.io/client/mc/release/linux-amd64/mc

Screen Shot 2021-06-23 at 11 28 16 am

tmoschou avatar Jun 23 '21 02:06 tmoschou

Hi,

Located in Australia

This is consistently taking over 5 minutes to download https://dl.min.io/client/mc/release/linux-amd64/mc

Screen Shot 2021-06-23 at 11 28 16 am

I can recommend pulling the docker image and extracting the binary (:

JanHolger avatar Jun 23 '21 02:06 JanHolger

Thanks @JanHolger

For others interested, if you are building a Docker image with mc, Docker has an easy way to do this with multistage build

COPY --from=minio/mc /usr/bin/mc /usr/local/bin/mc

tmoschou avatar Jun 23 '21 02:06 tmoschou

Thanks @JanHolger

For others interested, if you are building a Docker image with mc, Docker has an easy way to do this with multistage build

COPY --from=minio/mc /usr/bin/mc /usr/local/bin/mc

Doesn't work for windows 😕

viceice avatar Sep 21 '21 17:09 viceice