diff options
| author | Nicolas Vigier <boklm@mageia.org> | 2013-04-14 13:46:12 +0000 |
|---|---|---|
| committer | Nicolas Vigier <boklm@mageia.org> | 2013-04-14 13:46:12 +0000 |
| commit | 1be510f9529cb082f802408b472a77d074b394c0 (patch) | |
| tree | b175f9d5fcb107576dabc768e7bd04d4a3e491a0 /zarb-ml/mageia-dev/20110113/002104.html | |
| parent | fa5098cf210b23ab4f419913e28af7b1b07dafb2 (diff) | |
| download | archives-master.tar archives-master.tar.gz archives-master.tar.bz2 archives-master.tar.xz archives-master.zip | |
Diffstat (limited to 'zarb-ml/mageia-dev/20110113/002104.html')
| -rw-r--r-- | zarb-ml/mageia-dev/20110113/002104.html | 173 |
1 files changed, 173 insertions, 0 deletions
diff --git a/zarb-ml/mageia-dev/20110113/002104.html b/zarb-ml/mageia-dev/20110113/002104.html new file mode 100644 index 000000000..84168fed0 --- /dev/null +++ b/zarb-ml/mageia-dev/20110113/002104.html @@ -0,0 +1,173 @@ +<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN"> +<HTML> + <HEAD> + <TITLE> [Mageia-dev] Proposal for Mageia: implement bitorrent protocol to allow updates download + </TITLE> + <LINK REL="Index" HREF="index.html" > + <LINK REL="made" HREF="mailto:mageia-dev%40mageia.org?Subject=Re%3A%20%5BMageia-dev%5D%20Proposal%20for%20Mageia%3A%20implement%20bitorrent%09protocol%0A%20to%20allow%20updates%20download&In-Reply-To=%3C4D2E559D.6040808%40laposte.net%3E"> + <META NAME="robots" CONTENT="index,nofollow"> + <META http-equiv="Content-Type" content="text/html; charset=us-ascii"> + <LINK REL="Previous" HREF="002125.html"> + <LINK REL="Next" HREF="002107.html"> + </HEAD> + <BODY BGCOLOR="#ffffff"> + <H1>[Mageia-dev] Proposal for Mageia: implement bitorrent protocol to allow updates download</H1> + <B>andre999</B> + <A HREF="mailto:mageia-dev%40mageia.org?Subject=Re%3A%20%5BMageia-dev%5D%20Proposal%20for%20Mageia%3A%20implement%20bitorrent%09protocol%0A%20to%20allow%20updates%20download&In-Reply-To=%3C4D2E559D.6040808%40laposte.net%3E" + TITLE="[Mageia-dev] Proposal for Mageia: implement bitorrent protocol to allow updates download">andr55 at laposte.net + </A><BR> + <I>Thu Jan 13 02:30:05 CET 2011</I> + <P><UL> + <LI>Previous message: <A HREF="002125.html">[Mageia-dev] Java-Policy first draft published +</A></li> + <LI>Next message: <A HREF="002107.html">[Mageia-dev] Proposal for Mageia: implement bitorrent protocol to allow updates download +</A></li> + <LI> <B>Messages sorted by:</B> + <a href="date.html#2104">[ date ]</a> + <a href="thread.html#2104">[ thread ]</a> + <a href="subject.html#2104">[ subject ]</a> + <a href="author.html#2104">[ author ]</a> + </LI> + </UL> + <HR> +<!--beginarticle--> +<PRE>Olivier Thauvin a écrit : +><i> * andre999 (<A HREF="https://www.mageia.org/mailman/listinfo/mageia-dev">andr55 at laposte.net</A>) wrote: +</I>>><i> Romain d'Alverny a écrit : +</I>>>><i> +</I>>>><i> On Wed, Jan 12, 2011 at 04:29, Michael Scherer<<A HREF="https://www.mageia.org/mailman/listinfo/mageia-dev">misc at zarb.org</A>> wrote: +</I>>>><i> +</I>>>><i> However, if 1) was to open 5 connections on 5 distinct servers, that +</I>>>><i> would make more sense, no? +</I>>><i> +</I>>><i> Right. +</I>>><i> Another way to look at the question : +</I>>><i> If 1000 people are downloading from mirrors allowing a total of 2000 +</I>>><i> connexions, if no-one uses multiple connexions, then 1000 connexions are +</I>>><i> wasted. These unused connexions would likely be from faster mirrors. +</I>><i> +</I>><i> The upload given by a serveur is split in term of: +</I>><i> - connection available +</I>><i> - bandwidth available. +</I>><i> +</I>><i> If the mirrors is connected to Gb (which is more likelly the size of +</I>><i> bandwidth for the whole university...), and you split this Gb/s onto +</I>><i> 2000 connection you obtain 500kb/s. +</I> +Please note that my example was hypothetical, for multiple sites :) +Sorry if that wasn't clear. I don't know of _any_ single sites able to +do that. (Although I don't doubt that they exist.) +(When I started the example, I wrote 20 mirrors, but then erased it +because it didn't seem relevant to my point.) + +><i> However, I know only few server in the world really able to read Gb/s +</I>><i> from their disk. The top rate I obtain on dc is 400mbis/s (the memory +</I>><i> cache help a lot to obtain more). +</I>><i> +</I>><i> The number of connection is set high because some people download at +</I>><i> only 50kb/s and other 2Mbit/s, so the spare bandwidth from the 50kb/s +</I>><i> can be given to others. Nothing more. +</I> +exactly + +><i> According the graph on distrib-coffee: +</I>><i> <A HREF="http://distrib-coffee.ipsl.jussieu.fr/munin/distrib-coffee/distrib-coffee/index.html">http://distrib-coffee.ipsl.jussieu.fr/munin/distrib-coffee/distrib-coffee/index.html</A> +</I>><i> there is an average of 100 http download at a time, if each connection +</I>><i> become 5 (500), you'll reach the limit (200 on this server). +</I>><i> What will be the gain on your side ? +</I> +In that context, obviously. The idea wasn't that most sites would have +5 connexions - rather to allow up to 5 (depending on the traffic at the +moment. I would expect most sites to have one or 2 connexions. And +preferably use multiple mirrors, as recommended by aria2c documentation. + +><i> I talked here only about http, but apply the same to ftp in the same +</I>><i> internet connection, so it mean I have 100mbits/s to share between 400 +</I>><i> connections. +</I>><i> +</I>><i> As Michael explain, I voluntary limit the count of connection per IP, +</I>><i> before I did this, the server was overload 12 hour a day, which mean +</I>><i> stop serving ! +</I> +A very good idea. I would do the same thing in your situation. +Actually, aria2c would work somewhat better if all sites with more +limited capacity did the same thing. Because the benefit comes from +making use of the unused capacity (of the moment) of mostly larger +mirror sites. And trying to access sites already at capacity slows +somewhat the downloading. +Unfortunately not all download software monitors the connexion speed to +dynamically choose the fastest connexions, as does aria2c. + +>><i> With aria2c, 3 mirrors which support a total of 5 connexions gives me +</I>>><i> optimal speed. (The limit being the speed of my computer.) +</I>><i> +</I>><i> Can we know the speed of your connection ? +</I> +Fast, but I don't know exactly. It is at the local library, via wi-fi. + (I use it for downloading ISOs because my home connexion has limited +bandwidth.) +It is on the municipal network with telephony and all, and I access it +in the evening, when essentially only the library is open. I have seen +another user downloading at over 900 KB/sec while I was downloading, at +a somewhat slower speed. (A while back.) + +At the library with up to 5 connexions on 2 or 3 mirrors, it is always +over 600 KB/sec, often over 700 KB/sec. The last time I did a +comparison (1 connexion/1 mirror vs max 5 connexions/2 mirrors) for a +DVD, the ratio of speed was approx 3,5. (From summary notes on my +computer.) + +><i> Maybe your connection is good enough to provide a mirror for Mageia ? +</I>><i> And then you'll be able to test what you're suggesting. +</I> +Unfortunately, my home connexion tops out at 400KB/sec (officially +512KB/sec), but usually is less than half that. (Variable-speed slow +DSL.) And the upload speed is severely limited by my FAI, as well as a +limited bandwidth. +Wouldn't mind trying a mirror when better connexions become available. +(Don't know if I would go for something as big as Mageia, though.) + +><i> What is the result with 5 mirrors and 1 connection per mirror ? +</I>At the library, it tops out with 3 mirrors and 5 connexions. The best +was over 700KB/sec. (4 mirrors wasn't any faster.) +(I borrowed a faster computer from someone once, and it averaged well +over 800 KB/sec on 1 mirror/5 connexions, for download of a DVD.) + +><i> Obviously, any mirror in France (I am in France) is able to fulfill +</I>><i> my personnal connection... (10mbits/s). +</I> +J'aimerais bien ça :) +Where I live (banlieue de Montréal), I couldn't get more than 2Mbits/s +(officially), if that. And fairly expensive, as well. With very +limited upload speeds. + +-- +André +</PRE> + + + + + + + +<!--endarticle--> + <HR> + <P><UL> + <!--threads--> + <LI>Previous message: <A HREF="002125.html">[Mageia-dev] Java-Policy first draft published +</A></li> + <LI>Next message: <A HREF="002107.html">[Mageia-dev] Proposal for Mageia: implement bitorrent protocol to allow updates download +</A></li> + <LI> <B>Messages sorted by:</B> + <a href="date.html#2104">[ date ]</a> + <a href="thread.html#2104">[ thread ]</a> + <a href="subject.html#2104">[ subject ]</a> + <a href="author.html#2104">[ author ]</a> + </LI> + </UL> + +<hr> +<a href="https://www.mageia.org/mailman/listinfo/mageia-dev">More information about the Mageia-dev +mailing list</a><br> +</body></html> |