--bwlimit how to

[Ben Escoto]

--==_Exmh_932942349P
Content-Type: text/plain; charset=us-ascii

>>>>> "T" == trevor  <trevor@tecnopolis.ca>
>>>>> wrote the following on Tue, 3 Sep 2002 06:52:02 -0500 (CDT)

  T> I read in the archives how people wanted a rsync-like --bwlimit
  T> option.  I too wanted it, but am split on whether I agree with
  T> the author that it should be done outside of rdiff-backup.
  T> Theoretically he's probably correct, but practically most people
  T> will never figure out how to use cstream or the like.

I did think a bit more about this after the last discussion.  There is
an added problem that didn't get mentioned.  Right now ssh does the
compression, and the bandwidth can't be reliably limited before
compression because different data will get compressed to different
degrees.  So to add a true --bwlimit option I would have to move
compression into ssh also.  However, I've noticed that python's gzip
module is not very quick, probably because it is only partly written
in C.  Presumably ssh's compression code is much quicker.

  T> So I'm writing this email to say that I did get cstream to work
  T> with rdiff to emulate a --bwlimit type option.

Very cool.  I added this to the FAQ at

http://rdiff-backup.stanford.edu/FAQ.html#bwlimit

with some editing.  Tell me if you mind and I'll take it down.  I also
edited it a bit so you may want to look at it and make sure it is
still OK.

    One question though:  it looks like only ssh's output is getting
piped into cstream.  I suppose this is appropriate since the source
directory is remote.  Would the commands have to be rearranged if the
source directory is local?


-- 
Ben Escoto

--==_Exmh_932942349P
Content-Type: application/pgp-signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.0.7 (GNU/Linux)
Comment: Exmh version 2.5 01/15/2001

iD8DBQE9dPC5+owuOvknOnURApp1AJ42YFUT8Ssx7JE90O+e4xIk5BuaLQCfQ3cP
iouL+nP644ava09hkuQViy4=
=2+AB
-----END PGP SIGNATURE-----

--==_Exmh_932942349P--