script for determining space consumed by increments

[Ben Escoto]

--==_Exmh_1498447336P
Content-Type: text/plain; charset=us-ascii

>>>>> "DG" == dean gaudet <dean-list-rdiff-backup@arctic.org>
>>>>> wrote the following on Mon, 13 May 2002 10:22:19 -0700 (PDT)

  DG> i noticed a fair amount of superfluous syscalls in strace output
  DG> on the mirror side:
    ...

Yep, rdiff-backup is almost totally unoptimized, so a lot could be
done...

  DG> my system aren't running at full cpu, or full disk bandwidth
  DG> (dunno about disk seeking), or full net ... which is why i
  DG> suspect serialisation.

So maybe it would be worth it to try conn_bufsize = 32768 or
whatever.  Who knows, you might get 11hrs -> 6hrs.

  DG> there's an async i/o interface named aio, but it's meant to give
  DG> you async i/o on long-term opened files.  on programs which do a
  DG> lot of fs metadata manipulation, the only option for parallelism
  DG> is multithreading or multiprocesses.

Yes, for instance rsync is multiprocess (even when run locally it
makes three processes).  But this leads to a lot of complexity.  I
think rsync was having protocol problems leading to sessions hanging
just a few months ago.  So I don't expect to try multithreading
anytime soon...


--
Ben Escoto

--==_Exmh_1498447336P
Content-Type: application/pgp-signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.0.6 (GNU/Linux)
Comment: Exmh version 2.5 01/15/2001

iD8DBQE84GJQ+owuOvknOnURAtkBAJ9PAIbU5Q+XyPa6lOdM6aINoaYxmgCfcTIJ
c1X1y7C5Wnq6kuF7S52+gXs=
=TODu
-----END PGP SIGNATURE-----

--==_Exmh_1498447336P--