In order to integrate Squid Web Cache and FTP Mirror Tracker we wrote
2 Perl modules implementing ICP (WebCache::ICP) and cache
digests (WebCache::Digest).
Using these modules we created:
- Daemon that is generating ICP_HIT/ICP_MISS responses using FTP
Mirror Tracker database.
- Cache digest for the FTP site consisting of the URLs of the
possibly original servers.
Then launching Squid on the same server as a FTP Mirror Tracker and
integrating it in the cache hierarchy
we greatly reduced
- bandwidth utilization
- "MISS" response time
- server load.
Cache digests where proven to be almost unusable due to the large size
(more then 2.5 Mb per 10 Gb of the disk space of the FTP server that is
mirroring FreeBSD and Red Hat Linux)