AntTP - Serving Autonomi data over HTTP

AntTP v0.9.1 is out and includes some big performance changes. It adds a hybrid LFU cache, which stores chunks to both memory and disk. It also persists items in the disk cache between restarts, which makes offline mode a step closer.

Caching is also a big step towards adding tarchive support, where the same chunk can contain a number of files. Expect support for tarchives to land next.

EDIT: Added some performance results here too: Performance testing upload/download using AntTP - #111 by Traktion

  • Adds LFU hybrid (disk/memory) cache for storing immutable data chunks. This uses the Foyer library.
  • Updates chunk streamer dependency to pass in a ChunkGetter implementation, which uses the immutable data cache.
  • Adds config options to tune the amount of memory and disk used for caching.
  • Updates dependencies to use the latest autonomi libraries.
  • Removes custom datamap and app-config caching, which now uses the LRU cache too.
  • Aligns cache worker threads count with download thread count
  • Improves error handling to remove panics where not necessary.
  • Fixes to anttp swagger URLs for chunk and pointer controller.

Github: Release v0.9.1 · traktion/AntTP · GitHub
Dockerhub: https://hub.docker.com/r/traktion/anttp
Cargo: cargo install anttp

9 Likes