Feature: improve usefulness and anonymity of Archive

happybeing · January 22, 2025, 12:04am

Developers, in case you’d like to comment:

feature: improve usefulness and anonymity of Archive

opened 11:53PM - 21 Jan 25 UTC

I'd like to suggest some changes to the Archive API in order to improve utility,… privacy and reduce the likelihood of breaking changes in future: - rename `autonomi::client::files::MetaData` as `autonomi::client::files::FileMetaData` - change `autonomi::client::files::MetaData` to ``` autonomi::client::files::FileMetaData { modified: std::time::SystemTime, file size: u64, extended_metadata: String, // As yet undefined JSON string for future proofing file metadata } ``` The above omits `created: std::time::SystemTime` which I don't think is appropriate, but could be included if thought necessary. Including `file_size` is helpful for apps which would otherwise have no idea how large a file is without first downloading it. Providing `extended_metadata` as a JSON string allows for arbitrary additional metadata, perhaps OS or app dependent to be included without breaking changes to the format of a serialised Archive. - make the Map value a tuple (or struct): `(path, address, Option<FileMetaData>)`, so that all file metadata is optional. See next. - improve privacy by allowing file metadata to optional, so change `add_file()` to `add_file(path, address, fs_metadata: Option<std::fs::Metadata>, json_metadata: String)` so that all metadata is optional. Passing `std::fs:Metadata` also simplifies provision of metadata and insulates apps from internal changes to `FileMetaData`. Privacy is improved because file times could be used as a fingerprint to identify the original creator or uploader of public content such as a website. - add `Archive::merge_from(&mut self, archive: &Archive)`, a helper to merge one `Archive` into another. This could be done using `Archive::iter()` and `Archive::add_file()` but is a bit clumsy, so nice to hide the detail.

cc @loziniak @Traktion @Jadkin @dirvine

loziniak · January 22, 2025, 2:07am

I haven’t really used Archive, so I support it as a voice of a practical user. I feel I’d try to implement filesystem-like storage myself anyway

Topic		Replies	Views
API enhancement to deliver 70% cost reduction and 70% network load reduction Features api	8	302	October 24, 2024
Introducing docs.autonomi.com Updates	42	896	June 4, 2024
API proposal for discussion - Unify PublicArchive and PrivateArchive structs Development	3	71	April 11, 2025
Hello again. How's it going? Apps	3	157	July 6, 2024
Looking for an Updated “Primer” or Detailed Explanation of the New Network Internals Development	4	151	February 26, 2025

Feature: improve usefulness and anonymity of Archive

Related topics