neo
May 27, 2022, 5:58am
21
maidsafe:
Currently, we are using a halfway-house system where the client contacts three elders at random and those elders contact the four adults holding chunk A - so we potentially have 12MB (3x4) of data flowing across the network for a 1MB request - better, but still not great. And reducing contacts to three elders comes at a cost: if we have only three elders interacting with the adults we no longer have a supermajority to decide if one of the adults is dysfunctional, making dysfunction tracking more complex.
A solution we are looking at now is information dispersal algorithms (IDA, also known as erasure coding). This could help us significantly reduce the volume of data transfer per GET, by having adults pass a share of the data to the elders rather than the whole thing.
I had thought that the system was to send a request packet to the adults and they respond saying they have the chunk ready and then the elders tell one adult to send the data.
Basically that was similar to what is described but only for the request/check packet to the adults and then the fastest adult is requested to actually send the chunk.
Why the change to sending the chunk immediately.
4 Likes
Great update Ants! Interesting that Erasure Codes are being considered. There has been a lot of discussion on the forum in the past on this and I’d recommend this thread for people wanting a refresher:
So we have say 3 chunks, A B & C. Consider then erasure code where 2 of 3 is OK. Now forgetting the size issues on getting the data (replicated chunks will be the most efficient) or the size of total data stored for X resilience (where X is % you can lose) where erasure codes look to be more efficient (but I will explain below, why they may not be).
Okay, just to make sure I understand what you’re saying, let’s say you have some chunk you’d like to store, X. You have two redundancy schemes, r…
Always interesting things happening. Thanks Maidsafe team!
12 Likes
jlpell
May 27, 2022, 12:19pm
23
Spectacular update! My favorite in a long time. This change is next level tech!
10 Likes
jonas
May 27, 2022, 12:27pm
24
Perhaps it help if phrasing it as 7 overlapping pieces.
(how exactly overlapping is done is then more complex to explain, but the simple story of “slicing into pieces” should appear logical, I hope)
14 Likes
Thanks team. We are getting close to testnet!
9 Likes
Thx 4 the update Maidsafe devs
Amazing all the steps taken to ensure data permanence.
Really love it how everything is being optimised
keep hacking super ants
6 Likes
Thank you for the heavy work team MaidSafe! I add the translations in the first post
Нашата основна цел със Safe Network е вечното съхранение на информацията на човечеството. Ние съхраняваме копия на данни на устройства, които статистически е малко вероятно да се намират в същия регион, ако например се случи масивно прекъсване на...
Ceci est une traduction automatique. L’original en anglais est ici: Update 26 May 2022 Notre objectif principal avec Safe Network est la permanence des données. Nous stockons des copies de données sur des appareils qui, statistiquement, ne sont...
Это машинный перевод. Оригинал на английском здесь: Update 26 May 2022 Наша основная цель с Safe Network — постоянство данных. Мы храним копии данных на устройствах, которые по статистике вряд ли будут находиться в том же регионе, если, например,...
Esta es una traducción automática. El original en inglés está aquí: 26 May 2022 Nuestro objetivo principal con Safe Network es la permanencia de los datos. Almacenamos copias de datos en dispositivos que, estadísticamente, es poco probable que...
Privacy. Security. Freedom
7 Likes
