that’s me really away to bed this time
iv just sorted all my mp3s out and have a folder with 41gb of files all less than 10mb
iv created a container at safe://hyryyry1e3i46spukkrh1md7grw5z6ye3yjpz11ksh3669q6zfnhfzp6ydanra
and now have a script uploading files one by one
anyone who wants to check how far its got can check with
safe files ls safe://hyryyry1e3i46spukkrh1md7grw5z6ye3yjpz11ksh3669q6zfnhfzp6ydanra
good luck and will be looking forward to seeing how things went in the morning
~ is the home directory in Linux - same as C:\Users\ [name] in Windows
here it is, its not ideal (and not sure if last command was ok, is testnet running?) but better then nothing
https://mega.nz/file/rhNAXTyD#Qw2lpoB129YNKIfwMj-HYp4hr1Slo5QM1zl_L2VeNn4
here is text “file” from video.:
How to connect to testnet and upload/download file to network in windows
(exactly on this testnet Update 08 December, 2022: A wild testnet appears! - #57 by SmoothOperatorGR )
1. Download windows file testnet
https://github.com/maidsafe/safe_network/releases/download/main/safe-win-wild-testnet.zip
2. Create path/folders like this: USERPROFILE.safe\cli
3. navigate from cmd to folder when you put your downloaded file (from point 2)
4. put in cmd this commands:
safe --version
(to make sure you’re on the correct version (0.67.0 of the CLI).)
then put in cmd:
safe networks add wild-testnet https://sn-node.s3.eu-west-2.amazonaws.com/testnet_tool/main/network-contacts
then put in cmd:
safe networks switch wild-testnet
5. upload some file to network:
6. download file from network:
put in cmd adress and name of file (which you find on forum):
GL
Thanks again! Will try tomorrow, now off to sleep.
Tried a random 10MB PUT, and it worked on the 1st try in an alpine LXC container. Yessss!!
Looking forward to more frequent testnets! Thank you Maidsafe team!
Personally, I am really interested in the format and content of the json logs for sn_node binary, so different types of dashboards can be built for monitoring purposes.
I applaud the approach, although we know the network can already do more than this.
Data integrity is fundamental, so isolating it makes perfect sense.
Testing this on my win PC for once, rather than my usual linux arm instance, but I’m running into some issues…
I can successfully cat the test image (as well as the others linked, included @Southside cock…) but windows is telling me the files are corrupt?!
@Southside, can you please verify this is the content of your co…ok that sounds wrong…content of your cock01.jpg file?
This is how the start of it looks in hex:
UPDATE: ignore please, working fine now, must have been a problem at my end
Congratulations MaidSafe!! 
Verification failed 
I’ll put a hexdump of cock01.jpg as a Gist if you want to dig deeper? @stout77
looks different
$ hexdump cock01.jpg > stout_cock.out
ok this is weird, files downloads fine on a linux VM on the same machine:
@maidsafe do we have an encoding problem?
The OS I’m having problems with is windows 11
UPDATE: ignore please, working fine now, must have been a problem at my end
Who else is using windows?
Can you download this OK?
FilesContainer created at: "safe://hyryyry1ct6mcfy5csjzuxeoa7bjkzqn4tuojxemhdocoybz9o784np9emhnra?v=hhmhtrmoa6sysu4mjuq99i6z1i16ydy54eyez3tit1j5nfjjwujey"
+---+-------------------------+--------------------------------------------------------------------+
| + | /home/willie/cock01.jpg | safe://hygoygyqzr1t99g38e5orf6o6ts4cja8ck7wo1hnn1rqcte4b19shnpbqeh |
+---+-------------------------+--------------------------------------------------------------------+
Yup [usual chars]
10 [requisite number of unnecessary characters]
We’re working on how to deal with full nodes
Important, but also there should be a disincentive for nodes getting too full. Some way to make sure nodes don’t go over something like 50% of their capacity, otherwise, if global disaster strikes and a huge amount of data needs re-spreading, then there might not be enough space. I’d suggest having junk ‘bonus’ data designed specifically to occupy node storage space.
Maybe for every chunk of user data stored, an equally-sized random bonus chunk could be stored on the same node, and presentation of both could be necessary for the full GET reward (if those are still a thing, if not then some equivalent).
If a node is offered a user chunk but is already full (of user chunks and bonus chunks), then the node should tell the others in its section that it is full rather than risk not getting a bonus for another chunk. If the section needs the node to take the chunk (due to catastrophe maybe), then it could exchange two of the node’s bonus chunks for a single bonus chunk applicable to two different user chunks.
Just some improvised ideas.
Just regarding the niggles with running on Windows, the install script actually modifies the PATH variable, so that would have helped there.
Interesting bug you’ve found with the encoding. Highlights the importance of cross-platform testing coverage.
Uploading a 1.5 MB file took 7.673s
Downloading the same file using safe cat took 2.695s
Downloading the same file using safe files get took 3.224s
These numbers look pretty good!
Uploading 8 MB file 10 times gave these results
Min: 9.596 seconds
Avg: 11.277 seconds
Max: 15.203 seconds
Stdev: 1.850
Avg Mbps: 5.930 Mbps
All tests:
10.482
10.473
10.56
10.712
11.031
15.203
9.596
14.166
10.409
10.136
Uploading various sized files indicates the lag on startup (larger files are faster because they can use the existing connection from the early chunks)
| size (KB) | upload time (seconds) | speed (Mbps) |
|---|---|---|
| 1 | 2.78 | 0.00294 |
| 10 | 4.319 | 0.01896 |
| 100 | 5.059 | 0.16192 |
| 200 | 5.158 | 0.31764 |
| 300 | 5.977 | 0.41117 |
| 400 | 5.57 | 0.58829 |
| 700 | 6.434 | 0.89126 |
| 1000 | 6.502 | 1.25992 |
| 2000 | 7.19 | 2.27872 |
| 3000 | 8.03 | 3.06052 |
| 5000 | 9.014 | 4.54404 |
| 8000 | 10.482 | 6.25224 |
That’s my upload been running for nearly 9 hours and so far 1319 files uploaded with no errors.
Haven’t had a chance verify any files yet as I’m on my mobile.
Again anyone wanting to check in can do so with
safe files ls safe://hyryyry1e3i46spukkrh1md7grw5z6ye3yjpz11ksh3669q6zfnhfzp6ydanra
So atm I’m thining nodes want to report storage because they don’t want to get full, as they will then be kicked off for being unable to return data.
ie, they want the network to grow so they can keep earning. Seems simple + clean.
Again anyone wanting to check in can do so with
a subset:
| 8529920 | 1670562028 | 1670562028 | Beyond - Tunes - Tunes - 12 - Nirvana - Smells like teen spirit.mp3 |
|---------+------------+------------+---------------------------------------------------------------------------------------------------------------------------------------------------|
| 4698112 | 1670562083 | 1670562083 | Beyond - Tunes - Tunes - 13 - P.C.D - Dont cha.mp3 |
|---------+------------+------------+---------------------------------------------------------------------------------------------------------------------------------------------------|
| 3991552 | 1670562118 | 1670562118 | Beyond - Tunes - Tunes - 14 - Robbie - Trippin.mp3 |
|---------+------------+------------+---------------------------------------------------------------------------------------------------------------------------------------------------|
| 5578752 | 1670562152 | 1670562152 | Big Country - Crossing - 1,000 Stars.mp3 |
|---------+------------+------------+---------------------------------------------------------------------------------------------------------------------------------------------------|
| 6004736 | 1670562194 | 1670562194 | Big Country - Crossing - All Fall Together [Jimmy Iovine Remix][Version].mp3 |
|---------+------------+------------+---------------------------------------------------------------------------------------------------------------------------------------------------|
| 5941248 | 1670562236 | 1670562236 | Big Country - Crossing - Angle Park [US Version].mp3 |
|---------+------------+------------+---------------------------------------------------------------------------------------------------------------------------------------------------|
| 6369280 | 1670562278 | 1670562278 | Big Country - Crossing - Chance.mp3 |
|---------+------------+------------+---------------------------------------------------------------------------------------------------------------------------------------------------|
| 18 | 1670528808 | 1670528808 | uploads.txt |
+---------+------------+------------+---------------------------------------------------------------------------------------------------------------------------------------------------+
FYIs nodes are currently reporting stored data sizes thus:
node-20: 24K
node-12: 24K
node-19: 12K
node-24: 1.5G
node-10: 1.7G
node-6: 1.5G
node-18: 1.2G
node-25: 1.5G
node-23: 1.8G
node-13: 1.5G
node-11: 2.9G
node-22: 1.7G
node-16: 1.7G
node-8: 1.7G
node-17: 2.9G
node-21: 2.8G
node-26: 3.4G
node-5: 1.8G
Ok, update on this, re-tried to cat the file and it now works fine…not sure what was happening before but please ignore and don’t waste time investigating that…weird stuff