Files to test with

Community
1

BegBlag is up and no preexisting chunks found in the network :slight_smile:

🔗 Connected to the Network                                                                                                                    "BegBlag.mp3" will be made public and linkable
Splitting and uploading "BegBlag.mp3" into 17 chunks
**************************************
*          Uploaded Files            *
**************************************
Uploaded "BegBlag.mp3" to address 304b74b76536e89910262ade48020a4ab2724bdaf353f3b42de625fee2477228
Among 17 chunks, found 0 already existed in network, uploaded the leftover 17 chunks in 3 minutes 11 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of NanoTokens(29) for 17 chunks
Made payment of NanoTokens(29) for royalties fees
New wallet balance: 0.000000008


safe files download "BegBlag.mp3" 304b74b76536e89910262ade48020a4ab2724bdaf353f3b42de625fee2477228
12 Likes
2

I guess since you probably didn’t get a chance to upload it on the previous 4mb chunk network this might be to be expected - even existing beg blag chunk would be 512kb of size and therefore different than the 4mb version =)

You’re a hero my friend :tada:

3 Likes
3 
Saved "BegBlag.mp3" at /home/petr/BegBlag.mp3
File downloaded in 1 seconds 508 milliseconds

Nice and faaast :slight_smile:

8 Likes
4

Yes I’d didn’t have a chance on the last 4mb chunk network

I don’t think I’ll have time to save for a Linux iso but you never know if they crank up the uploads my two hetzners on scraping duty might just do it in time. :slight_smile:

3 Likes
5

Going up to 4MB chunk sizing, I would highly doubt that any newly self encrypted file would generate existing chunk hashes/addresses/xor simply because they are different bigger chunks being generated. The only exception to that might be files less than 3MB

4 Likes
6

some positive news uploads are still working

"AnarchyInTheSouthside.mp3" will be made public and linkable
Splitting and uploading "AnarchyInTheSouthside.mp3" into 67 chunks
**************************************
*          Uploaded Files            *
**************************************
Uploaded "AnarchyInTheSouthside.mp3" to address 1c280f04cf0d0321dcc7de2f9893dead87daf26f4f597d366a8d2b142438144a
Among 67 chunks, found 2 already existed in network, uploaded the leftover 65 chunks in 8 minutes 45 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of NanoTokens(147) for 65 chunks
Made payment of NanoTokens(119) for royalties fees
New wallet balance: 0.000003544
Completed with Ok(()) of execute "Files(Upload { file_path: \"AnarchyInTheSouthside.mp3\", batch_size: 16, make_data_public: true, retry_strategy: Quick })"

and i did not get absolutely destroyed by upload cost i have about 3.5k nanos in the upload fund now

safe files download "AnarchyInTheSouthside.mp3" 1c280f04cf0d0321dcc7de2f9893dead87daf26f4f597d366a8d2b142438144a
8 Likes
7

On the 4MB Chunk network using this upload example of 17 chunks,

some math to consider using 4K block size storage, the default block size for most file systems used EXT3/4, NFS, etc…

the F/S blocksize chosen when setting up the volume (in this case 4K) which indirectly the influences cost of storage, and therefore will influence the price quoted (and rewards earned)by node to the uploader

given the job(earning the rewards) to store initial chunks

17 chunks X 4MB block size will equal = 68MB file size

68,000,000 bytes divided by 4,000 byte block size

equals 17,000 IOPs InputOutput operations if done in one second

n.b- The FTL the ‘file translation layer’, on board most all cheap SSDs running on a micro controller in NVME’s case on each SSD has limited memory (buffering and threading capability (handling multiple session writes at once)

so the volume block size selected for the target drive will impact write speed performance,

too small (ie 4K block size) with multiple competing writes = slow write performance on such cheap NVME SSD drives.

To large a block size specified( say 32k or even 64k) will limit the amount of blocks queued in buffers boy the NVME SSDs controller, causing it to signal wait to the upstream OS File System control, which also slows down the write speed performance of the SSD

Write speed performance in Storage is the BIGGEST Bottleneck always in Network Storage.

So getting the

SIZE alignment of safenode block size to file storage block size,

opytimized

given the capabilities of both one’s SYSTEM (Cores, Threads, Memory and the number of safenodes you want to operate)

balanced with the capabilities of the NVME SSDS providing the storage to the nodes
(over DAS bus or SAN Array Bandwidth)

Is THE key configuration effort

node operators need to pay attention to

ensure their Safenodes perform fast and offer up best price quotes to earn maximum nano rewards.

3 Likes
8

uploads are still working :slight_smile:

🔗 Connected to the Network                                                                                                            Chunking 1 files...
"Patosh-RoughNight.mp3" will be made public and linkable
Splitting and uploading "Patosh-RoughNight.mp3" into 7 chunks
**************************************
*          Uploaded Files            *
**************************************
Uploaded "Patosh-RoughNight.mp3" to address 157632cf709643b9c0962632b838a7dd4cfb74b73a5af6dbaaedb81bb32042e3
Among 7 chunks, found 0 already existed in network, uploaded the leftover 7 chunks in 6 minutes 51 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of NanoTokens(38) for 7 chunks
Made payment of NanoTokens(14) for royalties fees
New wallet balance: 0.000003492
Completed with Ok(()) of execute "Files(Upload { file_path: \"Patosh-RoughNight.mp3\", batch_size: 16, make_data_public: true, retry_strategy: Quick })"

@Patosh

safe files download "Patosh-RoughNight.mp3" 157632cf709643b9c0962632b838a7dd4cfb74b73a5af6dbaaedb81bb32042e3
8 Likes
9

xD haha - difference between home client and server client is kind of drastic

🔗 Connected to the Network                                                                                     Downloading "Patosh-RoughNight.mp3" from 157632cf709643b9c0962632b838a7dd4cfb74b73a5af6dbaaedb81bb32042e3 with batch-size 16
Saved "Patosh-RoughNight.mp3"
File downloaded in 14 seconds 994 milliseconds

🔗 Connected to the Network                                                                                     Downloading "Patosh-RoughNight.mp3" from 157632cf709643b9c0962632b838a7dd4cfb74b73a5af6dbaaedb81bb32042e3 with batch-size 16
Saved "Patosh-RoughNight.mp3"
File downloaded in 362 milliseconds

(btw - and this was not just a temporary effect - it’s still the same if I try it again - I guess I’m seeing now locally a similar effect of what @happybeing has with his mobile connection because somehow network demands have risen to areas my home internet has a hard time to cope with … whyever that would be the case for a client downloading …)

2 Likes
10

aaaactually … though the file is 6.3MB I always download 6 chunks (?) … 4MB chunks * 6 == 24MB …?!

that would explain at least 4s on my crappy internet … if it gets downloaded from a couple sources in parallel redundantly … that might even explain the whole 14s locally … so it would be just the connection speed limit … (another explanation is that somehow I’m just seeing half of my connection speed being utilized … so 8s and some ramp-up-phase up to that speed …)

but why would a 6MB file end up being 6 chunks (?)

2 Likes
11

uploads are sill going up :slight_smile:

safe files download "Best_CD_Ever.mp3" fbacdcbf3498e2524bc984161fb9b629264c0b40430d524f97ddd6cf2bd1b70f
safe files download "Deep Feelings Mix.mp3" dac40db90cf37832e6b00cbbbfe736df18208fdc27c80f8f0a95fcfbff31ace4
3 Likes
12

But downloads aren’t working because the network contacts peers aren’t working. which is reasonable if they are preparing for a new network. But I’d shutdown my accessible safenode so can’t use it as a peer. :frowning:

3 Likes
13

here is a peer downloads still working just fine :slight_smile:

export SAFE_PEERS=/ip4/65.108.69.236/udp/55001/quic-v1/p2p/12D3KooWHyJRcmZ8foHgJhpEhZRZjfkcreMQ2FjMjCLgaPXX3WDP
3 Likes
14

some more uploads fresh off the press

safe files download "An_Introduction_To_The_SafeNetwork.mp4" 9bc36e66c086a18714823c29a7425d79fe15b4820c672600b96ce8aa5ae55952
safe files download "autonomi.mp4" 63ea8d21336febc2df1db605ad10d3470f0c03669feaf7e819403a8e6356c13b

previous uploads just to keep it all together

safe files download "BegBlag.mp3" 304b74b76536e89910262ade48020a4ab2724bdaf353f3b42de625fee2477228
safe files download "AnarchyInTheSouthside.mp3" 1c280f04cf0d0321dcc7de2f9893dead87daf26f4f597d366a8d2b142438144a
safe files download "Patosh-RoughNight.mp3" 157632cf709643b9c0962632b838a7dd4cfb74b73a5af6dbaaedb81bb32042e3
safe files download "Best_CD_Ever.mp3" fbacdcbf3498e2524bc984161fb9b629264c0b40430d524f97ddd6cf2bd1b70f
safe files download "Deep Feelings Mix.mp3" dac40db90cf37832e6b00cbbbfe736df18208fdc27c80f8f0a95fcfbff31ace4
1 Like
15

Linux mint iso just finished uploading for 40,730 nanos :slight_smile:

**************************************
*          Uploaded Files            *
**************************************
Uploaded "linuxmint-21.2-cinnamon-64bit.iso" to address 769d8c65aad0809a                                                                          916c327803f404a8f03d948d4c937143ea7d63dce7be9753
Among 2888 chunks, found 16 already existed in network, uploaded the lef                                                                          tover 2872 chunks in 215 minutes 48 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of NanoTokens(32493) for 2872 chunks
Made payment of NanoTokens(8237) for royalties fees

download

safe --peer="/ip4/65.108.69.236/udp/55001/quic-v1/p2p/12D3KooWHyJRcmZ8foHgJhpEhZRZjfkcreMQ2FjMjCLgaPXX3WDP" files download "linuxmint-21.2-cinnamon-64bit.iso" 769d8c65aad0809a916c327803f404a8f03d948d4c937143ea7d63dce7be9753

check sum

md5sum linuxmint-21.2-cinnamon-64bit.iso
98213481fef82b9337de96469edb5089  linuxmint-21.2-cinnamon-64bit.iso
3 Likes
16

16 chunks existing? Oo … oh well … very very cool!!!

17

download is failing :frowning: there are a few chunks missing ill go for another upload

image
image3745×228 33.3 KB

after a re upload its downloading fine with persistent flag check sum is good :slight_smile:

🔗 Connected to the Network                                                                                                                       Downloading "linuxmint-21.2-cinnamon-64bit.iso" from 769d8c65aad0809a916c327803f404a8f03d948d4c937143ea7d63dce7be9753 with batch-size 64
Saved "linuxmint-21.2-cinnamon-64bit.iso" at /home/ubuntu/linuxmint-21.2-cinnamon-64bit.iso
File downloaded in 2 minutes 47 seconds 541 milliseconds

Completed with Ok(()) of execute "Files(Download { file_name: Some(\"linuxmint-21.2-cinnamon-64bit.iso\"), file_addr: Some(\"769d8c65aad0809a916c327803f404a8f03d948d4c937143ea7d63dce7be9753\"), show_holders: false, batch_size: 64, retry_strategy: Persistent })"

md5sum linuxmint-21.2-cinnamon-64bit.iso
98213481fef82b9337de96469edb5089  linuxmint-21.2-cinnamon-64bit.iso


safe --peer="/ip4/65.108.69.236/udp/55001/quic-v1/p2p/12D3KooWHyJRcmZ8foHgJhpEhZRZjfkcreMQ2FjMjCLgaPXX3WDP" files download "linuxmint-21.2-cinnamon-64bit.iso" 769d8c65aad0809a916c327803f404a8f03d948d4c937143ea7d63dce7be9753 --retry-strategy persistent --batch-size 64
2 Likes
18 
🔗 Connected to the Network                                                                                                                                                                               Downloading "linuxmint-21.2-cinnamon-64bit.iso" from 769d8c65aad0809a916c327803f404a8f03d948d4c937143ea7d63dce7be9753 with batch-size 64
Saved "linuxmint-21.2-cinnamon-64bit.iso" at /backups/anythingllm/linuxmint-21.2-cinnamon-64bit.iso
File downloaded in 4 minutes 16 seconds 258 milliseconds
Completed with Ok(()) of execute "Files(Download { file_name: Some(\"linuxmint-21.2-cinnamon-64bit.iso\"), file_addr: Some(\"769d8c65aad0809a916c327803f404a8f03d948d4c937143ea7d63dce7be9753\"), show_holders: false, batch_size: 64, retry_strategy: Persistent })"

:+1:

4 Likes
19

and she is still alive here is an old Ubuntu image 696Mb

Logging to directory: "/home/ubuntu/.local/share/safe/client/logs/log_2024-10-17_06-43-11"
safe client built with git version: 412b998 / stable / 412b998 / 2024-10-07
Instantiating a SAFE client...
Connecting to the network with 25 peers
⡀ Connecting to The SAFE Network...                                                                                     ^C
ubuntu@sor:~/safe$ export SAFE_PEERS=/ip4/65.108.69.236/udp/55001/quic-v1/p2p/12D3KooWHyJRcmZ8foHgJhpEhZRZjfkcreMQ2FjMjCLgaPXX3WDP
ubuntu@sor:~/safe$ safe files upload -p ubuntu-12.04-alternate-amd64.iso                                                Logging to directory: "/home/ubuntu/.local/share/safe/client/logs/log_2024-10-17_06-43-55"
safe client built with git version: 412b998 / stable / 412b998 / 2024-10-07
Instantiating a SAFE client...
Connecting to the network with 1 peers
🔗 Connected to the Network                                                                                             Chunking 1 files...
"ubuntu-12.04-alternate-amd64.iso" will be made public and linkable
Splitting and uploading "ubuntu-12.04-alternate-amd64.iso" into 697 chunks
**************************************
*          Uploaded Files            *
**************************************
Uploaded "ubuntu-12.04-alternate-amd64.iso" to address 9b34c5034806ba7b3dc24a7fae8e8f2c7eefbf5ad74ef840e0bbd9b9160bbaf8
Among 697 chunks, found 2 already existed in network, uploaded the leftover 695 chunks in 55 minutes 5 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of NanoTokens(9455) for 695 chunks
Made payment of NanoTokens(2218) for royalties fees
New wallet balance: 0.000008893
Completed with Ok(()) of execute "Files(Upload { file_path: \"ubuntu-12.04-alternate-amd64.iso\", batch_size: 16, make_data_public: true, retry_strategy: Quick })"

export SAFE_PEERS=/ip4/65.108.69.236/udp/55001/quic-v1/p2p/12D3KooWHyJRcmZ8foHgJhpEhZRZjfkcreMQ2FjMjCLgaPXX3WDP
safe files download "ubuntu-12.04-alternate-amd64.iso" 9b34c5034806ba7b3dc24a7fae8e8f2c7eefbf5ad74ef840e0bbd9b9160bbaf8

md5sum ubuntu-12.04-alternate-amd64.iso
9fcc322536575dda5879c279f0b142d7  ubuntu-12.04-alternate-amd64.iso
1 Like
20

Its pan breid

willie@gagarin:/fgfs/fgmeta$ export SAFE_PEERS=/ip4/65.108.69.236/udp/55001/quic-v1/p2p/12D3KooWHyJRcmZ8foHgJhpEhZRZjfkcreMQ2FjMjCLgaPXX3WDP
safe files download "ubuntu-12.04-alternate-amd64.iso" 9b34c5034806ba7b3dc24a7fae8e8f2c7eefbf5ad74ef840e0bbd9b9160bbaf8
Logging to directory: "/home/willie/.local/share/safe/client/logs/log_2024-10-17_15-59-05"
safe client built with git version: 412b998 / stable / 412b998 / 2024-10-07
Instantiating a SAFE client...
Connecting to the network with 1 peers
🔗 Connected to the Network                                                                  Downloading "ubuntu-12.04-alternate-amd64.iso" from 9b34c5034806ba7b3dc24a7fae8e8f2c7eefbf5ad74ef840e0bbd9b9160bbaf8 with batch-size 16
Error downloading "ubuntu-12.04-alternate-amd64.iso": Chunks error Chunk could not be retrieved from the network: 1ed298(00011110)...
Completed with Ok(()) of execute "Files(Download { file_name: Some(\"ubuntu-12.04-alternate-amd64.iso\"), file_addr: Some(\"9b34c5034806ba7b3dc24a7fae8e8f2c7eefbf5ad74ef840e0bbd9b9160bbaf8\"), show_holders: false, batch_size: 16, retry_strategy: Quick })"