[ValentinesNet] [14/2/24 Testnet] [Offline]

your right, over 200 folders with maybe 80% being 5K

20Mbs up

52,208 Files
7.15 GB (7,681,815,455 bytes)
7.34 GB (7,885,418,496 bytes) size on disk

Payment is per chunk, but that used to be 1MB minimum. Not sure what use to happen with 5K files, were they disallowed or maybe bundled and wrapped into 1MB chunks

1 Like

can see the memory usage settle down at the time I killed vps 6 and vps 15 and @Josh killed off his nodes that were not receiving as many records as the rest @ 1200 on the 16th

7 Likes

Downloaded in 6m20s. I just used whatever the default options are for downloading in batches.

Maybe whatever the issue was with the download that @Toivo tried earlier was just because the network was going through some turmoil at the time and it would be worth trying again.

2 Likes

Nah I was being a dunce, the 4 in question with very little records in my case were the 4 that died when my nodes were trying to catch up due to a late start.

3 Likes

Good of you to share your plans with us. I’m relieved the kompromat section doesn’t have anything for us (yet).

All 740K of 108 files and folders downloaded in less than 9s.

I see that the format of the download command for folders is the other way from files.

safe folders download <address> <folder>
vs
safe files download <file> <address>

Is there a good reason for this I wonder? Or could it be harmonised for the sake of consistency and ease of remembering?

3 Likes

I’d keep that in mind :slight_smile:

1 Like

History

  • chunks were up to 1MB.
  • 5KB file was split into 3 chunks of 5/3 Kbytes in size.
  • files 3KB or less went as one unencrypted chunk

Now

  • chunks max size changed to 1/2MB in testnets and may remain at that
  • files of any size are now chunked and encrypted
  • no unencrypted sized file
3 Likes

Uploaded an iso last night. Noticed no network address was shown - how do we retrieve this file?

willie@gagarin:~$ safe files upload -p ~/Downloads/ubuntu-22.04.3-live-server-amd64.iso 
Logging to directory: "/home/willie/.local/share/safe/client/logs/log_2024-02-17_03-19-25"
Built with git version: 1c52947 / main / 1c52947
Instantiating a SAFE client...
Trying to fetch the bootstrap peers from https://sn-testnet.s3.eu-west-2.amazonaws.com/network-contacts
Connecting to the network with 48 peers
🔗 Connected to the Network                                                                                                                                           "/home/willie/Downloads/ubuntu-22.04.3-live-server-amd64.iso" will be made public and linkable
Starting to chunk "/home/willie/Downloads/ubuntu-22.04.3-live-server-amd64.iso" now.
Chunking 1 files...
Uploading 4071 chunks
⠂ [01:11:31] [######################################>-] 3940/4071                                                                                                     Retrying failed chunks 131 ...
⠉ [01:18:37] [#######################################>] 3974/4071                                                                                                     Retrying failed chunks 97 ...
⠒ [01:24:58] [#######################################>] 3976/4071                                                                                                     Retrying failed chunks 95 ...
⠚ [01:31:21] [#######################################>] 3977/4071                                                                                                     Retrying failed chunks 94 ...
Unverified file "ubuntu-22.04.3-live-server-amd64.iso", suggest to re-upload again.
**************************************
*          Uploaded Files            *
**************************************
Among 4071 chunks, found 1 already existed in network, uploaded the leftover 4070 chunks in 97 minutes 37 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of 0.007912257 for 4070 chunks
Made payment of 0.001394160 for royalties fees
New wallet balance: 199.988738563

Yes, all my files download again, and superfast. :muscle:

Also, the difference between home LAN and phone tethered is remarkable. Phone needs batch size of 4 to not miss chunks, and LAN has no problem with 64. Although 64 is not faster than 8, at least not on 134 chunk’s file.

3 Likes

Also, to add to @neo’s summary, files of 0, 1 or 2 byes are not uploaded. I expect this will be rectified at some point once the folders API is in place, perhaps storing them in the metadata chunk (so no data map for those and possibly other very small files).

5 Likes

It says the file was unverified and suggests a re-upload. So I think it wasn’t successful so there is no final address.

4 Likes

Failed again…

willie@gagarin:~$ safe files upload -p ~/Downloads/ubuntu-22.04.3-live-server-amd64.iso 
Logging to directory: "/home/willie/.local/share/safe/client/logs/log_2024-02-17_14-50-30"
Built with git version: 1c52947 / main / 1c52947
Instantiating a SAFE client...
Trying to fetch the bootstrap peers from https://sn-testnet.s3.eu-west-2.amazonaws.com/network-contacts
Connecting to the network with 48 peers
🔗 Connected to the Network                                                                                                                                           "/home/willie/Downloads/ubuntu-22.04.3-live-server-amd64.iso" will be made public and linkable
Starting to chunk "/home/willie/Downloads/ubuntu-22.04.3-live-server-amd64.iso" now.
Uploading 94 chunks
⠁ [00:06:26] [----------------------------------------] 0/94                                                                                                          Retrying failed chunks 94 ...
⠉ [00:12:40] [#>--------------------------------------] 3/94                                                                                                          Retrying failed chunks 91 ...
⠒ [00:18:49] [#>--------------------------------------] 4/94                                                                                                          Retrying failed chunks 90 ...
Unverified file "ubuntu-22.04.3-live-server-amd64.iso", suggest to re-upload again.
**************************************
*          Uploaded Files            *
**************************************
Among 94 chunks, found 0 already existed in network, uploaded the leftover 94 chunks in 24 minutes 59 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of 0.000750447 for 94 chunks
Made payment of 0.000132305 for royalties fees
New wallet balance: 199.987855811
4 Likes

Try with a new wallet?

2 Likes

I have also lot’s of difficulties getting a bunch of files up. Of 1,7GB folder about 54 chunks just doesn’t go.

The errors are again this type. Someone has bad nodes again. Who could that be? What do you think, @aatonnomicc? :wink:

[2024-02-17T18:24:07.631009Z DEBUG sn_networking] Did not get a valid response for the ChunkProof from PeerId("12D3KooWBoju5RbNGWxwV2CwESw1kuGw26W3J3DD9cPYdtMwfibv")
[2024-02-17T18:24:07.631053Z DEBUG sn_networking] Did not get a valid response for the ChunkProof from PeerId("12D3KooWHyQtF2EXRsrANZKALamz9s3Z5weTDcxHYmpPZqXN5DbW")
[2024-02-17T18:24:07.631087Z DEBUG sn_networking] Did not get a valid response for the ChunkProof from PeerId("12D3KooWKNhjjxUVuJD69ph8KBkkd845dMZ1TDuou2Fpy6XNWxmP")
[2024-02-17T18:24:07.631118Z DEBUG sn_networking] Did not get a valid response for the ChunkProof from PeerId("12D3KooWMhr7v9SnqScunF2Y13jwepsc6KBBAUVkycxDwHQd8W3w")
[2024-02-17T18:24:07.631144Z DEBUG sn_networking] Did not get a valid response for the ChunkProof from PeerId("12D3KooWNobVHVpdMmh4Xhs8yciNkiKQQ2BQA842vLpzRgVyfkQG")
[2024-02-17T18:24:07.631173Z DEBUG sn_networking] Got 0 verified chunk existence proofs for chunk_address NetworkAddress::RecordKey(b4e23d - 0ac08926146597649df801d395ff0542423f34c70a66e5a66393198f9a0b7b10)
2 Likes

i just checked all my machines @Toivo one of those offending nodes was mine and is now terminated

12D3KooWBoju5RbNGWxwV2CwESw1kuGw26W3J3DD9cPYdtMwfibv

Logs Logs for 12D3KooWBoju5RbNGWxwV2CwESw1kuGw26W3J3DD9cPYdtMwfibv

these delinquents are nothing to do with me lol

12D3KooWHyQtF2EXRsrANZKALamz9s3Z5weTDcxHYmpPZqXN5DbW not one of mine
12D3KooWKNhjjxUVuJD69ph8KBkkd845dMZ1TDuou2Fpy6XNWxmP not one of mine
12D3KooWMhr7v9SnqScunF2Y13jwepsc6KBBAUVkycxDwHQd8W3w not one of mine
12D3KooWNobVHVpdMmh4Xhs8yciNkiKQQ2BQA842vLpzRgVyfkQG not one of mine
7 Likes

Worth a try but sadly no further forward…

willie@gagarin:~/safehome/client$ rm -rf wallet/
willie@gagarin:~/safehome/client$ safe wallet get-faucet 64.227.32.230:8000
Logging to directory: "/home/willie/.local/share/safe/client/logs/log_2024-02-17_15-48-17"
Built with git version: 1c52947 / main / 1c52947
Instantiating a SAFE client...
Trying to fetch the bootstrap peers from https://sn-testnet.s3.eu-west-2.amazonaws.com/network-contacts
Connecting to the network with 48 peers
🔗 Connected to the Network                                                                                                                                           Requesting token for wallet address: 91ee9092e04e95f07c4a77f6c1e6e1f52291ce571e81407ef84d18f2d132ebe9f2fe481f1938ff99e7761849a6b9f040
Successfully parsed transfer. 
Verifying transfer with the Network...
Successfully verified transfer.
Successfully stored cash_note to wallet dir.
Old balance: 0.000000000
New balance: 100.000000000
Successfully got tokens from faucet.
willie@gagarin:~/safehome/client$ safe files upload -p ~/Downloads/ubuntu-22.04.3-live-server-amd64.iso 
Logging to directory: "/home/willie/.local/share/safe/client/logs/log_2024-02-17_15-48-26"
Built with git version: 1c52947 / main / 1c52947
Instantiating a SAFE client...
Trying to fetch the bootstrap peers from https://sn-testnet.s3.eu-west-2.amazonaws.com/network-contacts
Connecting to the network with 48 peers
🔗 Connected to the Network                                                                                                                                           "/home/willie/Downloads/ubuntu-22.04.3-live-server-amd64.iso" will be made public and linkable
Starting to chunk "/home/willie/Downloads/ubuntu-22.04.3-live-server-amd64.iso" now.
Uploading 90 chunks
⠁ [00:06:11] [#>--------------------------------------] 4/90                                                                                                          Retrying failed chunks 86 ...
⠂ [00:12:12] [####>-----------------------------------] 9/90                                                                                                          Retrying failed chunks 81 ...
⠐ [00:17:47] [####>-----------------------------------] 11/90                                                                                                         Retrying failed chunks 79 ...
Unverified file "ubuntu-22.04.3-live-server-amd64.iso", suggest to re-upload again.
**************************************
*          Uploaded Files            *
**************************************
Among 90 chunks, found 0 already existed in network, uploaded the leftover 90 chunks in 23 minutes 20 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of 0.000684938 for 90 chunks
Made payment of 0.000120733 for royalties fees
New wallet balance: 99.999194329
5 Likes

Have you checked for any of those offending nodes on your herzner ? I know its spelt wrong but I’m dylexic and don’t care.

5 Likes

We can tell - I’ll do some grepping once Ive finished my LemSip

4 Likes

Use your NTracking it’s got a search feature at the top of the page put in the node ID and it will tell you if it’s yours and in which machine it is on :slight_smile: it’s a game changer :joy:

2 Likes

Too late - one of them is mine though



safe@ValentestnetSouthside01:~/safespace/node$ ll |grep mh4Xhs8yciNkiKQQ2BQA842
drwxrwxr-x   5 safe safe  4096 Feb 17 10:56 12D3KooWNobVHVpdMmh4Xhs8yciNkiKQQ2BQA842vLpzRgVyfkQG/

So I’ll kill that now.
I ran out of disk space and ntracking is not working any more on http://135.181.196.39/mtracking.html

2 Likes