[MemDebugNet] [4/10/23 Testnet] [Offline]

Development Releases
242

still struggling to download this file on my home connection even after increasing time out to 120s

ubuntu@safe:~$ safe files download  --timeout 120 AnarchyInTheSouthside.mp3 eaa0b39813183323b491e6715a0b4ea9f3cfdeede6f04a73c5b849b5210ad20d
Logging to directory: "/home/ubuntu/.local/share/safe/client/logs/log_2023-10-10_08-58-14"
Built with git version: 985e1d0 / main / 985e1d0
Instantiating a SAFE client...
Trying to fetch the bootstrap peers from https://sn-testnet.s3.eu-west-2.amazonaws.com/network-contacts
Connecting to the network w/peers: ["/ip4/138.68.175.236/tcp/38365/p2p/12D3KooWBk7HqragMtCdmfTYVAy8T9jJuPRbade5BjE3q7sDXuYC", "/ip4/134.122.110.132/tcp/42537/p2p/12D3KooW9x133NoUsif3aXLw33MinDLXMKvdQwL8Fy6FPnKk1U1p", "/ip4/138.68.178.41/tcp/35753/p2p/12D3KooW9t3EoKMrxY98Hd8m92rkKzDguyP7qmNP1Yb5nzKHsUsX", "/ip4/209.97.183.90/tcp/35353/p2p/12D3KooWBJQSD2qrpqdHau6dti5tihkK8NBFAyjeRuHR5aZgZ7EZ", "/ip4/209.97.134.128/tcp/36563/p2p/12D3KooW9uycSAMUxnVMXBFDtvFkmSmZJ2p5vJy6mvyv6986WkVw", "/ip4/165.22.114.243/tcp/43507/p2p/12D3KooWA88RP5cNNxQZrnLHGxU21EYFvfDjVYZkn3aestkqDyze", "/ip4/165.227.226.209/tcp/37861/p2p/12D3KooW9rENjfWvuoHahcQiziWk4B9Yfzw7kBSi6BrBFp4rUhp3", "/ip4/167.99.89.78/tcp/39385/p2p/12D3KooWAUUTizhiGYqFcJksDk7YbWXMra7DhkJormQY5LwstXbV", "/ip4/178.62.5.22/tcp/41709/p2p/12D3KooWA4WvSGtGkFVJT14q7kSss8UZZHm1PMSntuJNE5tSoSut", "/ip4/134.122.110.125/tcp/43885/p2p/12D3KooWCUxxiNK4TU98yiSbZf1pAVTai5qcH9sTvkN2QjHRiTno", "/ip4/138.68.182.225/tcp/34247/p2p/12D3KooWA4YKEECUHGBmAAGsLsuCihdb5mMgkJSfbvt9ysaLASFQ", "/ip4/138.68.190.1/tcp/37523/p2p/12D3KooWADMxubnokBfg1xNwMUwY2Z4yqYjrRjTB6CXkrh48L7Ne", "/ip4/142.93.35.1/tcp/44573/p2p/12D3KooWBLJGVswdvJvvBLU33WCwJdLSxzKmWdPyghLvKaxHt9xN", "/ip4/167.99.89.55/tcp/36549/p2p/12D3KooWAbPRA4MjFnpcdsTEHdiifLctywvanMQgRj91cSgm2eq4", "/ip4/165.227.238.161/tcp/39591/p2p/12D3KooWB5PKufJLJ2Lzm16uBzFHPXK46Qz2RPbmm6K4mTVxeHBF", "/ip4/165.232.98.177/tcp/42309/p2p/12D3KooW9rHbExmGFDu3rEx5Cei57vH5ahftncZXRBCuQjAxhjrv", "/ip4/209.97.128.181/tcp/45271/p2p/12D3KooWAkJybhpGKrpurFN3XkLxKnKc8CLSSJDNMaEPgZrk6nQs", "/ip4/68.183.33.142/tcp/34385/p2p/12D3KooW9qo2TEV6jTrFe8JCTs4CdGwjoZHKVFwpiWmjyQGRxN9a", "/ip4/209.97.143.12/tcp/45085/p2p/12D3KooWCKZyxndJoL7snv1w6q4WkgsDzQB6n3rPFVCCSpcePbVd", "/ip4/161.35.161.196/tcp/44469/p2p/12D3KooW9uZJEnTm2eg6CrMvbepn5RSgkAMU4RQsNzk9nmBbwX55"]...
🔗 Connected to the Network                                                                                                                                                                                                                             Downloading AnarchyInTheSouthside.mp3 from eaa0b39813183323b491e6715a0b4ea9f3cfdeede6f04a73c5b849b5210ad20d
Client (read all) download progress 1/132
Error downloading "AnarchyInTheSouthside.mp3": Chunks error Chunk could not be retrieved from the network: f0a250(11110000)...

log

safe.log to 8a9009e1b5c4ebc2e81fe899ff09bb8648d06b37b199a3c944b8f2e0074bc884
2 Likes
243

And again arrived here in no time:

Client downloaded file in 59.442593798s
Saved AnarchyInTheSouthside.mp3 at /home/topi/.local/share/safe/client/AnarchyInTheSouthside.mp3

real	1m2,430s
user	0m41,540s
sys	0m12,135s

I’d like to try to upload something, but the faucet is not working. Could someone send me a penny? @aatonnomicc, remember the guy, who once helped you out, when you were in trouble :disappointed_relieved:

Or are the prices so high that no money can buy any storage?

aa06a51ccae374ee595e2e881834d2056e1d0d025083401a1fcf9085d1a63ef72860911b15dbb74adc6eae2daf89292c

4 Likes
244

this is prety much all iv got just for you @Toivo

safe wallet receive 5ec1a8603e163021e9fd31c1fcc62834148482994c779df62c77e801824f5fd78fd45a2849408942200e79e1a2ab060832b4e41b424f7f06dd8764fdd5496d793d1c4206a8550269d23c80b866d0e409008107d297179cbfccb6443918363b8e6b37cb97b55e274d458b2f9ae46093deeaf983c830831eaff963b25f0c96212bd37101336589f0477212cfc8975fbae2770c96a1611fdc0a369f86dff09ccc6b967d256fab99df71a30d000edf3af943d9670c247cfd3f324efa58deda82c88d7b00000000000000614e9fd0c316495837b3140a43df6b77291141398701f40f4e3491cbaf1449879bd60b03f5995f44a187d68512eea23eb90000000000000001
3 Likes
245 

Input was split into 185 chunks
Will now attempt to upload them...
Error: 
   0: Transfer Error Transfer error: Not enough balance, 99.991793956 available, 1890599.515990176 required.
5 Likes
246

Thanks a lot @aatonnomicc, I knew I could trust you :heartpulse:

So for you it is 1890599 / 185 = 10219 per chunk.
But I uploaded mine with:

Chunking 1 files...
Input was split into 4 chunks
Will now attempt to upload them...
Uploaded 4 chunks in 20 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of 0.000352771 for 4 chunks

EDIT:

OK, larger file is way more expensive:

Chunking 1 files...
Input was split into 115 chunks
Will now attempt to upload them...
Error: 
   0: Transfer Error Transfer error: Not enough balance, 124.999647229 available, 76072388.474115903 required.
5 Likes
247

im getting

Made payment of 0.000009418 for 1 chunks

restarted my router and increased time out to 500 seconds and still failing on same chunk

3 Likes
248

Interesting, I tried another file…

Uploaded 4 chunks in 14 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of 0.000026177 for 4 chunks

EDIT: I see, price goes with file size

Input was split into 58 chunks
Will now attempt to upload them...
Uploaded 58 chunks in 1 minutes 14 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of 0.009446603 for 58 chunks

EDIT2: It is not about file size I think. Price varies greatly between nodes and with more chunks, there is bigger probability of hitting really expensive nodes:

Input was split into 4 chunks
Will now attempt to upload them...
Uploaded 4 chunks in 16 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of 0.253467645 for 4 chunks

Btw I thought chunk size is 512 kB, how come 112 kB file was chunked in 4 chunks?

5 Likes
249

upgraded to the latest client and am now failing on a different chunk

Error downloading "AnarchyInTheSouthside.mp3": Chunks error Chunk could not be retrieved from the network: f0a250(11110000)

edit ------------------

it changed chunk on the last try before I upgraded the client to sn_cli 0.83.36

3 Likes
250

And my file was only 36,7kB, uploaded earlier, and still pricier than yours.

Me: Made payment of 0.000352771 for 4 chunks 36,7kB
You: Made payment of 0.000026177 for 4 chunks 112kB

EDIT:

Three times the same upload back to back:

Made payment of 0.001811038 for 11 chunks
Made payment of 0.000034194 for 11 chunks
Made payment of 0.001809202 for 11 chunks

File of 16 chunks is super pricey. A steep rise from 11 chunks:

Input was split into 16 chunks
Will now attempt to upload them...
Error: 
   0: Transfer Error Transfer error: Not enough balance, 124.992304823 available, 1890599.508113001 required.

The command safe files download

downloaded my files successfully. But a file that was a 4,8MB jpg before uploading, is now a 28,7MB jpg file. But it opens normally. I uploaded it six times, and so it downloaded six times, so that’s where the number comes. But weird thing anyway.

4 Likes
251

At the mo you cannot. Also, this statement mayy have been a bit premature. I’ve had good/bad runs with and without this change. (Which was me manually coding in another semaphore).

After that I’ve been poking at more libp2p ways to perhaps tame concurrent up/down, and there’s a couple of PRs that mayyy help here.

A lot of the slow upload situation appears to have been due to the kad timeout though, and us loosing some responses (or libp2p… I think standard packet loss), but basically not allowing us to progress if we had one failed StoreCost check.

sn_cli 083.36 features a reduction here that may help smooth things out.

This is likely just more transfers taking more time (and requiring verification before we progress).

@toivo (i think) asked how our nodes were doing… at ~200mb ram usage, ~50% capacity. And we’ve started to lose some (between 2-5 on most machines are down).

7 Likes
252

Faucet isn’t working for me either.

Any spare tokens so I can test the upload with the new client? Contributions appreciated to:

8a9c82c95d9e93c29ae7ac6b7f9464f7b39fa8d9f414ff2e8358a6c96e58d5368c117af9d6a4ca4c6bb7010f05d360fc

2 Likes
253

Here you go, 65:

36aa24138ecc4118233ae12b75a527d489f3b6fe66383c0af522fa1703b4a4e7a86cb869656987b36ff301fd30be570e813bd50d366c0c548e6399e0e47f5836aac003660800f184aee2a12489f0da495b6f3f4c55f8c24b00449abdb94bc9b9cb9f9f98e9680fdf928fc1844fe884b815267019c44a41348ef2eb9ab1e72e3169a51d79d84e0a6ad67ec952be7050fb411ff80cbe1cfc487652175b4bca8b1967b8da3173d7adbf9addd9a2a232c35511326b802798180dd874546ee0c0369eb5fc588c10920000000000000066dd5db138cfc42a8c089e625cc273fdf2a24cfd07239b7999e55c9cce5b53ef6aaebc987f776f36ccc650952eff1287b90000000000000001

But be aware the price gets astronomical somewhere between 11 and 16 chunks - at least for me. It seems the network doesn’t treat everyone as equal.

2 Likes
254

Not sure if it is a proven fix but i removed safe and reinstalled. Faucet worked after.

4 Likes
255

Bum, that didn’t work (well, removing ~/.local/share/safe/client) and now I’ve blown the receive address. Sorry @Toivo your generous gift is lost forever :man_facepalming:

In case there are any still willing to send tokens to an idiot :pray: my new address is:

a7d51c5de31b02395d22e58b630b8458e1ae376395873e3af554d23061c70eca589f99d8bb7a38835ca1df9e61c0428f

4 Likes
256

There’s 30 more:

Summary

61b24eb0ce8f781e14cc102d6de4d7c6cf7b771ec0bab9bd4c53634b2900a71a141726b662e71b7214df38c488293417dd67f84960388198b61147ae8194599f40038d6e2d09acb06a5da06cc867e167468cce0d401ce46fc5d674929d258f849eca2dc555c0a347f93548a9e938a9377230cdff377cecb5c022261ff79a06b0346d04918e2077bf8aa859395bd4a7bb4199a115e2e3fc8528dc947cb3ea855237654c7b107755c0d0691c2f69e0759b5026081809da6f9f01b8092b3451ded2676f78b4c57e88d76178e30fac000000000000006d450a568b48ed2e4b81692341a846938b63c329bdca43768238d86e2deabdfe199a75e1e5be2523c7454baafaba69bfb60000000000000001

6 Likes
257 
Successfully stored cash_note to wallet dir. 
Old balance: 0.000000000
New balance: 30.000000000

:pray:

5 Likes
258

@joshuef trying my mega upload of Videos seems to have hit the same problem using

$ safe -V
sn_cli 0.83.36

safe.zip (269.0 KB)

2 Likes
259

8c36f44d743fc3cbc409edc809977dfccf866ff5a997a372ebf02e3db2b9587e is missing a response

[2023-10-10T12:52:17.652857Z TRACE sn_networking::event] KademliaEvent ignored: OutboundQueryProgressed { id: QueryId(50), result: GetClosestPeers(Err(Timeout { key: [140, 54, 244, 77, 116, 63, 195, 203, 196, 9, 237, 200, 9, 151, 125, 252, 207, 134, 111, 245, 169, 151, 163, 114, 235, 240, 46, 61, 178, 185, 88, 126], peers: [PeerId("12D3KooWCNpSEeuMk23C6JQ8ZwNZPxUsA8SX35BK8jptkU4Fomvm"), PeerId("12D3KooWARXwRwBYDovzev9tQHZ4KqXLVTemuGdib3aoxyFa446g"), PeerId("12D3KooWBHJFgf3V3YMcWjhrstYc3du2jJirN8rBSg3MkNeCo4vm"), PeerId("12D3KooWSQicdjch6ewSVYVs4uC7dKe8DXZNuQ9oE1ZKup9Cmwit"), PeerId("12D3KooWB5PKufJLJ2Lzm16uBzFHPXK46Qz2RPbmm6K4mTVxeHBF"), PeerId("12D3KooWPaheVZ5Mjdt6c6zUo5wgMhCPhX32K2M7fm7t6jek78gT"), PeerId("12D3KooWNrM6Trn1KqvPqCDmfuW61os2Ma5N1dpyRMEEjtHUDkvL"), PeerId("12D3KooWJzSLqyN9yjFqhcPFP2JuoLYiWzZPDyUV2ZB3CAYP6JLa"), PeerId("12D3KooWK9zFJVY4SLqXpMtb2AU6mTnNm5stveGKk2KTTeQkSR23")] })), stats: QueryStats { requests: 42, success: 15, failure: 0, start: Some(Instant { tv_sec: 58518, tv_nsec: 540761167 }), end: Some(Instant { tv_sec: 58578, tv_nsec: 917699912 }) }, step: ProgressStep { count: 1, last: true } }

We’re not handling our timeout here. Ahaaaa! (Also why 9 closest peers!?)

10 Likes
260

its effectively dead - inflated itself out of meaningful existence.


🔗 Connected to the Network                                                                                     Chunking 1 files...
Input was split into 4 chunks
Will now attempt to upload them...
Error: 
   0: Transfer Error Transfer error: Not enough balance, 20792.924066954 available, 78440561.750190965 required.
   1: Transfer error: Not enough balance, 20792.924066954 available, 78440561.750190965 required
   2: Not enough balance, 20792.924066954 available, 78440561.750190965 required

Location:
   sn_cli/src/subcommands/files.rs:226

Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.

Alas poor MemDebugNet, you were fun…

2 Likes
261

Full, not dead - I hope. That should be two significantly different states.

Btw, I added 50 more nodes today in hope to push prices little bit down, but I saw no difference. Too little, too late I guess.

3 Likes