If it doesnt error out, i’d say leave it running and see if it carries on. That shoouuld just lead to a retry (and we relaly shouldnt report the error there I think if it does retry)
1 Like
Ya Dancer !!!
upgraded to safe client 83.27
faucet is working again
beg blag went up without a hitch 
ubuntu@safe:~/safe$ safe files upload BegBlagandSteal.mp3
Logging to directory: "/home/ubuntu/.local/share/safe/client/logs/log_2023-10-05_18-51-17"
Built with git version: 3d130db / main / 3d130db
Instantiating a SAFE client...
Trying to fetch the bootstrap peers from https://sn-testnet.s3.eu-west-2.amazonaws.com/network-contacts
Connecting to the network w/peers: ["/ip4/138.68.175.236/tcp/38365/p2p/12D3KooWBk7HqragMtCdmfTYVAy8T9jJuPRbade5BjE3q7sDXuYC", "/ip4/134.122.110.132/tcp/42537/p2p/12D3KooW9x133NoUsif3aXLw33MinDLXMKvdQwL8Fy6FPnKk1U1p", "/ip4/138.68.178.41/tcp/35753/p2p/12D3KooW9t3EoKMrxY98Hd8m92rkKzDguyP7qmNP1Yb5nzKHsUsX", "/ip4/209.97.183.90/tcp/35353/p2p/12D3KooWBJQSD2qrpqdHau6dti5tihkK8NBFAyjeRuHR5aZgZ7EZ", "/ip4/209.97.134.128/tcp/36563/p2p/12D3KooW9uycSAMUxnVMXBFDtvFkmSmZJ2p5vJy6mvyv6986WkVw", "/ip4/165.22.114.243/tcp/43507/p2p/12D3KooWA88RP5cNNxQZrnLHGxU21EYFvfDjVYZkn3aestkqDyze", "/ip4/165.227.226.209/tcp/37861/p2p/12D3KooW9rENjfWvuoHahcQiziWk4B9Yfzw7kBSi6BrBFp4rUhp3", "/ip4/167.99.89.78/tcp/39385/p2p/12D3KooWAUUTizhiGYqFcJksDk7YbWXMra7DhkJormQY5LwstXbV", "/ip4/178.62.5.22/tcp/41709/p2p/12D3KooWA4WvSGtGkFVJT14q7kSss8UZZHm1PMSntuJNE5tSoSut", "/ip4/134.122.110.125/tcp/43885/p2p/12D3KooWCUxxiNK4TU98yiSbZf1pAVTai5qcH9sTvkN2QjHRiTno", "/ip4/138.68.182.225/tcp/34247/p2p/12D3KooWA4YKEECUHGBmAAGsLsuCihdb5mMgkJSfbvt9ysaLASFQ", "/ip4/138.68.190.1/tcp/37523/p2p/12D3KooWADMxubnokBfg1xNwMUwY2Z4yqYjrRjTB6CXkrh48L7Ne", "/ip4/142.93.35.1/tcp/44573/p2p/12D3KooWBLJGVswdvJvvBLU33WCwJdLSxzKmWdPyghLvKaxHt9xN", "/ip4/167.99.89.55/tcp/36549/p2p/12D3KooWAbPRA4MjFnpcdsTEHdiifLctywvanMQgRj91cSgm2eq4", "/ip4/165.227.238.161/tcp/39591/p2p/12D3KooWB5PKufJLJ2Lzm16uBzFHPXK46Qz2RPbmm6K4mTVxeHBF", "/ip4/165.232.98.177/tcp/42309/p2p/12D3KooW9rHbExmGFDu3rEx5Cei57vH5ahftncZXRBCuQjAxhjrv", "/ip4/209.97.128.181/tcp/45271/p2p/12D3KooWAkJybhpGKrpurFN3XkLxKnKc8CLSSJDNMaEPgZrk6nQs", "/ip4/68.183.33.142/tcp/34385/p2p/12D3KooW9qo2TEV6jTrFe8JCTs4CdGwjoZHKVFwpiWmjyQGRxN9a", "/ip4/209.97.143.12/tcp/45085/p2p/12D3KooWCKZyxndJoL7snv1w6q4WkgsDzQB6n3rPFVCCSpcePbVd", "/ip4/161.35.161.196/tcp/44469/p2p/12D3KooW9uZJEnTm2eg6CrMvbepn5RSgkAMU4RQsNzk9nmBbwX55"]...
🔗 Connected to the Network Chunking 1 files...
Input was split into 32 chunks
Will now attempt to upload them...
Uploaded 32 chunks in 24 seconds
**************************************
* Payment Details *
**************************************
Made payment of 0.000012727 for 32 chunks
New wallet balance: 454.999975914
**************************************
* Verification *
**************************************
32 chunks to be checked and repaid if required
Verified 32 chunks in 2.613871238s
Verification complete: all chunks paid and stored
**************************************
* Uploaded Files *
**************************************
Uploaded BegBlagandSteal.mp3 to 80744b3d25bab269cab54e8baccf4f54f1aa01615230b99171bc3576c1ca7230
4 Likes
large files are still failing just tried a 2Gb movie and got an error then it terminated back to bash command line
ubuntu@safe:~/safe$ safe files upload crow.mkv
Logging to directory: "/home/ubuntu/.local/share/safe/client/logs/log_2023-10-05_18-54-05"
Built with git version: 3d130db / main / 3d130db
Instantiating a SAFE client...
Trying to fetch the bootstrap peers from https://sn-testnet.s3.eu-west-2.amazonaws.com/network-contacts
Connecting to the network w/peers: ["/ip4/138.68.175.236/tcp/38365/p2p/12D3KooWBk7HqragMtCdmfTYVAy8T9jJuPRbade5BjE3q7sDXuYC", "/ip4/134.122.110.132/tcp/42537/p2p/12D3KooW9x133NoUsif3aXLw33MinDLXMKvdQwL8Fy6FPnKk1U1p", "/ip4/138.68.178.41/tcp/35753/p2p/12D3KooW9t3EoKMrxY98Hd8m92rkKzDguyP7qmNP1Yb5nzKHsUsX", "/ip4/209.97.183.90/tcp/35353/p2p/12D3KooWBJQSD2qrpqdHau6dti5tihkK8NBFAyjeRuHR5aZgZ7EZ", "/ip4/209.97.134.128/tcp/36563/p2p/12D3KooW9uycSAMUxnVMXBFDtvFkmSmZJ2p5vJy6mvyv6986WkVw", "/ip4/165.22.114.243/tcp/43507/p2p/12D3KooWA88RP5cNNxQZrnLHGxU21EYFvfDjVYZkn3aestkqDyze", "/ip4/165.227.226.209/tcp/37861/p2p/12D3KooW9rENjfWvuoHahcQiziWk4B9Yfzw7kBSi6BrBFp4rUhp3", "/ip4/167.99.89.78/tcp/39385/p2p/12D3KooWAUUTizhiGYqFcJksDk7YbWXMra7DhkJormQY5LwstXbV", "/ip4/178.62.5.22/tcp/41709/p2p/12D3KooWA4WvSGtGkFVJT14q7kSss8UZZHm1PMSntuJNE5tSoSut", "/ip4/134.122.110.125/tcp/43885/p2p/12D3KooWCUxxiNK4TU98yiSbZf1pAVTai5qcH9sTvkN2QjHRiTno", "/ip4/138.68.182.225/tcp/34247/p2p/12D3KooWA4YKEECUHGBmAAGsLsuCihdb5mMgkJSfbvt9ysaLASFQ", "/ip4/138.68.190.1/tcp/37523/p2p/12D3KooWADMxubnokBfg1xNwMUwY2Z4yqYjrRjTB6CXkrh48L7Ne", "/ip4/142.93.35.1/tcp/44573/p2p/12D3KooWBLJGVswdvJvvBLU33WCwJdLSxzKmWdPyghLvKaxHt9xN", "/ip4/167.99.89.55/tcp/36549/p2p/12D3KooWAbPRA4MjFnpcdsTEHdiifLctywvanMQgRj91cSgm2eq4", "/ip4/165.227.238.161/tcp/39591/p2p/12D3KooWB5PKufJLJ2Lzm16uBzFHPXK46Qz2RPbmm6K4mTVxeHBF", "/ip4/165.232.98.177/tcp/42309/p2p/12D3KooW9rHbExmGFDu3rEx5Cei57vH5ahftncZXRBCuQjAxhjrv", "/ip4/209.97.128.181/tcp/45271/p2p/12D3KooWAkJybhpGKrpurFN3XkLxKnKc8CLSSJDNMaEPgZrk6nQs", "/ip4/68.183.33.142/tcp/34385/p2p/12D3KooW9qo2TEV6jTrFe8JCTs4CdGwjoZHKVFwpiWmjyQGRxN9a", "/ip4/209.97.143.12/tcp/45085/p2p/12D3KooWCKZyxndJoL7snv1w6q4WkgsDzQB6n3rPFVCCSpcePbVd", "/ip4/161.35.161.196/tcp/44469/p2p/12D3KooW9uZJEnTm2eg6CrMvbepn5RSgkAMU4RQsNzk9nmBbwX55"]...
🔗 Connected to the Network Chunking 1 files...
Input was split into 4418 chunks
Will now attempt to upload them...
Error:
0: Transfer Error Failed to send tokens due to Network Error Could not retrieve the record after storing it: d6d4aedf6535bf2c8b414c59200725e095e2eeb9dd2a3eb4d516c9b821be440c..
1: Failed to send tokens due to Network Error Could not retrieve the record after storing it: d6d4aedf6535bf2c8b414c59200725e095e2eeb9dd2a3eb4d516c9b821be440c.
Location:
sn_cli/src/subcommands/files.rs:210
Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.
ubuntu@safe:~/safe$
log
safe.log 471e420898b9500ecfedbf773b9990a86e40a7f32e4b3b5ead18ed784d40d5e3
1 Like
I think I saw that error on the last testnet when I tried uploading and hadn’t cleared .local/share/safe/client so still had a wallet from a previous testnet.
1 Like
And yet I just upgraded to safe 83.27 and had a total failure with the same file!
Chunking 1 files...
Input was split into 32 chunks
Will now attempt to upload them...
Error:
0: Transfer Error Failed to send tokens due to Network Error Could not retrieve the record after storing it: f325196a6887d3f8a4a79a1d992bfa76625b256366b803c9b9cb9066815c4f38..
1: Failed to send tokens due to Network Error Could not retrieve the record after storing it: f325196a6887d3f8a4a79a1d992bfa76625b256366b803c9b9cb9066815c4f38.
Downgraded to 83.18 and it worked fine.
Upgraded to 83.27 again and same failure.
2 Likes
Did you recreate a new wallet with your new client? You should.
1 Like
I started it off again and it says it is uploading chunks, progress hasn’t moved and its time shows 31 minutes so I have grabbed the log which looks stuck again:
safe.zip (54.5 KB)
I’ll leave it running a bit longer but may have to stop it in an hour or so.
EDIT: after 2hr 11m no change in the progress bar so I’m afraid I have to stop it. I think the above safe.zip has what you need but will re-upload the log up to now if you want it.
3 Likes
same, I tried latest and it complained right away.
Error:
0: Transfer Error Failed to send tokens due to Network Error Could not retrieve the record after storing it: f325196a6887d3f8a4a79a1d992bfa76625b256366b803c9b9cb9066815c4f38..
1: Failed to send tokens due to Network Error Could not retrieve the record after storing it: f325196a6887d3f8a4a79a1d992bfa76625b256366b803c9b9cb9066815c4f38.
then went to 83.18 and it has been chugging along for a good 20 minutes uploading a dir just shy of 1gb.
Edit: the suspense is killing me 
Current progress is 1040/1886.
2 Likes
Now I’m baffled because an hour later it has worked with 83.27.
1 Like
it was all going so well but it appears, to be hanging here now.
Uploaded 6 chunks in 27.176169027s. Current progress is 1886/1886.
First round of upload complete. Verifying and repaying if required...
======= Verification: 1886 chunks to be checked and repaid if required =============
Failed to fetch a chunk ChunkAddress(140e1b(00010100)..)
Edit: nope, it moved, still in it. excitiment returns.
Edit2: excuse me while I do a happy dance!
I have not been uploading much lately but this is the best result I have had in a while. 973.4 MB
======= Verification complete: all chunks paid and stored =============
Uploaded all chunks in 101 minutes 52 seconds
5 Likes
I’ve been uploading since yesterday with (sn_cli 0.83.17) and all but my largest file (which was going all night) went through okay. The final large file failed with the standard:
Uploaded 10 chunks in 55.109268987s. Current progress is 1450/1659.
Getting upload costs from network for 10 chunks...
Cannot get store cost for NetworkAddress::ChunkAddress(03a34d(00000011).. - - 03a34d6b122a6cda361c3405370d36bb11dde82f90bc65d8125e9c7c254c6ef8) with error CouldNotSendMoney("Network Error Not enough store cost prices returned from the network to ensure a valid fee is paid.")
Transfers applied locally
Error:
0: Transfer Error Failed to send tokens due to Network Error Could not retrieve the record after storing it: b8f96aeab3ccdc29b2466fb76f47f986bca44a9e89a119dd1ea828134a410425..
1: Failed to send tokens due to Network Error Could not retrieve the record after storing it: b8f96aeab3ccdc29b2466fb76f47f986bca44a9e89a119dd1ea828134a410425.
log of the last upload that failed:
safe.log.zip (1.0 MB)
Should I update the client and start again? I notice others are using newer client - what’s the go here devs?
3 Likes
I managed to get a node working from my office, and so far everything seems to be running smoothly. I haven’t seen any of the memory issues that have been mentioned.
I haven’t taken part in any testnets since the early ones a couple of years ago, so it’s great to see the progress. I recall that back then there was discussion of only allowing one node per public IP when mainnet goes live. Is that still the plan or will be be able to run multiple nodes behind the same router?
8 Likes
There’s something funny going on because I’ve had my upload of random files running since the start on 0.83.17 on a different VM on the same computer with very few errors.
So I downgraded safe on the VM I’ve been using to upload BegBlagandSteal to 0.83.17 and that failed at the same rate - about 1 in 3.
I even tried stopping the upload of random files. I thought there was a difference at first but now I think there isn’t.
Another thing I’ve tried is using one of my own nodes as the SAFE_PEER rather than relying on the default ones in case they are overloaded. No difference.
The uploads seem to fail at the verify stage. So there isn’t a problem writing the records but at the stage of reading them from the network.
So I wondered if now there is if there is a lot of contention on read the records for BegBlagandSteal because multiple people are trying to read them for the verify stage so I tried uploads of files the network won’t have seen before (which is what my random file uploader is doing). That seems to work a lot better. So I think it is either contention on popular files or general problems reading saved files for verify purposes. I favour the former because the few tests of downloading the random files I’ve done have all worked.
So I really need to do complete the script for downloading all the files I’ve uploaded and checking their md5sums.
And we could do with a bunch of people all trying to download a popular file at once!
6 Likes
We are looking for folk to run multiple nodes per IP, it’s cool.
7 Likes
@aatonnomicc can you post the address for a recent successful BegBlag?
1 Like
Question for anyone who knows - are each of the chunks for a given file given to a different set of nodes? Or do all chunks from a file go to the same set of nodes? Just wondering how far apart the data is initially spread out.
Yankees should not be allowed to vote . .
This is the best possible answer:)
1 Like
Just for a bit of a different view, I am running a node with Valgrind ‘Memcheck’ seeing as you aready have Heaptrack nodes.
2 Likes
Does that have the same constraint with respect to musl?
1 Like