I am getting repetitive here
Year of the testnets continues
Its good to see the testing of pricing beginning. This is a big incentive for ordinary folk to run a node.
9 Likes
Client download progress 896/981
Client download progress 928/981
Client download progress 960/981
Client download progress 981/981
Successfully got file L.Effondrement.S01E08.FiNAL.FRENCH.mkv!
Writing 501888232 bytes to "/home/ubuntu/.local/share/safe/client/L.Effondrement.S01E08.FiNAL.FRENCH.mkv"
8 Likes
Still, Rockers is failing to upload
safe files upload Rockers1978.mp4
Built with git version: aba95fb / main / aba95fb
Instantiating a SAFE client...
🔗 Connected to the Network
Loaded wallet from "/home/ubuntu/.local/share/safe/client/wallet" with balance Token(99999997492)
Preparing (chunking) files at 'Rockers1978.mp4'...
Making payment for 1212 Chunks that belong to 1 file/s.
No payment needed for 1212 records.
Successfully stored wallet with cached payment proofs, and new balance 99.999997492.
Successfully paid for storage and generated the proofs. They can now be sent to the storage nodes when uploading paid chunks.
Storing file 'Rockers1978.mp4' of 619794047 bytes (1212 chunk/s)..
Failed to store all chunks of file 'Rockers1978.mp4' to all nodes in the close group: Network Error Could not retrieve the record after storing it:
c57802acd316d142632536290e79d51b051f8d633d15343b48390c66038ad2e1.
Writing 63 bytes to "/home/ubuntu/.local/share/safe/client/uploaded_files/file_names_2023-08-15_00-06-38"
Is there an explanation why some uploads still fail? Shouldn’t that be a priority to solve?
2 Likes
Ok this is new to me:
safe files upload whale-chasers.JPG
Built with git version: aba95fb / main / aba95fb
Instantiating a SAFE client...
🔗 Connected to the Network
Loaded wallet from "/home/ubuntu/.local/share/safe/client/wallet" with balance Token(99999997492)
Preparing (chunking) files at 'whale-chasers.JPG'...
Making payment for 4 Chunks that belong to 1 file/s.
Error: Failed to send tokens due to Network Error Could not retrieve the record after storing it: b0e26f03d6125a5306b05c6a69676baa4b7f0f97be43b3cd40f26cf80f2758b9.
Location:
sn_cli/src/subcommands/wallet.rs:305:26
1 Like
Uploading says its working but it is painfully slow
~5 mins since I kicked this 107MB dir off and its not yet done 1MB
willie@gagarin:~$ time safe files upload /fgfs/Aircraft/C-17
Built with git version: aba95fb / main / aba95fb
Instantiating a SAFE client...
🔗 Connected to the Network Loaded wallet from "/home/willie/.local/share/safe/client/wallet" with balance Token(99999994346)
Preparing (chunking) files at '/fgfs/Aircraft/C-17'...
Making payment for 1722 Chunks that belong to 416 file/s.
Successfully made payment of 4928 for 1232 records. (At a cost per record of Token(4).)
Successfully stored wallet with cached payment proofs, and new balance 99.999989426.
Successfully paid for storage and generated the proofs. They can now be sent to the storage nodes when uploading paid chunks.
Storing file 'flare.png' of 627 bytes (1 chunk/s)..
Successfully stored 'flare.png' to 00bcd8292d1dd807869212712ace1f2f263c6f816e3d0ebee7c67e69e99f52b1
Storing file 'trailR.xml' of 2349 bytes (1 chunk/s)..
Successfully stored 'trailR.xml' to 00d35a926ae46a627db43a3fc9dc5bf190b1024bc1bacaffd24721d41e7d2503
Storing file 'vor.ac' of 28337 bytes (4 chunk/s)..
Successfully stored 'vor.ac' to 01527554bf3e476465182553bd59501ec03eddc8d72cf866fc058452c12b089f
Storing file 'flare-trail.xml' of 1886 bytes (1 chunk/s)..
Successfully stored 'flare-trail.xml' to 01ff416fb82c0df5d65b8d5fa8a80c02b0871b525cf172a5b127da27e03b3220
Storing file '.DS_Store' of 6148 bytes (4 chunk/s)..
Successfully stored '.DS_Store' to 0228659b16a1a528ae2a1ff0e59e4d958dfb64b2d7d3c309331ca6998b745201
Storing file 'digits.rgb' of 75476 bytes (4 chunk/s)..
Successfully stored 'digits.rgb' to 022b15ece96392475e08542a30cb87c64c79d7dc1bbe2d5338794d13211216c5
Storing file 'cdu.xml' of 85 bytes (1 chunk/s)..
Successfully stored 'cdu.xml' to 022f0ab8a7610c9dd88064e2b15285dd15d5923446753ee01840c50bf82b810f
Storing file 'light.nas' of 1014 bytes (1 chunk/s)..
Successfully stored 'light.nas' to 027a2ad131009abac1529ca3c19bfa1d36ab55a2d5e09518e6cfcc940b7bf7cb
Storing file 'altitude-1000.wav' of 10351 bytes (4 chunk/s)..
Successfully stored 'altitude-1000.wav' to 027ccbf55013fca777186bdc75c287502db9744d905caa200202f7a05179fac6
Storing file 'altitude-50.wav' of 5251 bytes (4 chunk/s)..
Successfully stored 'altitude-50.wav' to 032bd2691b56a3aab5878f19abff9b40f0a4e2855faa822b54eba7525ce52614
Storing file 'enav.nas' of 824 bytes (1 chunk/s)..
Successfully stored 'enav.nas' to 06880cb4f7210c30595307c4f1b76fd446eb990f068431812f3a4a2d74c78eaf
Storing file 'AFDS.nas' of 8625 bytes (4 chunk/s)..
Successfully stored 'AFDS.nas' to 07589ea748e0afd227b6aefdaff4ceb5c877cae0cea3b37de51613593bf1db66
Storing file 'Tex_0005_1.jpg' of 2014856 bytes (5 chunk/s)..
Successfully stored 'Tex_0005_1.jpg' to 07a23f2f4a64ffbef175561525bea0c09131de5ffe63cd52a1fc4d2b197f62c6
Storing file 'instrumentation.xml' of 2514 bytes (1 chunk/s)..
Successfully stored 'instrumentation.xml' to 07c70ab78dc2326b21be13f581a80ba12eaf59716dcfb7f6588045178754eaee
Storing file 'light.ac' of 4726 bytes (4 chunk/s)..
Update: Im only getting around 50kb/s upload to the network. My ISP speedcheck gives the expected 8Mb/s upload.
3 Likes
43m40s to upload 1.9 GB
But with an error, haven’t tried to download it again
$ time safe files upload ubuntu-22.04.2-live-server-amd64.iso
Built with git version: aba95fb / main / aba95fb
Instantiating a SAFE client...
🔗 Connected to the Network Loaded wallet from "/home/user/.local/share/safe/client/wallet" with balance Token(100000000000)
Preparing (chunking) files at 'ubuntu-22.04.2-live-server-amd64.iso'...
Making payment for 3861 Chunks that belong to 1 file/s.
Successfully made payment of 7722 for 3861 records. (At a cost per record of Token(2).)
Successfully stored wallet with cached payment proofs, and new balance 99.999992278.
Successfully paid for storage and generated the proofs. They can now be sent to the storage nodes when uploading paid chunks.
Storing file 'ubuntu-22.04.2-live-server-amd64.iso' of 1975971840 bytes (3861 chunk/s)..
Failed to store all chunks of file 'ubuntu-22.04.2-live-server-amd64.iso' to all nodes in the close group: Network Error Could not retrieve the record after storing it: 93070a07d4192893b41fc58dd1ac011562fd88f8da1ecdd718f18c7d968c92ff.
Writing 84 bytes to "/home/user/.local/share/safe/client/uploaded_files/file_names_2023-08-15_11-04-46"
real 43m40.876s
user 13m40.394s
sys 4m58.216s
5 Likes
Its been 8+ hours, no chunks downloaded or retrieved yet… same concern as prior testnet though I don’t think the full fix is in for this particular issue (i.e. possibly current node being detected as dead? by other nodes), though AutoNAT status shows as Public.
I am not sure if more verbose logging made it into this testnet for the issue above. I am not seeing any more unique types of messages that seem interesting to note or add on to the dashboard panel at this point. I will check back in 8 to 12 hours from now, 
.
7 Likes
Downloads also painfully slow
Storing file 'splash1.png' of 541986 bytes (4 chunk/s)..
Successfully stored 'splash1.png' to 5fb27cb5b2f28469bc120352901a7d1cd2fb02526982b0d71ac001676b71e050
willie@gagarin:~$ time safe files download splash1.png 5fb27cb5b2f28469bc120352901a7d1cd2fb02526982b0d71ac001676b71e050
Built with git version: aba95fb / main / aba95fb
Instantiating a SAFE client...
🔗 Connected to the Network Downloading file "splash1.png" with address 5fb27cb5b2f28469bc120352901a7d1cd2fb02526982b0d71ac001676b71e050
Client download progress 3/3
Successfully got file splash1.png!
Writing 541986 bytes to "/home/willie/.local/share/safe/client/splash1.png"
real 1m12.352s
user 0m0.688s
sys 0m0.391s
1 Like
I keep getting this error on uploads:
Error: Failed to send tokens due to Network Error Could not retrieve the record after storing it
I believe it started after I re-uploaded a (big) file originally uploaded with -n flag
Can someone reproduce?
This file downloads and works for me, but I got confused because I didn’t include the filename in the command.
I was trying to do
safe files download bc26e6cc55a715ed69bfafcedc64c0d356b5c09b7a37fd75509b60f52163b342
But needed to do
safe files download filename.mkv bc26e6cc55a715ed69bfafcedc64c0d356b5c09b7a37fd75509b60f52163b342
Is there metadata stored in bc26e6c... that can infer the filename and avoid clients specifying the filename in the command?
safe files download file.mkv bc26e6cc55a715ed69bfafcedc64c0d356b5c09b7a37fd75509b60f52163b342
Built with git version: aba95fb / main / aba95fb
Instantiating a SAFE client...
🔗 Connected to the Network Downloading file "file.mkv" with address bc26e6cc55a715ed69bfafcedc64c0d356b5c09b7a37fd75509b60f52163b342
Client download progress 32/768
Client download progress 64/768
Client download progress 96/768
Client download progress 128/768
Client download progress 160/768
Client download progress 192/768
Client download progress 224/768
Client download progress 256/768
Client download progress 288/768
Client download progress 320/768
Client download progress 352/768
Client download progress 384/768
Client download progress 416/768
Client download progress 448/768
Client download progress 480/768
Client download progress 512/768
Client download progress 544/768
Client download progress 576/768
Client download progress 608/768
Client download progress 640/768
Client download progress 672/768
Client download progress 704/768
Client download progress 736/768
Client download progress 768/768
Successfully got file file.mkv!
Writing 393170097 bytes to "/home/user/.local/share/safe/client/file.mkv"
Should the destination be safe/client/downloaded_files/ ?
3 Likes
Uploaded 550mb of PDF files (32) successfully from Indonesia (upload peaking at 8.7mb/s which is my max internet upload speed):
061f5a179e7978df1c97e970dc428d4d5569adc5fc5e4a06bc1bb3fcab233952
115e807ab932be234ae89b657622e0aeb1631ebaf5f97e6b5304dd582878742c
11b4def5a5aa02f46ece2dcaff4f7511fe7273e9674a2943e7d971f681431e6e
169b4c1dc83b247ac15a892562b84082fb75e22cd02f102703ca3a09b7f7d41f
1de673c338f33df668635ed3b586bb8c84382e29e32f17da15a685cfcf509545
24a71fd2fde9b251e09e1677913d4b36dcc3fe163667df83cf88814ae0e1d636
267b5c03e996d181580196e8474f7fe4748fdc80f1433ce158d33bfefff41d08
2e0164810c875441e5d3907774694ee1aa3c25df642f2d6ca4db6bec08458122
308ed89efecf83773f9a7957720eb13b1855bdb753bf821ee2e19bf814b90075
3d0098825190165a23f72d45425ed3c4085dd46e65cbef63c646174fc12e33f9
42dd1c216ce949bc164ad7ed94acb092e98ca790de965b1b14bfc1707855c324
5114e000a5bf0807885904bd55acf2ca534bc50a8292ca199c0fa0e696095df0
65603cd3027dd9ab509c895a426db977200d8386be9bbbb6c5c1af8d6dfe8189
7017802df8660dde129e0fbedc05d140ed4c7178d2e10bec270c06a8757faf33
727c67a15d08156f9effc9331b0062014e89756a9a6d176bf4ec179e0503d574
76fb8a36bbaef7cf1d49c322ed69cf0ac62a5846e777b9f1efc629cf8f85ac5b
7b77f956786f9424de25ddc84b6f463d2d96a366443f13346c35cefebe6e995b
83bda2cbe264d855a856d7207831ccb9c6e7e720d303d29949c6907a52eacbfb
ac0c951833d7538cee827322dfc70648bf8072c56fac178dc7d0a006f456aabc
adcf774633451e726c78a17ab34d073e7995741c2b86e0562883bfedfa79de91
b7603ec43e989bb36c04c10e1560b1815d49bd5de64dba959496008bf3ea4564
b7d72e75273bf37acf5b4dd3a4dd9af806e5badf98080cf0e001bf5d2f179403
bd82da09a1093f697e5880e0639bf1137d0c3115949d8c381c0622d240686cbb
bf52cd28c2170311d1847c4c83fa491773b42348e40c5793e3c9a2dbe7fdbdb4
c0fff88efb4a8f6fed2610c8f1ab561be2825284d5f604c538b3bef2b473e56a
c602f8cc0591baa8951267d705220eaf18cb8973d2213a6913efd8c40db5db1a
c893e50d225f599ecd2c6ed904e97552d10d1acd67337d3da3e709311032c8b3
c9412e6ae1c982f49d5dd8bbca345e521d226d2a2858140a4adb0d67b80d76f6
c9fc3b5b6f6a970f9c59822a52d4f15e96afbe00294e13b901234007684101c8
e4ebfe80bc4e2bb15747c850ff67e10a8b3165dd4593937d680fc194ab0562cb
e5a5be063cfa8808a77f91332f0c6f4468dafdaef6d88a9e0e4666c2bc2810da
f883199e059c1f704bc4141c3de7b6d7bc7ca43dab0c48f2f878b14c81d45565
7 Likes
First single file test a success!
safe files download ~/Southside.jpg 36a1834fa03c7f3b5c635e48ecb21da0c9ada28fc1380be9940be57f97eb94d2
3 Likes
Aye, very good.
2 Likes
oops!!
Storing file 'click.wav' of 616 bytes (1 chunk/s)..
Failed to store all chunks of file 'click.wav' to all nodes in the close group: Network Error Could not retrieve the record after storing it: c5e5470b7932f30f57aefb973ab86560cf28a0aa4e4f424859eed4e8d2a80620.
13 hours of uptime for my node → still empty record_store directory.
2 Likes
A few records here
43M /home/ubuntu/.local/share/safe/node/12D3KooWQXV7R7uxmohPVxHzrzUsmtkHTYELMbVgfw8mdN9L6Jv7/record_store
43M /home/ubuntu/.local/share/safe/node/12D3KooWQXV7R7uxmohPVxHzrzUsmtkHTYELMbVgfw8mdN9L6Jv7
33M /home/ubuntu/.local/share/safe/node/12D3KooWPQuzjVLkVnTcSimmCjDNUmkM3pVgtmShxJEMPtVASTAt/record_store
33M /home/ubuntu/.local/share/safe/node/12D3KooWPQuzjVLkVnTcSimmCjDNUmkM3pVgtmShxJEMPtVASTAt
41M /home/ubuntu/.local/share/safe/node/12D3KooWQ2aRGoePC3UbcmH4VpeDjAifCnUCTS3jWZVAzPhGwTCa/record_store
41M /home/ubuntu/.local/share/safe/node/12D3KooWQ2aRGoePC3UbcmH4VpeDjAifCnUCTS3jWZVAzPhGwTCa
27M /home/ubuntu/.local/share/safe/node/12D3KooWFc9VjuG7TEZy7RjfrQorMtJSpGeFgVFYqpLvUuQKrAjm/record_store
27M /home/ubuntu/.local/share/safe/node/12D3KooWFc9VjuG7TEZy7RjfrQorMtJSpGeFgVFYqpLvUuQKrAjm
56M /home/ubuntu/.local/share/safe/node/12D3KooWPJ4dE9eTVWfgh9vUFULWf24KDKUwZbMViWCg8AsGTRJY/record_store
56M /home/ubuntu/.local/share/safe/node/12D3KooWPJ4dE9eTVWfgh9vUFULWf24KDKUwZbMViWCg8AsGTRJY
4.0K /home/ubuntu/.local/share/safe/node/12D3KooWLjdVxuMQGJrQZLr2RJr3TvGk2ct1YwTkHBNRpoSF2dkY/record_store
16K /home/ubuntu/.local/share/safe/node/12D3KooWLjdVxuMQGJrQZLr2RJr3TvGk2ct1YwTkHBNRpoSF2dkY
53M /home/ubuntu/.local/share/safe/node/12D3KooWB2diFoeEwReNPgh2pMbvRi3mWgb4J3nNbjFC7ELye8rk/record_store
53M /home/ubuntu/.local/share/safe/node/12D3KooWB2diFoeEwReNPgh2pMbvRi3mWgb4J3nNbjFC7ELye8rk
45M /home/ubuntu/.local/share/safe/node/12D3KooWEEq2chDVFA3sLQGWGTtrczst3MZ1NDJdsQbAf4wCbUft/record_store
45M /home/ubuntu/.local/share/safe/node/12D3KooWEEq2chDVFA3sLQGWGTtrczst3MZ1NDJdsQbAf4wCbUft
4.0K /home/ubuntu/.local/share/safe/node/12D3KooWMYKqTCEcm4C37QVmn5UnMKNFW1agcuCbCCaCKgCnsoBa/record_store
16K /home/ubuntu/.local/share/safe/node/12D3KooWMYKqTCEcm4C37QVmn5UnMKNFW1agcuCbCCaCKgCnsoBa
4.0K /home/ubuntu/.local/share/safe/node/12D3KooWJogyxLVVUU99d4EwBUsqPe35h7ZaAw4VuWx8c3VYFJfr/record_store
16K /home/ubuntu/.local/share/safe/node/12D3KooWJogyxLVVUU99d4EwBUsqPe35h7ZaAw4VuWx8c3VYFJfr
62M /home/ubuntu/.local/share/safe/node/12D3KooWAHy4uH6s897ev7GvQ1xYYFZgivhhyZTcBjajSoEU9Nzt/record_store
62M /home/ubuntu/.local/share/safe/node/12D3KooWAHy4uH6s897ev7GvQ1xYYFZgivhhyZTcBjajSoEU9Nzt
46M /home/ubuntu/.local/share/safe/node/12D3KooWS3HgbAXMSsr25frXLCxAo7NqdgSYmvNBersSm2AodCRV/record_store
46M /home/ubuntu/.local/share/safe/node/12D3KooWS3HgbAXMSsr25frXLCxAo7NqdgSYmvNBersSm2AodCRV
36M /home/ubuntu/.local/share/safe/node/12D3KooWAhQrw7G6D2wM45u4SDVoGY912bLCTABbZBSWZhuz2D5x/record_store
36M /home/ubuntu/.local/share/safe/node/12D3KooWAhQrw7G6D2wM45u4SDVoGY912bLCTABbZBSWZhuz2D5x
34M /home/ubuntu/.local/share/safe/node/12D3KooWPF9vLzb1Xza19gBXi5Szrm5X952ZghDyJ2dRRCatFSD8/record_store
34M /home/ubuntu/.local/share/safe/node/12D3KooWPF9vLzb1Xza19gBXi5Szrm5X952ZghDyJ2dRRCatFSD8
25M /home/ubuntu/.local/share/safe/node/12D3KooWKjmfsyLZcwNuaXtqkr8u13z4T5WGUW4fEy7dRbvVQj7t/record_store
25M /home/ubuntu/.local/share/safe/node/12D3KooWKjmfsyLZcwNuaXtqkr8u13z4T5WGUW4fEy7dRbvVQj7t
5.5M /home/ubuntu/.local/share/safe/node/12D3KooWCZrehf9v1mszu9dMvLq8FU5Kmb98CBjhGwghAaG87nFM/record_store
5.5M /home/ubuntu/.local/share/safe/node/12D3KooWCZrehf9v1mszu9dMvLq8FU5Kmb98CBjhGwghAaG87nFM
62M /home/ubuntu/.local/share/safe/node/12D3KooWJ9hj2916NAbhAEENLjhwjo3YTbNtW5pBYQEAp9tg6nmJ/record_store
62M /home/ubuntu/.local/share/safe/node/12D3KooWJ9hj2916NAbhAEENLjhwjo3YTbNtW5pBYQEAp9tg6nmJ
44M /home/ubuntu/.local/share/safe/node/12D3KooWMHDSxHPW6sLSHF1byf7UfyKFzBms5CnZ2p3k9GgdUPCs/record_store
44M /home/ubuntu/.local/share/safe/node/12D3KooWMHDSxHPW6sLSHF1byf7UfyKFzBms5CnZ2p3k9GgdUPCs
26M /home/ubuntu/.local/share/safe/node/12D3KooWJsB9nThBNtJNxofFsHZePh5G7yttrxWMG39kHtBD6zmx/record_store
26M /home/ubuntu/.local/share/safe/node/12D3KooWJsB9nThBNtJNxofFsHZePh5G7yttrxWMG39kHtBD6zmx
631M /home/ubuntu/.local/share/safe/node
6 Likes
My folder upload download test has failed again - worse than in the previous test-net, with none of the (successfully?) uploaded files downloading.
The first upload attempt I did with the -n option and I received no errors for the 11 files. I then attempted to download and all files failed to download.
I then attempted to re-upload without the -n option … so far, 9/11 files and literally hours later, nothing has successfully verified.
These are all small pdf files - ranging from 27MB down to 208KB.
The error I get for each is “Failed to store all chunks of file ‘1.pdf’ to all nodes in the close group: Network Error Could not retrieve the record after storing it” – filename is obviously different, but otherwise the same
The first upload I did on this network also produced the ‘Failed to store all chunks of file ‘1.pdf’ to all nodes in the close group: Network Error Could not retrieve the record after storing it’ error. But I then downloaded it successfully. Admittedly it was a file of only a few bytes.
I think it’s a warning that it couldn’t say for sure that it had been uploaded.
I’ve yet to verify any of the 1MB files I’ve uploaded. Those seem to be uploading without any errors.
1 Like
I was able to upload and download a jpg file … so it has worked for me
Only guessing, but I have a low bandwidth connection and I’m in Australia, so perhaps something is timing out.
I’ve run this same test folder of 11 pdf’s multiple times, and in the first testnet 4? of the 11 files did get uploaded, but subsequently I couldn’t upload the rest after multiple re-tries. This testnet I haven’t been able to upload even one of the 11 test files it appears.
1 Like
Ah yes, should have mentioned in the OP, but no, no solid progress on that, there’s a bunch of debug behaviour we’ll need to add to track down the connectivity issue it seems.
Not at the moment, but could probably be added (or will be down the line if we have File wrapper data etc as in the olde net).
A few weeks ago @chriso pushed some changes to use a standardised file dirs on all systems. (XDG spec maybe?)
If folk are not seeing any records being added to their node, can you try starting a second one and seeing if that joins?
Logs for these failed nodes (or more specifically their PeerID, should allow us to check what the maidsafe nodes make of them).
Indeed, it doesn’t verify anything, so you’d get no errors.
it could be that one has run its course and there’s a bug causing a hang here instead of erroring out. Do you have client logs for this?
This testnet actually has droplets in 5 different locations. I do wonder if this is why many folk are experiencing slower startup eg.
In terms of maidsafe nodes, we’ve still 2001 up. Random sampling shows mem / cpu are fine, though I can see a few nodes with 0 records just now (others are averaging ~90-150 records). So I’ll be diving into them to see if there’s any more leads on the issues @vort and @shu are seeing.
I should also note, that the token price for me has increased to 4/record. So calculations are doing something there.
(It should also be noted that underpayment could be another reason that files are not being accepted, so we may need to tweak our client side price retrieval eg. If folk can let us know what they’re paying for uploads that would be handy! ie: Successfully made payment of 1336 for 334 records. (At a cost per record of Token(4).)
9 Likes