You are telling me?
I was quite enjoying the hours of scrolling digits…
Made a pretty picture on my System Monitor though…
Does this warning include the latest changes?
Give me a shout if you need a hand getting rid of any hash. Always happy to help.
EDIT:
Yep its like trying to drink from a fire-hose if you do safe files download
I broke it again…
but maybe cos I was a smartarse and moved the binaries to /usr/local/bin so I could do faucet claim-genesis
willie@gagarin:~/projects/maidsafe/safe_network$ faucet claim-genesis
Loading genesis...
Genesis wallet balance: 1288490188.500000000
Loading faucet...
Sending 1288490188.499500000 from genesis to faucet wallet..
The transfer was not successfully registered in the network: CouldNotSendTokens("Failed to verify transfer validity in the network Not enough close group nodes accepted the spend. Got 0, required: 5."). It will be retried later.
Faucet wallet balance: 1288490188.499500000
Waiting a short moment before verifying the transfer from genesis...
Verifying the transfer from genesis...
Could not verify the transfer from genesis: CouldNotVerifyTransfer("Failed to verify transfer validity in the network Not enough close group nodes returned the requested spend. Got 0, required: 5.")
But if you follow the ReadMe it works OK
willie@gagarin:~/projects/maidsafe/safe_network$ cargo run --bin faucet --release -- claim-genesis
Finished release [optimized] target(s) in 0.22s
Running `target/release/faucet claim-genesis`
Loading genesis...
Genesis wallet balance: 0.000462664
Loading faucet...
Faucet wallet balance: 1288490188.499500000
Get the wallet address
willie@gagarin:~$ safe wallet address
Instantiating a SAFE client...
Client connected to the Network
937f0991791ab822902b6dd31c8d704e77a0f182fd215c78b8d2e0d7713aee7ce1b150def84dbbbf67c0ca72adf52846
but again Not enough close group nodes accepted the spend. Got 0, required: 5.
willie@gagarin:~/projects/maidsafe/safe_network$ cargo run --bin faucet --release -- send 0.00026266 937f0991791ab822902b6dd31c8d704e77a0f182fd215c78b8d2e0d7713aee7ce1b150def84dbbbf67c0ca72adf52846
Finished release [optimized] target(s) in 0.20s
Running `target/release/faucet send 0.00026266 937f0991791ab822902b6dd31c8d704e77a0f182fd215c78b8d2e0d7713aee7ce1b150def84dbbbf67c0ca72adf52846`
Loading genesis...
Genesis wallet balance: 0.000462664
Loading faucet...
Faucet wallet balance: 1288490188.499500000
The transfer was not successfully registered in the network: CouldNotSendTokens("Failed to verify transfer validity in the network Not enough close group nodes accepted the spend. Got 0, required: 5."). It will be retried later.
a02cd909894c7fb2ab72609d836c636398a54e37edc4f589e98bcad2468f8ec933ff35b8da84e266e5c0ebb02a962c08b90c93710b21a827f85369b8f274cbbf3e47fe3292b8deb053df6b05318095efe1deaa06af6917e6c023b9ee093297a897cfc1125c069e5b01ccf59e9e0bdc818464f9704b134c0fc8eebe0db92ecc242db103f0b2b158d90639a0ab4019146b94e93aa8c8741080ec841002c1ba95da000000000000000000000000000000000000000000000000000000000000000073787e1c1a0a49a3a332480a6e8fd1f28b1c78ac2de5bf82c7a79c1480d3ee9e0cff888279adf4050ddaa1565e266a2f5d0e95295b8cb32d31ce73575aef1cd50131cb1a5febc905df80acacc79b170e1e2a2c15dbffe1751785bfe58af5c9272ce25543657ede5b9ef0ab48341f25dd07e0f55aa9d950088580230e7aed6636070ff00f90f088870279149c79d6b73e9b3ce003e2437fca96661a---> snipped DBC
Thanks @oetyng and all, having fun exploring whats new, what works, what doesn’t yet 
cut n paste the DBC data from the errors above to a file in ~/.safe/client/wallet/received_dbcs and you can finally see a non zero balance in your wallet 
willie@gagarin:~/.safe/client/wallet/received_dbcs$ safe wallet deposit
Instantiating a SAFE client...
Client connected to the Network
Reading deposited tokens from "i.dbc".
Deposited Token(18446731728030651616).
willie@gagarin:~/.safe/client/wallet/received_dbcs$ safe wallet balance
Instantiating a SAFE client...
Client connected to the Network
12345.678900000
willie@gagarin:~/.safe/client/wallet/received_dbcs$
50 node testnet
Download error
willie@gagarin:~/projects/maidsafe/safe_network$ safe files upload /fgfs/Scenery/Scotland/Orthophotos/w010n60/
Instantiating a SAFE client…
Client connected to the Network
Storing file “2925969.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(64db76(01100100)…)Storing file “2925976.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(01d67f(00000001)…)Storing file “2925987.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(fce7ab(11111100)…)Storing file “2925961.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(4c819a(01001100)…)Storing file “2925971.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(facc0e(11111010)…)Storing file “2925994.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(f28c64(11110010)…)Storing file “2925978.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(d4e408(11010100)…)Storing file “2925995.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(c51f4c(11000101)…)Storing file “2925955.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(2ede80(00101110)…)Storing file “2925963.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(47f0eb(01000111)…)Storing file “2925970.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(c22e96(11000010)…)Storing file “2925968.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(84514f(10000100)…)Storing file “2925954.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(e43007(11100100)…)Storing file “2925986.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(c60588(11000110)…)Storing file “2925979.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(18b655(00011000)…)Storing file “2925962.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(df9467(11011111)…)Storing file “2925985.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(2e30d9(00101110)…)Storing file “2925977.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(4fd01a(01001111)…)Storing file “2909571.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(f27dd6(11110010)…)Storing file “2942352.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(3983b3(00111001)…)Storing file “2942368.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(376e3d(00110111)…)Storing file “2942384.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(35b793(00110101)…)Storing file “2942376.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(98e2a2(10011000)…)Storing file “2942360.dds” of 8388736 bytes…Successfully stored file to ChunkAddress(1774ac(00010111)…)Writing 1232 bytes to "/home/willie/.safe/client/uploaded_files/file_names_2023-04-28_02-11-26"willie@gagarin:~/projects/maidsafe/safe_network$ safe files download
Instantiating a SAFE client…
Client connected to the Network
Loading file names from index doc "file_names_2023-04-28_01-51-05"Downloading file "file_names.txt"Did not get file “file_names.txt” from the network! Protocol error Provider record was not found locally.Downloading file "configs"Did not get file “configs” from the network! Protocol error Provider record was not found locally.Downloading file "iredmail-configs"Did not get file “iredmail-configs” from the network! Protocol error Provider record was not found locally.Downloading file "catalog.tests.bom"Did not get file “catalog.tests.bom” from the network! Protocol error Provider record was not found locally.Downloading file "multinode.tests.bom"Did not get file “multinode.tests.bom” from the network! Protocol error Provider record was not found locally.Downloading file "catalog.tests.bom"Did not get file “catalog.tests.bom” from the network! Protocol error Provider record was not found locally.Downloading file "scotcoin.tests.bom"Did not get file “scotcoin.tests.bom” from the network! Protocol error Provider record was not found locally.Downloading file "catalog.bom"Did not get file “catalog.bom” from the network! Protocol error Provider record was not found locally.Downloading file "scotcoin.bom"Did not get file “scotcoin.bom” from the network! Protocol error Provider record was not found locally.Downloading file "scotcoin-standalone.yaml"Did not get file “scotcoin-standalone.yaml” from the network! Protocol error Provider record was not found locally.Downloading file "amazon.bom"Did not get file “amazon.bom” from the network! Protocol error Provider record was not found locally.Downloading file "scotcoin.yaml"Did not get file “scotcoin.yaml” from the network! Protocol error Provider record was not found locally.Downloading file "architecture.md"Did not get file “architecture.md” from the network! Protocol error Provider record was not found locally.Downloading file "identity.png"Did not get file “identity.png” from the network! Protocol error Provider record was not found locally.Downloading file "deployment.md"Did not get file “deployment.md” from the network! Protocol error Provider record was not found locally.Downloading file "token.md"Did not get file “token.md” from the network! Protocol error Provider record was not found locally.Downloading file "components.md"Did not get file “components.md” from the network! Protocol error Provider record was not found locally.Downloading file "identity.md"Did not get file “identity.md” from the network! Protocol error Provider record was not found locally.Downloading file "components.png"Did not get file “components.png” from the network! Protocol error Provider record was not found locally.Downloading file "contracts.md"Did not get file “contracts.md” from the network! Protocol error Provider record was not found locally.Downloading file "architecture.png"Did not get file “architecture.png” from the network! Protocol error Provider record was not found locally.Downloading file "ready-for.sh"Did not get file “ready-for.sh” from the network! Protocol error Provider record was not found locally.Downloading file "HEAD"Did not get file “HEAD” from the network! Protocol error Provider record was not found locally.Downloading file "HEAD"Did not get file “HEAD” from the network! Protocol error Provider record was not found locally.Downloading file "master"Did not get file “master” from the network! Protocol error Provider record was not found locally.Downloading file "description"Did not get file “description” from the network! Protocol error Provider record was not found locally.Downloading file "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx"Did not get file “pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx” from the network! Protocol error Provider record was not found locally.Downloading file "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack"Did not get file “pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack” from the network! Protocol error Provider record was not found locally.Downloading file "index"Did not get file “index” from the network! Protocol error Provider record was not found locally.Downloading file "config"Did not get file “config” from the network! Protocol error Provider record was not found locally.Downloading file "HEAD"Did not get file “HEAD” from the network! Protocol error Provider record was not found locally.Downloading file "packed-refs"Did not get file “packed-refs” from the network! Protocol error Provider record was not found locally.Downloading file "applypatch-msg.sample"Did not get file “applypatch-msg.sample” from the network! Protocol error Provider record was not found locally.Downloading file "pre-rebase.sample"Did not get file “pre-rebase.sample” from the network! Protocol error Provider record was not found locally.Downloading file "fsmonitor-watchman.sample"Did not get file “fsmonitor-watchman.sample” from the network! Protocol error Provider record was not found locally.Downloading file "pre-receive.sample"Did not get file “pre-receive.sample” from the network! Protocol error Provider record was not found locally.Downloading file "update.sample"Did not get file “update.sample” from the network! Protocol error Provider record was not found locally.Downloading file "prepare-commit-msg.sample"Did not get file “prepare-commit-msg.sample” from the network! Protocol error Provider record was not found locally.Downloading file "pre-push.sample"Did not get file “pre-push.sample” from the network! Protocol error Provider record was not found locally.Downloading file "commit-msg.sample"Did not get file “commit-msg.sample” from the network! Protocol error Provider record was not found locally.Downloading file "pre-applypatch.sample"Did not get file “pre-applypatch.sample” from the network! Protocol error Provider record was not found locally.Downloading file "post-update.sample"Did not get file “post-update.sample” from the network! Protocol error Provider record was not found locally.Downloading file "pre-commit.sample"Did not get file “pre-commit.sample” from the network! Protocol error Provider record was not found locally.Downloading file "exclude"Did not get file “exclude” from the network! Protocol error Provider record was not found locally.Downloading file "HEAD"Did not get file “HEAD” from the network! Protocol error Provider record was not found locally.Downloading file "master"Did not get file “master” from the network! Protocol error Provider record was not found locally.Downloading file "Dockerfile"Did not get file “Dockerfile” from the network! Protocol error Provider record was not found locally.Downloading file "build.sh"Did not get file “build.sh” from the network! Protocol error Provider record was not found locally.Downloading file "scotcoin.png"Did not get file “scotcoin.png” from the network! Protocol error Provider record was not found locally.Downloading file ".gitignore"Did not get file “.gitignore” from the network! Protocol error Provider record was not found locally.Downloading file "README.md"Did not get file “README.md” from the network! Protocol error Provider record was not found locally.Downloading file "pom.xml"Did not get file “pom.xml” from the network! Protocol error Provider record was not found locally.Downloading file "scotcoin.bom"Did not get file “scotcoin.bom” from the network! Protocol error Provider record was not found locally.Loading file names from index doc "file_names_2023-04-28_02-11-26"Downloading file "2925969.dds"Successfully got file 2925969.dds!Writing 8388736 bytes to "/home/willie/.safe/client/downloaded_files/2925969.dds"Downloading file "2925976.dds"Successfully got file 2925976.dds!Writing 8388736 bytes to "/home/willie/.safe/client/downloaded_files/2925976.dds"Downloading file "2925987.dds"Successfully got file 2925987.dds!Writing 8388736 bytes to "/home/willie/.safe/client/downloaded_files/2925987.dds"Downloading file "2925961.dds"Successfully got file 2925961.dds!Writing 8388736 bytes to "/home/willie/.safe/client/downloaded_files/2925961.dds"Downloading file "2925971.dds"Successfully got file 2925971.dds!Writing 8388736 bytes to "/home/willie/.safe/client/downloaded_files/2925971.dds"Downloading file "2925994.dds"Successfully got file 2925994.dds!Writing 8388736 bytes to "/home/willie/.safe/client/downloaded_files/2925994.dds"Downloading file "2925978.dds"Successfully got file 2925978.dds!Writing 8388736 bytes to "/home/willie/.safe/client/downloaded_files/2925978.dds"Downloading file "2925995.dds"Successfully got file 2925995.dds!Writing 8388736 bytes to “/home/willie/.safe/client/downloaded_files/2925995.dds”
I’ll zip up the logs and present this better - no linebreaks makes it difficult to see right now
I’m waiting for this test: reproduce node many to many msg fail by oetyng · Pull Request #206 · maidsafe/safe_network · GitHub before I poke much harder.
And #208 will make the output prettier. <— It did
I poked gently even though #206 is not merged yet
Registers work fine - All as expected 
Wallets can be made to “work” with a bit of cut n paste of DBC data into a file in ~/safe/client/wallet.received_dbcs 
willie@gagarin:~/projects/maidsafe/safe_network$ safe wallet balance
Instantiating a SAFE client...
Client connected to the Network
123.456789000
Uploading files is a bit of a mixed bag 
willie@gagarin:~/.safe/client/wallet/received_dbcs$ safe files upload ~/trecem/
Instantiating a SAFE client...
Client connected to the Network
Storing file "file_names.txt" of 1704 bytes..
Did not store file "file_names.txt" to all nodes in the close group! Network Error Outbound Error.
Storing file "configs" of 283 bytes..
Successfully stored file to ChunkAddress(6985cb(01101001)..)
Storing file "iredmail-configs" of 7506 bytes..
Did not store file "iredmail-configs" to all nodes in the close group! Network Error Outbound Error.
Storing file "catalog.tests.bom" of 1591 bytes..
Successfully stored file to ChunkAddress(56e21f(01010110)..)
Storing file "multinode.tests.bom" of 1611 bytes..
Successfully stored file to ChunkAddress(726342(01110010)..)
Storing file "catalog.tests.bom" of 383 bytes..
Did not store file "catalog.tests.bom" to all nodes in the close group! Network Error Outbound Error.
Storing file "scotcoin.tests.bom" of 240 bytes..
Successfully stored file to ChunkAddress(033efb(00000011)..)
Storing file "catalog.bom" of 212 bytes..
Did not store file "catalog.bom" to all nodes in the close group! Network Error Outbound Error.
Storing file "scotcoin.bom" of 5936 bytes..
Did not store file "scotcoin.bom" to all nodes in the close group! Network Error Outbound Error.
Storing file "scotcoin-standalone.yaml" of 532 bytes..
Successfully stored file to ChunkAddress(c37a62(11000011)..)
Storing file "amazon.bom" of 1544 bytes..
Successfully stored file to ChunkAddress(e482e4(11100100)..)
Storing file "scotcoin.yaml" of 511 bytes..
Did not store file "scotcoin.yaml" to all nodes in the close group! Network Error Outbound Error.
Storing file "architecture.md" of 497 bytes..
Successfully stored file to ChunkAddress(fbd49b(11111011)..)
Storing file "identity.png" of 819853 bytes..
Did not store file "identity.png" to all nodes in the close group! Network Error Outbound Error.
Storing file "deployment.md" of 73 bytes..
Did not store file "deployment.md" to all nodes in the close group! Network Error Outbound Error.
Storing file "token.md" of 9701 bytes..
Did not store file "token.md" to all nodes in the close group! Network Error Outbound Error.
Storing file "components.md" of 375 bytes..
Did not store file "components.md" to all nodes in the close group! Network Error Outbound Error.
Storing file "identity.md" of 4028 bytes..
Did not store file "identity.md" to all nodes in the close group! Network Error Outbound Error.
Storing file "components.png" of 1394174 bytes..
Did not store file "components.png" to all nodes in the close group! Network Error Outbound Error.
Storing file "contracts.md" of 3048 bytes..
Successfully stored file to ChunkAddress(55ae37(01010101)..)
Storing file "architecture.png" of 1155303 bytes..
Did not store file "architecture.png" to all nodes in the close group! Network Error Outbound Error.
Storing file "ready-for.sh" of 181847 bytes..
Did not store file "ready-for.sh" to all nodes in the close group! Network Error Outbound Error.
Storing file "HEAD" of 185 bytes..
Did not store file "HEAD" to all nodes in the close group! Network Error Outbound Error.
Storing file "HEAD" of 185 bytes..
Did not store file "HEAD" to all nodes in the close group! Network Error Outbound Error.
Storing file "master" of 185 bytes..
Did not store file "master" to all nodes in the close group! Network Error Outbound Error.
Storing file "description" of 73 bytes..
Did not store file "description" to all nodes in the close group! Network Error Outbound Error.
Storing file "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx" of 5328 bytes..
Did not store file "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx" to all nodes in the close group! Network Error Outbound Error.
Storing file "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" of 4345995 bytes..
Did not store file "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" to all nodes in the close group! Network Error Outbound Error.
Storing file "index" of 2503 bytes..
Did not store file "index" to all nodes in the close group! Network Error Outbound Error.
Storing file "config" of 271 bytes..
Successfully stored file to ChunkAddress(f44a8b(11110100)..)
Storing file "HEAD" of 23 bytes..
Did not store file "HEAD" to all nodes in the close group! Network Error Outbound Error.
Storing file "packed-refs" of 188 bytes..
Successfully stored file to ChunkAddress(2b269f(00101011)..)
Storing file "applypatch-msg.sample" of 478 bytes..
Successfully stored file to ChunkAddress(9c3f48(10011100)..)
Storing file "pre-rebase.sample" of 4898 bytes..
Did not store file "pre-rebase.sample" to all nodes in the close group! Network Error Outbound Error.
Storing file "fsmonitor-watchman.sample" of 3327 bytes..
Did not store file "fsmonitor-watchman.sample" to all nodes in the close group! Network Error Outbound Error.
Storing file "pre-receive.sample" of 544 bytes..
Successfully stored file to ChunkAddress(676116(01100111)..)
Storing file "update.sample" of 3610 bytes..
Did not store file "update.sample" to all nodes in the close group! Network Error Outbound Error.
Storing file "prepare-commit-msg.sample" of 1492 bytes..
Successfully stored file to ChunkAddress(50fa54(01010000)..)
Storing file "pre-push.sample" of 1348 bytes..
Successfully stored file to ChunkAddress(a53573(10100101)..)
Storing file "commit-msg.sample" of 896 bytes..
Did not store file "commit-msg.sample" to all nodes in the close group! Network Error Outbound Error.
Storing file "pre-applypatch.sample" of 424 bytes..
Did not store file "pre-applypatch.sample" to all nodes in the close group! Network Error Outbound Error.
Storing file "post-update.sample" of 189 bytes..
Did not store file "post-update.sample" to all nodes in the close group! Network Error Outbound Error.
Storing file "pre-commit.sample" of 1642 bytes..
Did not store file "pre-commit.sample" to all nodes in the close group! Network Error Outbound Error.
Storing file "exclude" of 240 bytes..
Did not store file "exclude" to all nodes in the close group! Network Error Outbound Error.
Storing file "HEAD" of 32 bytes..
Successfully stored file to ChunkAddress(faff6f(11111010)..)
Storing file "master" of 41 bytes..
Successfully stored file to ChunkAddress(27912c(00100111)..)
Storing file "Dockerfile" of 570 bytes..
Did not store file "Dockerfile" to all nodes in the close group! Network Error Outbound Error.
Storing file "build.sh" of 1752 bytes..
Successfully stored file to ChunkAddress(ffa702(11111111)..)
Storing file "scotcoin.png" of 4538 bytes..
Did not store file "scotcoin.png" to all nodes in the close group! Network Error Outbound Error.
Storing file ".gitignore" of 22 bytes..
Did not store file ".gitignore" to all nodes in the close group! Network Error Outbound Error.
Storing file "README.md" of 478 bytes..
Successfully stored file to ChunkAddress(6b105b(01101011)..)
Storing file "pom.xml" of 5091 bytes..
Did not store file "pom.xml" to all nodes in the close group! Network Error Outbound Error.
Storing file "scotcoin.bom" of 2226 bytes..
Successfully stored file to ChunkAddress(2666dd(00100110)..)
Writing 1025 bytes to "/home/willie/.safe/client/uploaded_files/file_names_2023-04-28_21-27-45"
@oetyng Do you want the logs for this or do you have plenty of these errors yourself?
Those file storage errors are a bit new actually, looks like a regression. You didn’t have this before, right? (I know I didn’t, right after file system storage was in.)
I don’t know if it’s from PR 179 or perhaps PR 182.
I’m doing a bit less work this weekend I think, but maybe I’ll get around to looking at where that was introduced. (I’ll be able to generate those logs, but thanks anyway!)
It was not at PR #179.
Although an interesting find is that the load from nodes was mostly around 88-95% when the .git folder of the repo was uploaded. The duration was ~2min 20s.
Before that PR, the load from nodes was mostly around 20-25% from same upload. The duration was ~1min 50s.
So that’s a perf regression in PR #179. >400% higher CPU usage, at >27% longer time.
The inmem kad storage, or our usage of it, performs quite a lot worse than our own file storage.
165MB
1507 files
266 folders
Okay, that’s for that comparison. Moving on to find where the file storage regression occurred.
I reckon that is a reason to go full file storage. It makes sense, actually. Thanks Ed @oetyng again we show do the whole thing as it’s gonna be and we see better results. The mem was a decent stab at a simpler testnet but looks like our own storage is just more performant.
PR #182 is clear as well wrt to those errors.
Could you try this a few times more?
I can’t reproduce it on main.
(There seems to be some issue with uploading one of the larger files of 9.67 MB in that dir though…)
Ok I will do some more uploading later.
Iirc, larger files were failing but that needs cònfirmed
That’s consistent with this:
OK back in the house now…
Last night I tried to download as well. Most of the files that failed to upload were 8MB, however ther were other failures too.
These smaller files were up and downloaded OK but a couple of larger files succeeded as well
willie@gagarin:~/projects/maidsafe/terraform-testnet-infra$ safe files download
Instantiating a SAFE client...
Client connected to the Network
Loading file names from index doc "file_names_2023-04-28_21-27-45"
Downloading file "configs"
Successfully got file configs!
Writing 283 bytes to "/home/willie/.safe/client/downloaded_files/configs"
Downloading file "catalog.tests.bom"
Successfully got file catalog.tests.bom!
Writing 1591 bytes to "/home/willie/.safe/client/downloaded_files/catalog.tests.bom"
Downloading file "multinode.tests.bom"
Successfully got file multinode.tests.bom!
Writing 1611 bytes to "/home/willie/.safe/client/downloaded_files/multinode.tests.bom"
Downloading file "scotcoin.tests.bom"
Successfully got file scotcoin.tests.bom!
Writing 240 bytes to "/home/willie/.safe/client/downloaded_files/scotcoin.tests.bom"
Downloading file "scotcoin-standalone.yaml"
Successfully got file scotcoin-standalone.yaml!
Writing 532 bytes to "/home/willie/.safe/client/downloaded_files/scotcoin-standalone.yaml"
Downloading file "amazon.bom"
Successfully got file amazon.bom!
Writing 1544 bytes to "/home/willie/.safe/client/downloaded_files/amazon.bom"
Downloading file "architecture.md"
Successfully got file architecture.md!
Writing 497 bytes to "/home/willie/.safe/client/downloaded_files/architecture.md"
Downloading file "contracts.md"
Successfully got file contracts.md!
Writing 3048 bytes to "/home/willie/.safe/client/downloaded_files/contracts.md"
Downloading file "config"
Successfully got file config!
Writing 271 bytes to "/home/willie/.safe/client/downloaded_files/config"
Downloading file "packed-refs"
Successfully got file packed-refs!
Writing 188 bytes to "/home/willie/.safe/client/downloaded_files/packed-refs"
Downloading file "applypatch-msg.sample"
Successfully got file applypatch-msg.sample!
Writing 478 bytes to "/home/willie/.safe/client/downloaded_files/applypatch-msg.sample"
Downloading file "pre-receive.sample"
Successfully got file pre-receive.sample!
Writing 544 bytes to "/home/willie/.safe/client/downloaded_files/pre-receive.sample"
Downloading file "prepare-commit-msg.sample"
Successfully got file prepare-commit-msg.sample!
Writing 1492 bytes to "/home/willie/.safe/client/downloaded_files/prepare-commit-msg.sample"
Downloading file "pre-push.sample"
Successfully got file pre-push.sample!
Writing 1348 bytes to "/home/willie/.safe/client/downloaded_files/pre-push.sample"
Downloading file "HEAD"
Successfully got file HEAD!
Writing 32 bytes to "/home/willie/.safe/client/downloaded_files/HEAD"
Downloading file "master"
Successfully got file master!
Writing 41 bytes to "/home/willie/.safe/client/downloaded_files/master"
Downloading file "build.sh"
Successfully got file build.sh!
Writing 1752 bytes to "/home/willie/.safe/client/downloaded_files/build.sh"
Downloading file "README.md"
Successfully got file README.md!
Writing 478 bytes to "/home/willie/.safe/client/downloaded_files/README.md"
Downloading file "scotcoin.bom"
Successfully got file scotcoin.bom!
Writing 2226 bytes to "/home/willie/.safe/client/downloaded_files/scotcoin.bom"
Loading file names from index doc "file_names_2023-04-28_17-29-22"
Downloading file "file_names.txt"
Successfully got file file_names.txt!
Writing 1704 bytes to "/home/willie/.safe/client/downloaded_files/file_names.txt"
Downloading file "configs"
Successfully got file configs!
Writing 283 bytes to "/home/willie/.safe/client/downloaded_files/configs"
Downloading file "iredmail-configs"
Successfully got file iredmail-configs!
Writing 7506 bytes to "/home/willie/.safe/client/downloaded_files/iredmail-configs"
Downloading file "catalog.tests.bom"
Successfully got file catalog.tests.bom!
Writing 1591 bytes to "/home/willie/.safe/client/downloaded_files/catalog.tests.bom"
Downloading file "multinode.tests.bom"
Successfully got file multinode.tests.bom!
Writing 1611 bytes to "/home/willie/.safe/client/downloaded_files/multinode.tests.bom"
Downloading file "catalog.tests.bom"
Successfully got file catalog.tests.bom!
Writing 383 bytes to "/home/willie/.safe/client/downloaded_files/catalog.tests.bom"
Downloading file "scotcoin.tests.bom"
Successfully got file scotcoin.tests.bom!
Writing 240 bytes to "/home/willie/.safe/client/downloaded_files/scotcoin.tests.bom"
Downloading file "catalog.bom"
Successfully got file catalog.bom!
Writing 212 bytes to "/home/willie/.safe/client/downloaded_files/catalog.bom"
Downloading file "scotcoin.bom"
Successfully got file scotcoin.bom!
Writing 5936 bytes to "/home/willie/.safe/client/downloaded_files/scotcoin.bom"
Downloading file "scotcoin-standalone.yaml"
Successfully got file scotcoin-standalone.yaml!
Writing 532 bytes to "/home/willie/.safe/client/downloaded_files/scotcoin-standalone.yaml"
Downloading file "amazon.bom"
Successfully got file amazon.bom!
Writing 1544 bytes to "/home/willie/.safe/client/downloaded_files/amazon.bom"
Downloading file "scotcoin.yaml"
Successfully got file scotcoin.yaml!
Writing 511 bytes to "/home/willie/.safe/client/downloaded_files/scotcoin.yaml"
Downloading file "architecture.md"
Successfully got file architecture.md!
Writing 497 bytes to "/home/willie/.safe/client/downloaded_files/architecture.md"
Downloading file "identity.png"
Successfully got file identity.png!
Writing 819853 bytes to "/home/willie/.safe/client/downloaded_files/identity.png"
Downloading file "deployment.md"
Successfully got file deployment.md!
Writing 73 bytes to "/home/willie/.safe/client/downloaded_files/deployment.md"
Downloading file "token.md"
Successfully got file token.md!
Writing 9701 bytes to "/home/willie/.safe/client/downloaded_files/token.md"
Downloading file "components.md"
Successfully got file components.md!
Writing 375 bytes to "/home/willie/.safe/client/downloaded_files/components.md"
Downloading file "identity.md"
Successfully got file identity.md!
Writing 4028 bytes to "/home/willie/.safe/client/downloaded_files/identity.md"
Downloading file "components.png"
Successfully got file components.png!
Writing 1394174 bytes to "/home/willie/.safe/client/downloaded_files/components.png"
Downloading file "contracts.md"
Successfully got file contracts.md!
Writing 3048 bytes to "/home/willie/.safe/client/downloaded_files/contracts.md"
Downloading file "architecture.png"
Successfully got file architecture.png!
Writing 1155303 bytes to "/home/willie/.safe/client/downloaded_files/architecture.png"
Downloading file "ready-for.sh"
Successfully got file ready-for.sh!
Writing 181847 bytes to "/home/willie/.safe/client/downloaded_files/ready-for.sh"
Downloading file "HEAD"
Successfully got file HEAD!
Writing 185 bytes to "/home/willie/.safe/client/downloaded_files/HEAD"
Downloading file "HEAD"
Successfully got file HEAD!
Writing 185 bytes to "/home/willie/.safe/client/downloaded_files/HEAD"
Downloading file "master"
Successfully got file master!
Writing 185 bytes to "/home/willie/.safe/client/downloaded_files/master"
Downloading file "description"
Successfully got file description!
Writing 73 bytes to "/home/willie/.safe/client/downloaded_files/description"
Downloading file "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx"
Successfully got file pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx!
Writing 5328 bytes to "/home/willie/.safe/client/downloaded_files/pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx"
Downloading file "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack"
Did not get file "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" from the network! Protocol error Provider record was not found locally.
Downloading file "index"
Successfully got file index!
Writing 2503 bytes to "/home/willie/.safe/client/downloaded_files/index"
Downloading file "config"
Successfully got file config!
Writing 271 bytes to "/home/willie/.safe/client/downloaded_files/config"
Downloading file "HEAD"
Successfully got file HEAD!
Writing 23 bytes to "/home/willie/.safe/client/downloaded_files/HEAD"
Downloading file "packed-refs"
Successfully got file packed-refs!
Writing 188 bytes to "/home/willie/.safe/client/downloaded_files/packed-refs"
Downloading file "applypatch-msg.sample"
Successfully got file applypatch-msg.sample!
Writing 478 bytes to "/home/willie/.safe/client/downloaded_files/applypatch-msg.sample"
Downloading file "pre-rebase.sample"
Successfully got file pre-rebase.sample!
Writing 4898 bytes to "/home/willie/.safe/client/downloaded_files/pre-rebase.sample"
Downloading file "fsmonitor-watchman.sample"
Successfully got file fsmonitor-watchman.sample!
Writing 3327 bytes to "/home/willie/.safe/client/downloaded_files/fsmonitor-watchman.sample"
Downloading file "pre-receive.sample"
Successfully got file pre-receive.sample!
Writing 544 bytes to "/home/willie/.safe/client/downloaded_files/pre-receive.sample"
Downloading file "update.sample"
Successfully got file update.sample!
Writing 3610 bytes to "/home/willie/.safe/client/downloaded_files/update.sample"
Downloading file "prepare-commit-msg.sample"
Successfully got file prepare-commit-msg.sample!
Writing 1492 bytes to "/home/willie/.safe/client/downloaded_files/prepare-commit-msg.sample"
Downloading file "pre-push.sample"
Successfully got file pre-push.sample!
Writing 1348 bytes to "/home/willie/.safe/client/downloaded_files/pre-push.sample"
Downloading file "commit-msg.sample"
Successfully got file commit-msg.sample!
Writing 896 bytes to "/home/willie/.safe/client/downloaded_files/commit-msg.sample"
Downloading file "pre-applypatch.sample"
Successfully got file pre-applypatch.sample!
Writing 424 bytes to "/home/willie/.safe/client/downloaded_files/pre-applypatch.sample"
Downloading file "post-update.sample"
Successfully got file post-update.sample!
Writing 189 bytes to "/home/willie/.safe/client/downloaded_files/post-update.sample"
Downloading file "pre-commit.sample"
Successfully got file pre-commit.sample!
Writing 1642 bytes to "/home/willie/.safe/client/downloaded_files/pre-commit.sample"
Downloading file "exclude"
Successfully got file exclude!
Writing 240 bytes to "/home/willie/.safe/client/downloaded_files/exclude"
Downloading file "HEAD"
Successfully got file HEAD!
Writing 32 bytes to "/home/willie/.safe/client/downloaded_files/HEAD"
Downloading file "master"
Successfully got file master!
Writing 41 bytes to "/home/willie/.safe/client/downloaded_files/master"
Downloading file "Dockerfile"
Successfully got file Dockerfile!
Writing 570 bytes to "/home/willie/.safe/client/downloaded_files/Dockerfile"
Downloading file "build.sh"
Successfully got file build.sh!
Writing 1752 bytes to "/home/willie/.safe/client/downloaded_files/build.sh"
Downloading file "scotcoin.png"
Successfully got file scotcoin.png!
Writing 4538 bytes to "/home/willie/.safe/client/downloaded_files/scotcoin.png"
Downloading file ".gitignore"
Successfully got file .gitignore!
Writing 22 bytes to "/home/willie/.safe/client/downloaded_files/.gitignore"
Downloading file "README.md"
Successfully got file README.md!
Writing 478 bytes to "/home/willie/.safe/client/downloaded_files/README.md"
Downloading file "pom.xml"
Successfully got file pom.xml!
Writing 5091 bytes to "/home/willie/.safe/client/downloaded_files/pom.xml"
Downloading file "scotcoin.bom"
Successfully got file scotcoin.bom!
Writing 2226 bytes to "/home/willie/.safe/client/downloaded_files/scotcoin.bom"
Loading file names from index doc "file_names_2023-04-28_21-13-23"
No files to download!
I’ll grab some lunch then try more uploads.
And then my GPU locked up…
So after rebooting I ran a standard test net as in the Readme and stored 27 ~8MB files just fine. Then downloaded with no errors…
===================================================
Still seeing token transfer errors as before. Note that the transfer from genesis to faucet seems to have worked despit the error shown
willie@gagarin:~/projects/maidsafe/safe_network$ cargo run --bin faucet --release -- claim-genesis
Finished release [optimized] target(s) in 0.34s
Running `target/release/faucet claim-genesis`
Loading genesis...
Genesis wallet balance: 1288490188.500000000
Loading faucet...
Sending 1288490188.499500000 from genesis to faucet wallet..
The transfer was not successfully registered in the network: CouldNotSendTokens("Failed to verify transfer validity in the network Not enough close group nodes accepted the spend. Got 0, required: 5."). It will be retried later.
Faucet wallet balance: 1288490188.499500000
Waiting a short moment before verifying the transfer from genesis...
Verifying the transfer from genesis...
Could not verify the transfer from genesis: CouldNotVerifyTransfer("Failed to verify transfer validity in the network Not enough close group nodes returned the requested spend. Got 0, required: 5.")
willie@gagarin:~/projects/maidsafe/safe_network$ cargo run --bin safe --release -- wallet address
Finished release [optimized] target(s) in 0.25s
Running `target/release/safe wallet address`
Instantiating a SAFE client...
Client connected to the Network
890c8c5083cc3d446d132b139b33f0991b1fcfe5691a534439316785c62f464d7faf0a01aba9f416e285e1e47ffa0170
willie@gagarin:~/projects/maidsafe/safe_network$ cargo run --bin faucet --release -- send 987.654321 890c8c5083cc3d446d132b139b33f0991b1fcfe5691a534439316785c62f464d7faf0a01aba9f416e285e1e47ffa0170
Finished release [optimized] target(s) in 0.93s
Running `target/release/faucet send 987.654321 890c8c5083cc3d446d132b139b33f0991b1fcfe5691a534439316785c62f464d7faf0a01aba9f416e285e1e47ffa0170`
Loading genesis...
Genesis wallet balance: 0.000462664
Loading faucet...
Faucet wallet balance: 1288490188.499500000
thread 'main' panicked at 'Tokens shall be successfully sent.: CreateTransfer(NotEnoughBalance("0.000000000"))', /home/willie/projects/maidsafe/safe_network/safenode/src/domain/dbc_genesis.rs:91:10
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
willie@gagarin:~/projects/maidsafe/safe_network$
The CPU then goes mental…
and then a timeout if I try to create a register
==================================
restart the testnet and try to store larger files
chews all my memory and cripples this box
This much is true
No file smaller than 188 bytes was stored nor any larger than 3048.
Failures occurred at all file sizes
CSV at filename size messageHEAD 23 Did not store file "HEAD" to all nodes in - Pastebin.com
File upload/downloads work well today for file sizes up to 9Mb each
Token transfer still returns the same error
willie@gagarin:~/projects/maidsafe/safe_network$ cargo run --bin faucet --release -- send 12121212.12121212 ace5b16a2d26e670bb0edfe77550d171c25fd06f8b4e1f270b7399989dd030affe385d4e7cc59928a6a6650344591acf
Finished release [optimized] target(s) in 0.23s
Running `target/release/faucet send 12121212.12121212 ace5b16a2d26e670bb0edfe77550d171c25fd06f8b4e1f270b7399989dd030affe385d4e7cc59928a6a6650344591acf`
Loading genesis...
Genesis wallet balance: 0.000462664
Loading faucet...
Faucet wallet balance: 1288490188.499500000
The transfer was not successfully registered in the network: CouldNotSendTokens("Failed to verify transfer validity in the network Not enough close group nodes accepted the spend. Got 0, required: 5."). It will be retried later.
edbc907256b681b45f3f66c ---snipped DBC
restarting the network and storing larger files appears to work at first but is very slow then fails
willie@gagarin:~/projects/maidsafe/safe_network$ safe files upload ~/Videos/cooking/madhur/
Instantiating a SAFE client...
Client connected to the Network
Storing file "file_names.txt" of 200 bytes..
Successfully stored file to ChunkAddress(83cfab(10000011)..)
Sto"madhur.jaffrey's.flavours.of.india.episode.04.avi" of 361880676 bytes..
Successfully stored file to ChunkAddress(31a256(00110001)..)
Storing file "madhur.jaffrey's.flavours.of.india.episode.02.avi" of 356676884 bytes..
Did not store file "madhur.jaffrey's.flavours.of.india.episode.02.avi" to all nodes in the close group! Network Error Outbound Error.
Storing file "madhur.jaffrey's.flavours.of.india.episode.05.avi" of 362742180 bytes..ring file
Storing large files is a problem still, but something I am sure will be sorted soon. File storage is eating RAM as well as disk space right now.
willie@gagarin:~/projects/maidsafe/safe_network$ safe files upload ~/Videos/cooking/madhur/
Instantiating a SAFE client...
Client connected to the Network
Storing file "file_names.txt" of 200 bytes..
Successfully stored file to ChunkAddress(83cfab(10000011)..)
Storing file "madhur.jaffrey's.flavours.of.india.episode.04.avi" of 361880676 bytes..
Successfully stored file to ChunkAddress(31a256(00110001)..)
Storing file "madhur.jaffrey's.flavours.of.india.episode.02.avi" of 356676884 bytes..
Did not store file "madhur.jaffrey's.flavours.of.india.episode.02.avi" to all nodes in the close group! Network Error Outbound Error.
Storing file "madhur.jaffrey's.flavours.of.india.episode.05.avi" of 362742180 bytes..
Did not store file "madhur.jaffrey's.flavours.of.india.episode.05.avi" to all nodes in the close group! Network Error Outbound Error.
Storing file "madhur.jaffrey's.flavours.of.india.episode.06.avi" of 357022232 bytes..
Did not store file "madhur.jaffrey's.flavours.of.india.episode.06.avi" to all nodes in the close group! Network Error Could not get CLOSE_GROUP_SIZE number of peers..
Storing file "madhur.jaffrey's.flavours.of.india.episode.03.avi" of 360133404 bytes..
Did not store file "madhur.jaffrey's.flavours.of.india.episode.03.avi" to all nodes in the close group! Network Error Could not get CLOSE_GROUP_SIZE number of peers..
Storing file "madhur.jaffrey's.flavours.of.india.episode.01.avi" of 358941706 bytes..
Did not store file "madhur.jaffrey's.flavours.of.india.episode.01.avi" to all nodes in the close group! Network Error Could not get CLOSE_GROUP_SIZE number of peers..
Writing 151 bytes to "/home/willie/.safe/client/uploaded_files/file_names_2023-05-01_16-17-13"
willie@gagarin:~/projects/maidsafe/safe_network$ ls -l ~/Videos/cooking/madhur/
total 2106852
-rw-r--r-- 1 willie willie 358941706 Jul 4 2015 "madhur.jaffrey's.flavours.of.india.episode.01.avi"
-rw-r--r-- 1 willie willie 356676884 Jul 4 2015 "madhur.jaffrey's.flavours.of.india.episode.02.avi"
-rw-r--r-- 1 willie willie 360133404 Jul 4 2015 "madhur.jaffrey's.flavours.of.india.episode.03.avi"
-rw-r--r-- 1 willie willie 361880676 Jul 4 2015 "madhur.jaffrey's.flavours.of.india.episode.04.avi"
-rw-r--r-- 1 willie willie 362742180 Jul 4 2015 "madhur.jaffrey's.flavours.of.india.episode.05.avi"
-rw-r--r-- 1 willie willie 357022232 Jul 4 2015 "madhur.jaffrey's.flavours.of.india.episode.06.avi"
drwxrwxr-x 2 willie willie 4096 Apr 21 02:24 uploaded_files
willie@gagarin:~/projects/maidsafe/safe_network$
All safe nodes crashed themselves here, I did not have to issue any pkill command this time as usually happens when I get to this state
I have no idea why this is not using swap as it did previously. AFAIK I have not changed swap settings on this box since it was last upgraded a year or so back.
Latest from Github still has memory issues
These graphs show a std 25 node testnet getting started up and then just idling.
I will concentrate on Terraform for now until the memory/CPU use gets sorted. There are several large PRs coming down the track so I doubt I will have too long to wait.
Kicking this topic back up while we wait for a new testnet.
Obv limitations at the moment are nodes seemingly restricted to max 1024 records, whether registers, chunks or (presumeably) spends.
Please correct me if I have that wrong.
Having said that memory use is better and I am about to test if I can get >1 node running on a 1GB Banana Pi talking on the LAN to a 25 node testnet
Yes it can be done.
Would you want to? - Not at this time, very slow and likely to run out of memory.
Cross compiling tonight for the armv7 gave me this error – again
Compiling object v0.30.3
Compiling color-spantrace v0.2.0
Compiling clap_derive v3.2.25
Compiling sn_testnet v0.1.5 (/project/sn_testnet)
Compiling clap v4.2.7
error: failed to run custom build command for `sn_testnet v0.1.5 (/project/sn_testnet)`
Caused by:
process didn't exit successfully: `/target/release/build/sn_testnet-90e6b21b0658eb45/build-script-build` (exit status: 1)
--- stderr
/target/release/build/sn_testnet-90e6b21b0658eb45/build-script-build: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.28' not found (required by /target/release/build/sn_testnet-90e6b21b0658eb45/build-script-build)
/target/release/build/sn_testnet-90e6b21b0658eb45/build-script-build: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.33' not found (required by /target/release/build/sn_testnet-90e6b21b0658eb45/build-script-build)
/target/release/build/sn_testnet-90e6b21b0658eb45/build-script-build: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.32' not found (required by /target/release/build/sn_testnet-90e6b21b0658eb45/build-script-build)
/target/release/build/sn_testnet-90e6b21b0658eb45/build-script-build: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.34' not found (required by /target/release/build/sn_testnet-90e6b21b0658eb45/build-script-build)
warning: build failed, waiting for other jobs to finish...
Couple of nights ago I worked round this with rustup update - thanks @happybeing DiskNet [May 16th Testnet 2023] **Now Offline** - #23 by happybeing
However that did not work tonight.
I doubt testnet was ever seriously considered to run on armv7 hardware anyway.
Can I get cargo to only build me safe and safenode for the arm7?
#TooLazyToRTFM