I’m not sure about the current state of the client / self_encryption but it feels like hopefully the client can deal with these errors in a way that allows retries on a more granular level (streaming + concurrency?).
Is it one chunk failure causes the whole thing to fail, or is it more granular than that? What’s the retry strategy (whole file or per chunk, whatever the current case may be)?
In what we have at this version, retry is just keep trying the same PUT again. But if target nodes/cost shift that wont wash. (And it’s hard to tell with current log levels).
Right now I’m doing a wee refactor to get repayment attempts into that flow.
It would be great to get more granular, but it comes at a cost of verifying the transactions. Right now, we chunk everything output that, and then get costs based on those chunks and do the least amount of txs to generate DBCs. If we are fully stream based, we’d be doing 1tx per chunk, which would give us another longer validation step.
So right now, I’m aiming for at least the payment retries into the validation flow and then we’ll see where we are!
Not in this version, and it mayyy not come. We’ve been looking at just this and pondering the economics of it and other solutions…
That seems an awful lot (to any one node, it’d normally top out ~150 connections), but it could be the total number of nodes in the network. Maidsafe have 2k up, eg.
Ah yeh? Interesting, maybe it’s higher than previous after the DialNet fix (which may nottt be fixed as yet from this testnet. jury is still out!). Or maybe I’m just off there. Can’t say I’ve dug into that topic in a bit. I’d be interested to know what other folk are seeing here.
My first Testnet ever!! Client uploads and downloads seemed to work well!
Only problem was when i tried to upload one 700mb file =
" Error: Failed to send tokens due to Network Error Not enough store cost quotes returned from the network to ensure a valid fee is paid. "
Uploads are still painfully slow.
This is a 8Mb dir I use often for testing and which IIRC I already uploaded yesterday - so it should be quick (?)
It took just under 19mins.
willie@gagarin:~$ time safe files upload -c 20 ~/trecem
Built with git version: 8faf662 / main / 8faf662
Instantiating a SAFE client...
🔗 Connected to the Network Preparing (chunking) files at '/home/willie/trecem'...
Making payment for 104 Chunks that belong to 51 file/s.
Transfers applied locally
After 18.34945333s, All transfers made for total payment of Token(1632) nano tokens.
Successfully made payment of 0.000001632 for 51 records. (At a cost per record of Token(1632).)
Successfully stored wallet with cached payment proofs, and new balance 99.999972960.
Successfully paid for storage and generated the proofs. They can now be sent to the storage nodes when uploading paid chunks.
Preparing to store file 'scotcoin.tests.bom' of 240 bytes (1 chunk/s)..
Preparing to store file 'pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack' of 4345995 bytes (10 chunk/s)..
Preparing to store file 'catalog.bom' of 212 bytes (1 chunk/s)..
Preparing to store file 'Dockerfile' of 570 bytes (1 chunk/s)..
Preparing to store file 'scotcoin.bom' of 2226 bytes (1 chunk/s)..
Preparing to store file 'master' of 41 bytes (1 chunk/s)..
Preparing to store file 'packed-refs' of 188 bytes (1 chunk/s)..
Preparing to store file 'components.md' of 375 bytes (1 chunk/s)..
Starting to upload chunk #0 from "scotcoin.tests.bom". (after 0 seconds elapsed)
Preparing to store file 'components.png' of 1394174 bytes (4 chunk/s)..
Preparing to store file 'identity.png' of 819853 bytes (4 chunk/s)..
Preparing to store file 'scotcoin.png' of 4538 bytes (4 chunk/s)..
Preparing to store file 'token.md' of 9701 bytes (4 chunk/s)..
Preparing to store file 'fsmonitor-watchman.sample' of 3327 bytes (4 chunk/s)..
Preparing to store file 'description' of 73 bytes (1 chunk/s)..
Preparing to store file 'prepare-commit-msg.sample' of 1492 bytes (1 chunk/s)..
Preparing to store file 'ready-for.sh' of 181847 bytes (4 chunk/s)..
Preparing to store file 'contracts.md' of 3048 bytes (1 chunk/s)..
Preparing to store file 'catalog.tests.bom' of 1591 bytes (1 chunk/s)..
Preparing to store file 'pre-rebase.sample' of 4898 bytes (4 chunk/s)..
Preparing to store file 'pre-applypatch.sample' of 424 bytes (1 chunk/s)..
Preparing to store file 'pre-receive.sample' of 544 bytes (1 chunk/s)..
Preparing to store file 'configs' of 283 bytes (1 chunk/s)..
Preparing to store file 'README.md' of 478 bytes (1 chunk/s)..
Preparing to store file 'multinode.tests.bom' of 1611 bytes (1 chunk/s)..
Preparing to store file 'update.sample' of 3610 bytes (4 chunk/s)..
Preparing to store file 'pre-commit.sample' of 1642 bytes (1 chunk/s)..
Preparing to store file '.gitignore' of 22 bytes (1 chunk/s)..
Preparing to store file 'architecture.png' of 1155303 bytes (4 chunk/s)..
Preparing to store file 'applypatch-msg.sample' of 478 bytes (1 chunk/s)..
Preparing to store file 'pre-push.sample' of 1348 bytes (1 chunk/s)..
Preparing to store file 'scotcoin.yaml' of 511 bytes (1 chunk/s)..
Preparing to store file 'index' of 2503 bytes (1 chunk/s)..
Preparing to store file 'master' of 185 bytes (1 chunk/s)..
Preparing to store file 'scotcoin-standalone.yaml' of 532 bytes (1 chunk/s)..
Preparing to store file 'exclude' of 240 bytes (1 chunk/s)..
Preparing to store file 'pom.xml' of 5091 bytes (4 chunk/s)..
Preparing to store file 'catalog.tests.bom' of 383 bytes (1 chunk/s)..
Preparing to store file 'amazon.bom' of 1544 bytes (1 chunk/s)..
Preparing to store file 'HEAD' of 23 bytes (1 chunk/s)..
Preparing to store file 'identity.md' of 4028 bytes (4 chunk/s)..
Preparing to store file 'deployment.md' of 73 bytes (1 chunk/s)..
Preparing to store file 'pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx' of 5328 bytes (4 chunk/s)..
Preparing to store file 'post-update.sample' of 189 bytes (1 chunk/s)..
Preparing to store file 'scotcoin.bom' of 5936 bytes (4 chunk/s)..
Preparing to store file 'config' of 271 bytes (1 chunk/s)..
Preparing to store file 'commit-msg.sample' of 896 bytes (1 chunk/s)..
Preparing to store file 'iredmail-configs' of 7506 bytes (4 chunk/s)..
Preparing to store file 'file_names.txt' of 1704 bytes (1 chunk/s)..
Preparing to store file 'HEAD' of 32 bytes (1 chunk/s)..
Preparing to store file 'architecture.md' of 497 bytes (1 chunk/s)..
Preparing to store file 'build.sh' of 1752 bytes (1 chunk/s)..
Starting to upload chunk #0 from "catalog.bom". (after 0 seconds elapsed)
Starting to upload chunk #0 from "components.md". (after 0 seconds elapsed)
Starting to upload chunk #0 from "pre-receive.sample". (after 0 seconds elapsed)
Starting to upload chunk #0 from "contracts.md". (after 0 seconds elapsed)
Starting to upload chunk #3 from "token.md". (after 0 seconds elapsed)
Starting to upload chunk #0 from "configs". (after 0 seconds elapsed)
Starting to upload chunk #0 from "pre-applypatch.sample". (after 0 seconds elapsed)
Starting to upload chunk #3 from "fsmonitor-watchman.sample". (after 0 seconds elapsed)
Starting to upload chunk #3 from "update.sample". (after 0 seconds elapsed)
Starting to upload chunk #9 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack". (after 0 seconds elapsed)
Starting to upload chunk #0 from "pre-commit.sample". (after 0 seconds elapsed)
Starting to upload chunk #0 from "token.md". (after 3 seconds elapsed)
Starting to upload chunk #0 from "applypatch-msg.sample". (after 0 seconds elapsed)
Starting to upload chunk #0 from "pre-push.sample". (after 0 seconds elapsed)
Starting to upload chunk #0 from "index". (after 0 seconds elapsed)
Starting to upload chunk #0 from "master". (after 0 seconds elapsed)
Starting to upload chunk #0 from "scotcoin-standalone.yaml". (after 0 seconds elapsed)
Starting to upload chunk #0 from "exclude". (after 0 seconds elapsed)
Starting to upload chunk #0 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack". (after 4 seconds elapsed)
Uploaded chunk #0 from "configs" in 4 seconds)
Uploaded "configs" in 4 seconds
Successfully stored 'configs' to 6985cb196857ce5f699be13ba628c3ac0065d5af3fde0c45768c71b41aed326a
Starting to upload chunk #0 from "update.sample". (after 4 seconds elapsed)
Uploaded chunk #0 from "pre-commit.sample" in 4 seconds)
Uploaded "pre-commit.sample" in 4 seconds
Successfully stored 'pre-commit.sample' to 88e6ea1f5e1e42910f3e18413b7db371039cd718d887d4415d4ec0e5bdc5efab
Starting to upload chunk #3 from "pom.xml". (after 0 seconds elapsed)
Uploaded chunk #9 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" in 5 seconds)
Starting to upload chunk #1 from "update.sample". (after 5 seconds elapsed)
Uploaded chunk #0 from "scotcoin.tests.bom" in 5 seconds)
Uploaded "scotcoin.tests.bom" in 5 seconds
Successfully stored 'scotcoin.tests.bom' to 033efbb001188c3bf34eeb23ab8af66320dd9c881ff500948e8f4ee02aa1d1af
Starting to upload chunk #0 from "catalog.tests.bom". (after 1 seconds elapsed)
Uploaded chunk #0 from "pre-receive.sample" in 7 seconds)
Uploaded "pre-receive.sample" in 7 seconds
Successfully stored 'pre-receive.sample' to 6761162a19d4006aad67e7db0ebe45098e66881adf6eabff68b88ac3953cd1f6
Uploaded chunk #3 from "update.sample" in 7 seconds)
Uploaded chunk #0 from "components.md" in 7 seconds)
Uploaded "components.md" in 7 seconds
Successfully stored 'components.md' to 33346f88427c6dd1f8581397945b5e5707423608d4f11aacefa68e528be63565
Starting to upload chunk #2 from "update.sample". (after 7 seconds elapsed)
Uploaded chunk #3 from "token.md" in 7 seconds)
Starting to upload chunk #0 from "HEAD". (after 3 seconds elapsed)
Starting to upload chunk #0 from "amazon.bom". (after 3 seconds elapsed)
Uploaded chunk #0 from "pre-applypatch.sample" in 7 seconds)
Uploaded "pre-applypatch.sample" in 7 seconds
Successfully stored 'pre-applypatch.sample' to 65f9d51279f4774ac9d35c211b768cd6a37aa866136963e4d8412bb50abdfadc
Uploaded chunk #0 from "catalog.bom" in 7 seconds)
Uploaded "catalog.bom" in 7 seconds
Successfully stored 'catalog.bom' to 21ea8c9bd9fcad40a42756e4416bf3bb8ff708ae84e846374175a09a91e86fe7
Starting to upload chunk #0 from "deployment.md". (after 3 seconds elapsed)
Starting to upload chunk #3 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx". (after 3 seconds elapsed)
Uploaded chunk #3 from "fsmonitor-watchman.sample" in 8 seconds)
Starting to upload chunk #0 from "post-update.sample". (after 3 seconds elapsed)
Starting to upload chunk #3 from "identity.md". (after 4 seconds elapsed)
Uploaded chunk #0 from "contracts.md" in 8 seconds)
Uploaded "contracts.md" in 8 seconds
Successfully stored 'contracts.md' to 55ae374ebda997fb79709670b3e50e7a9471e876d5155197be83bd2bd18b1039
Starting to upload chunk #3 from "scotcoin.bom". (after 4 seconds elapsed)
Uploaded chunk #0 from "applypatch-msg.sample" in 11 seconds)
Uploaded "applypatch-msg.sample" in 11 seconds
Successfully stored 'applypatch-msg.sample' to 9c3f4859e52fa7bb8ffd8fe308df64af41a84e767d6167278e9effd22afcd797
Starting to upload chunk #0 from "pom.xml". (after 11 seconds elapsed)
Uploaded chunk #0 from "update.sample" in 11 seconds)
Starting to upload chunk #0 from "config". (after 12 seconds elapsed)
Uploaded chunk #0 from "scotcoin-standalone.yaml" in 12 seconds)
Uploaded "scotcoin-standalone.yaml" in 12 seconds
Successfully stored 'scotcoin-standalone.yaml' to c37a625b4340179819062aa4b56d3eee4e0b29762c8058601c2528a9a2a16f67
Starting to upload chunk #1 from "pom.xml". (after 12 seconds elapsed)
Uploaded chunk #3 from "scotcoin.bom" in 8 seconds)
Starting to upload chunk #0 from "commit-msg.sample". (after 12 seconds elapsed)
Uploaded chunk #0 from "master" in 12 seconds)
Uploaded "master" in 12 seconds
Successfully stored 'master' to c25de8216cd4e6532a6f7d5cfb35c791f3f21bcc67a6edab0f75208c5be2cb14
Starting to upload chunk #2 from "pom.xml". (after 12 seconds elapsed)
Uploaded chunk #1 from "update.sample" in 11 seconds)
Starting to upload chunk #3 from "iredmail-configs". (after 12 seconds elapsed)
Uploaded chunk #0 from "exclude" in 13 seconds)
Uploaded "exclude" in 13 seconds
Successfully stored 'exclude' to cea9d4bb398dbfdc5575538caddfb0f3dea8c414dfc9c8524df6509b2157df51
Starting to upload chunk #0 from "file_names.txt". (after 13 seconds elapsed)
Uploaded chunk #0 from "token.md" in 13 seconds)
Starting to upload chunk #0 from "HEAD". (after 13 seconds elapsed)
Uploaded chunk #0 from "amazon.bom" in 10 seconds)
Uploaded "amazon.bom" in 13 seconds
Successfully stored 'amazon.bom' to e482e4e6ce58f1ec4c44e40904709aa792e0de3955899c166c983dbd817f60e4
Starting to upload chunk #0 from "architecture.md". (after 13 seconds elapsed)
Uploaded chunk #3 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx" in 9 seconds)
Starting to upload chunk #0 from "build.sh". (after 13 seconds elapsed)
Uploaded chunk #0 from "pre-push.sample" in 13 seconds)
Uploaded "pre-push.sample" in 13 seconds
Successfully stored 'pre-push.sample' to a5357323f56b3f204b841a966501443bb7b35b9dd10bc48d86f590889e518105
Starting to upload chunk #0 from "identity.md". (after 13 seconds elapsed)
Uploaded chunk #3 from "identity.md" in 10 seconds)
Starting to upload chunk #1 from "identity.md". (after 14 seconds elapsed)
Uploaded chunk #2 from "update.sample" in 11 seconds)
Uploaded "update.sample" in 18 seconds
Successfully stored 'update.sample' to 886d2a65d16cfddc8f1032aeb922454997427361f497b4dc5c6488591ce8b4d4
Starting to upload chunk #2 from "identity.md". (after 14 seconds elapsed)
Uploaded chunk #0 from "index" in 15 seconds)
Uploaded "index" in 15 seconds
Successfully stored 'index' to ad2c45885420a9f21fa72d546996615b0cb4b19a1d959f207beb32a5c97485c3
Starting to upload chunk #0 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx". (after 15 seconds elapsed)
Uploaded chunk #0 from "post-update.sample" in 11 seconds)
Uploaded "post-update.sample" in 15 seconds
Successfully stored 'post-update.sample' to efa7027103d6cb6a0fbcc3ef6e105afbe7fd6cab612ea844181af2fc29c4b4e9
Starting to upload chunk #1 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx". (after 15 seconds elapsed)
Uploaded chunk #3 from "pom.xml" in 15 seconds)
Starting to upload chunk #2 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx". (after 16 seconds elapsed)
Uploaded chunk #0 from "deployment.md" in 13 seconds)
Uploaded "deployment.md" in 17 seconds
Starting to upload chunk #0 from "scotcoin.bom". (after 17 seconds elapsed)
Successfully stored 'deployment.md' to e5761884863ffdd914685aaf0d427892479530a449ad33ef59654e7e8e688a33
Uploaded chunk #0 from "HEAD" in 15 seconds)
Uploaded "HEAD" in 18 seconds
Successfully stored 'HEAD' to e48a49ba10e35a6e4213b46572aadccbfe6be7b02991f2545aac09c89f95ae5f
Starting to upload chunk #1 from "scotcoin.bom". (after 18 seconds elapsed)
Uploaded chunk #1 from "pom.xml" in 10 seconds)
Starting to upload chunk #2 from "scotcoin.bom". (after 22 seconds elapsed)
Uploaded chunk #0 from "pom.xml" in 11 seconds)
Starting to upload chunk #0 from "iredmail-configs". (after 23 seconds elapsed)
Uploaded chunk #0 from "HEAD" in 10 seconds)
Uploaded "HEAD" in 23 seconds
Successfully stored 'HEAD' to faff6f3172c24fe0b09c81e94e0c202294c07f3006d40afa04dd733ad436c464
Starting to upload chunk #1 from "iredmail-configs". (after 23 seconds elapsed)
Uploaded chunk #0 from "config" in 11 seconds)
Uploaded "config" in 23 seconds
Successfully stored 'config' to f44a8ba155de4bc6553d5e321863284c10e2aa22e9da2f898e9901d9eb201618
Starting to upload chunk #2 from "iredmail-configs". (after 23 seconds elapsed)
Uploaded chunk #0 from "identity.md" in 10 seconds)
Starting to upload chunk #3 from "ready-for.sh". (after 24 seconds elapsed)
Uploaded chunk #0 from "file_names.txt" in 11 seconds)
Uploaded "file_names.txt" in 24 seconds
Successfully stored 'file_names.txt' to faecefa49e8cfac06eef52f03a02f86ddcf63136db13837b189cf825b6e98dae
Starting to upload chunk #0 from "description". (after 24 seconds elapsed)
Uploaded chunk #3 from "iredmail-configs" in 12 seconds)
Starting to upload chunk #0 from "prepare-commit-msg.sample". (after 25 seconds elapsed)
Uploaded chunk #0 from "build.sh" in 12 seconds)
Uploaded "build.sh" in 25 seconds
Successfully stored 'build.sh' to ffa702b7d8e5fc4924048c8173f1b74bd9ceeb2a7dd1f6905099c3a478b63182
Starting to upload chunk #0 from "ready-for.sh". (after 25 seconds elapsed)
Uploaded chunk #0 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx" in 10 seconds)
Starting to upload chunk #1 from "ready-for.sh". (after 25 seconds elapsed)
Uploaded chunk #1 from "identity.md" in 11 seconds)
Starting to upload chunk #2 from "ready-for.sh". (after 25 seconds elapsed)
Uploaded chunk #0 from "commit-msg.sample" in 13 seconds)
Uploaded "commit-msg.sample" in 26 seconds
Successfully stored 'commit-msg.sample' to f86a15da47642ae89116913f5355a61ad88e2cd620e655de242e1937a4d90720
Starting to upload chunk #4 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack". (after 30 seconds elapsed)
Uploaded chunk #2 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx" in 10 seconds)
Starting to upload chunk #1 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack". (after 30 seconds elapsed)
Uploaded chunk #1 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx" in 12 seconds)
Uploaded "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx" in 27 seconds
Successfully stored 'pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.idx' to edab22975fcb46e11d2f8e35cd1d28464588c1456eaf8c2ba2b44fffa26e5765
Starting to upload chunk #2 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack". (after 31 seconds elapsed)
Uploaded chunk #0 from "scotcoin.bom" in 10 seconds)
Starting to upload chunk #3 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack". (after 31 seconds elapsed)
Uploaded chunk #2 from "pom.xml" in 16 seconds)
Uploaded "pom.xml" in 29 seconds
Starting to upload chunk #1 from "fsmonitor-watchman.sample". (after 33 seconds elapsed)
Successfully stored 'pom.xml' to dd9e5e6beea42eb267230225ff8baf405772a6eab61fc8b58312da044ad772ed
Uploaded chunk #1 from "scotcoin.bom" in 11 seconds)
Starting to upload chunk #0 from "fsmonitor-watchman.sample". (after 33 seconds elapsed)
Uploaded chunk #0 from "ready-for.sh" in 21 seconds)
Starting to upload chunk #0 from "catalog.tests.bom". (after 47 seconds elapsed)
Uploaded chunk #0 from "iredmail-configs" in 24 seconds)
Uploaded chunk #3 from "ready-for.sh" in 23 seconds)
Starting to upload chunk #0 from ".gitignore". (after 47 seconds elapsed)
Starting to upload chunk #3 from "architecture.png". (after 47 seconds elapsed)
Uploaded chunk #0 from "prepare-commit-msg.sample" in 27 seconds)
Uploaded "prepare-commit-msg.sample" in 52 seconds
Successfully stored 'prepare-commit-msg.sample' to 50fa5437d83918c07255ac91c63ee9a0c2f4500c24ea6baade18bfe4340a6c9f
Starting to upload chunk #0 from "architecture.png". (after 52 seconds elapsed)
Uploaded chunk #1 from "ready-for.sh" in 28 seconds)
Starting to upload chunk #1 from "architecture.png". (after 53 seconds elapsed)
Uploaded chunk #2 from "ready-for.sh" in 28 seconds)
Uploaded "ready-for.sh" in 53 seconds
Successfully stored 'ready-for.sh' to 54ad13048c9f74654cbe0e2dabfac861b45b0125e93bde781513fff63392145a
Starting to upload chunk #2 from "architecture.png". (after 53 seconds elapsed)
Uploaded chunk #1 from "fsmonitor-watchman.sample" in 25 seconds)
Starting to upload chunk #3 from "pre-rebase.sample". (after 54 seconds elapsed)
Uploaded chunk #0 from "description" in 29 seconds)
Uploaded "description" in 54 seconds
Successfully stored 'description' to 4f7787748d2f5cf541de8bfa695f74585d20d441c5b7fa3bb327ebbce3deb9ff
Starting to upload chunk #0 from "pre-rebase.sample". (after 54 seconds elapsed)
Uploaded chunk #2 from "iredmail-configs" in 34 seconds)
Starting to upload chunk #1 from "pre-rebase.sample". (after 58 seconds elapsed)
Uploaded chunk #1 from "iredmail-configs" in 39 seconds)
Uploaded "iredmail-configs" in 1 minutes 3 seconds
Successfully stored 'iredmail-configs' to faebe7fdb6b69824f2b993a27ac5551586f1441260c30ab3ac1b3ec530db54e7
Starting to upload chunk #2 from "pre-rebase.sample". (after 1 minutes 3 seconds elapsed)
Uploaded chunk #0 from "catalog.tests.bom" in 30 seconds)
Uploaded "catalog.tests.bom" in 1 minutes 18 seconds
Successfully stored 'catalog.tests.bom' to 56e21f9e7bc971f850fadaad69ec054e9b9e4e3ff44d7c572e72744979d9edba
Starting to upload chunk #2 from "fsmonitor-watchman.sample". (after 1 minutes 22 seconds elapsed)
Uploaded chunk #0 from ".gitignore" in 34 seconds)
Uploaded ".gitignore" in 1 minutes 21 seconds
Starting to upload chunk #0 from "scotcoin.yaml". (after 1 minutes 21 seconds elapsed)
Successfully stored '.gitignore' to 8a794264ebcd148e2b08c5091916fd86e2797ab22c9206c646fde011e049745c
Uploaded chunk #0 from "architecture.png" in 33 seconds)
Starting to upload chunk #0 from "README.md". (after 1 minutes 25 seconds elapsed)
Uploaded chunk #2 from "architecture.png" in 36 seconds)
Starting to upload chunk #0 from "multinode.tests.bom". (after 1 minutes 29 seconds elapsed)
Uploaded chunk #3 from "architecture.png" in 49 seconds)
Starting to upload chunk #3 from "identity.png". (after 1 minutes 36 seconds elapsed)
Uploaded chunk #0 from "README.md" in 23 seconds)
Uploaded "README.md" in 1 minutes 49 seconds
Successfully stored 'README.md' to 6b105be9ab38476dc79f6280a0f329b50f24603f4e401374ee9adbaeea54cb49
Starting to upload chunk #3 from "components.png". (after 1 minutes 49 seconds elapsed)
Uploaded chunk #0 from "scotcoin.yaml" in 49 seconds)
Uploaded "scotcoin.yaml" in 2 minutes 10 seconds
Successfully stored 'scotcoin.yaml' to aa91d1b3a955fa94c30bc662847ae93a04ac37440ff1213bdc7dff0caeb76152
Starting to upload chunk #0 from "identity.png". (after 2 minutes 10 seconds elapsed)
Uploaded chunk #0 from "multinode.tests.bom" in 49 seconds)
Uploaded "multinode.tests.bom" in 2 minutes 19 seconds
Successfully stored 'multinode.tests.bom' to 726342ca6a8d53332833927b8571f59732769f227eea7bd83acfde25ade73a24
Starting to upload chunk #1 from "identity.png". (after 2 minutes 19 seconds elapsed)
Uploaded chunk #3 from "components.png" in 42 seconds)
Starting to upload chunk #2 from "identity.png". (after 2 minutes 32 seconds elapsed)
Uploaded chunk #2 from "identity.png" in 1 minutes 35 seconds)
Starting to upload chunk #0 from "components.png". (after 4 minutes 7 seconds elapsed)
Uploaded chunk #1 from "pre-rebase.sample" in 5 minutes 28 seconds)
Starting to upload chunk #1 from "components.png". (after 6 minutes 26 seconds elapsed)
Uploaded chunk #1 from "components.png" in 36 seconds)
Starting to upload chunk #2 from "components.png". (after 7 minutes 3 seconds elapsed)
Uploaded chunk #0 from "architecture.md" in 7 minutes 12 seconds)
Starting to upload chunk #0 from "scotcoin.bom". (after 7 minutes 25 seconds elapsed)
Uploaded "architecture.md" in 7 minutes 25 seconds
Successfully stored 'architecture.md' to fbd49ba1a90d4cc0b422e8ee0d6090b707bce4eb9c7d8c74c86c2386d453dfc2
Uploaded chunk #2 from "components.png" in 37 seconds)
Starting to upload chunk #0 from "Dockerfile". (after 7 minutes 40 seconds elapsed)
Uploaded chunk #0 from "scotcoin.bom" in 30 seconds)
Uploaded "scotcoin.bom" in 7 minutes 56 seconds
Starting to upload chunk #0 from "master". (after 7 minutes 56 seconds elapsed)
Successfully stored 'scotcoin.bom' to 2666dd20e19f197bc42c697aef7c525fd7caf535427c506a80d5b6188ccbe1a3
Uploaded chunk #3 from "pre-rebase.sample" in 7 minutes 5 seconds)
Starting to upload chunk #0 from "packed-refs". (after 7 minutes 59 seconds elapsed)
Uploaded chunk #1 from "identity.png" in 5 minutes 50 seconds)
Starting to upload chunk #1 from "token.md". (after 8 minutes 13 seconds elapsed)
Uploaded chunk #0 from "packed-refs" in 35 seconds)
Uploaded "packed-refs" in 8 minutes 35 seconds
Starting to upload chunk #2 from "token.md". (after 8 minutes 39 seconds elapsed)
Successfully stored 'packed-refs' to 2b269ff1f82e5b9db3d5feaaf8991e293f6ebc38ad666f57ef4ed0d6e2d24bc1
Uploaded chunk #1 from "token.md" in 28 seconds)
Starting to upload chunk #6 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack". (after 8 minutes 41 seconds elapsed)
Uploaded chunk #0 from "pre-rebase.sample" in 7 minutes 54 seconds)
Starting to upload chunk #5 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack". (after 8 minutes 52 seconds elapsed)
Uploaded chunk #2 from "token.md" in 22 seconds)
Uploaded "token.md" in 9 minutes 1 seconds
Starting to upload chunk #7 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack". (after 9 minutes 1 seconds elapsed)
Successfully stored 'token.md' to 46b56091d45917e5c1678ecd0961e63a45e4d12ebf40ae316081ca0c7aaa2a2d
Uploaded chunk #6 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" in 27 seconds)
Starting to upload chunk #8 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack". (after 9 minutes 8 seconds elapsed)
Uploaded chunk #2 from "identity.md" in 8 minutes 52 seconds)
Starting to upload chunk #3 from "scotcoin.png". (after 9 minutes 7 seconds elapsed)
Uploaded "identity.md" in 9 minutes 7 seconds
Successfully stored 'identity.md' to e554b80a08b20f6c0f319d638f30f19861a05d8035a2314d8cea7be278860bcd
Uploaded chunk #2 from "pre-rebase.sample" in 8 minutes 4 seconds)
Uploaded "pre-rebase.sample" in 9 minutes 8 seconds
Successfully stored 'pre-rebase.sample' to 5bfd26526ab4f35027be8cddd5a9d1b7a3227049ade0796901b95fd80893fbb9
Starting to upload chunk #0 from "scotcoin.png". (after 9 minutes 8 seconds elapsed)
Uploaded chunk #3 from "scotcoin.png" in 17 seconds)
Starting to upload chunk #1 from "scotcoin.png". (after 9 minutes 24 seconds elapsed)
Uploaded chunk #7 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" in 33 seconds)
Starting to upload chunk #2 from "scotcoin.png". (after 9 minutes 31 seconds elapsed)
Uploaded chunk #0 from "scotcoin.png" in 23 seconds)
Uploaded chunk #8 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" in 33 seconds)
Uploaded chunk #1 from "scotcoin.png" in 25 seconds)
Uploaded chunk #2 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" in 9 minutes 35 seconds)
Uploaded chunk #0 from "identity.png" in 8 minutes 12 seconds)
Uploaded chunk #0 from "catalog.tests.bom" in 11 minutes 33 seconds)
Uploaded "catalog.tests.bom" in 11 minutes 34 seconds
Successfully stored 'catalog.tests.bom' to e313fbb915600edbd99672c63dda90f9e461845fca639457873b2dcef73bc140
Uploaded chunk #4 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" in 12 minutes 1 seconds)
Uploaded chunk #0 from "fsmonitor-watchman.sample" in 13 minutes 7 seconds)
Uploaded chunk #0 from "components.png" in 9 minutes 54 seconds)
Uploaded "components.png" in 14 minutes 1 seconds
Successfully stored 'components.png' to 3ec62293ca151c46eeaa099ee207d0f9b00a26ce1acfb0b55cc32fa625ba11b2
Uploaded chunk #2 from "fsmonitor-watchman.sample" in 12 minutes 57 seconds)
Uploaded "fsmonitor-watchman.sample" in 14 minutes 19 seconds
Successfully stored 'fsmonitor-watchman.sample' to 4a18c57b6263223d31979f28068912c4b0c2db627120f2474effa395a9ed65bf
Uploaded chunk #0 from "Dockerfile" in 7 minutes 21 seconds)
Uploaded "Dockerfile" in 15 minutes 1 seconds
Successfully stored 'Dockerfile' to 21ed679a2579a8da93b82a24b4e345c358492d091d5e935dd9f1c6e27e43a2b3
Uploaded chunk #0 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" in 16 minutes 18 seconds)
Uploaded chunk #1 from "architecture.png" in 15 minutes 29 seconds)
Uploaded "architecture.png" in 16 minutes 23 seconds
Successfully stored 'architecture.png' to 926d667ae690ba7357d2148b6d273464c9ea6bf24e1971dfc265a43f42beaf1f
Uploaded chunk #2 from "scotcoin.bom" in 16 minutes 29 seconds)
Uploaded "scotcoin.bom" in 16 minutes 52 seconds
Successfully stored 'scotcoin.bom' to f408f7201615442002a909450c76965329036c93dd2ad256ad46d8f1292a4fe0
Uploaded chunk #5 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" in 8 minutes 11 seconds)
Uploaded chunk #2 from "scotcoin.png" in 7 minutes 37 seconds)
Uploaded "scotcoin.png" in 17 minutes 8 seconds
Successfully stored 'scotcoin.png' to 42114b2b0bf4a91210a126204a7fc95c3630e9f5298948445f3f644287a55861
Uploaded chunk #3 from "identity.png" in 15 minutes 46 seconds)
Uploaded "identity.png" in 17 minutes 22 seconds
Successfully stored 'identity.png' to 3fdcef5b9b06b2832546257e4876a3f7a227f37b1da2f87ade5247429353a5f4
Uploaded chunk #0 from "master" in 9 minutes 39 seconds)
Uploaded "master" in 17 minutes 35 seconds
Successfully stored 'master' to 27912cc3755e5272d7021f14d1158ff628cb4ee3023fd8cb7df22213de027a70
Uploaded chunk #3 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" in 17 minutes 22 seconds)
Uploaded chunk #1 from "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" in 17 minutes 34 seconds)
Uploaded "pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack" in 18 minutes 5 seconds
Successfully stored 'pack-cb34aa95664acc3af4b9d153db1c54679e7abd36.pack' to 1a306b1a865e436dc4455b4be4d16f6d884465ecc0b88e9c847e5383afe91a68
Writing 2786 bytes to "/home/willie/.local/share/safe/client/uploaded_files/file_names_2023-09-05_18-29-00"
real 18m54.352s
user 5m31.545s
sys 0m18.301s
````Preformatted text`
#!/bin/bash
for i in {1..50}
do
SN_LOG=all $HOME/.local/bin/safenode --log-output-dest=$HOME/.local/share/safe/node --root-dir=$HOME/.local/share/safe/node &
echo $i
sleep 5
done
But I’ve reaslied that specifying the log-output-dest and the root-dir like that means that I just get 1 node started with those locations and the output for the other ones is just lost.
If I don’t specify a location by using just:-
SN_LOG=all $HOME/.local/bin/safenode &
in the script I just seem to get 1 node started with the log output on the ssh session and another 49 running but there seems to be no location for and of the the logs that I can find (grepped the output of lsof). And I can’t find the record-store or anything else for the nodes.
How would you start 50 nodes with them all having a location for their logs and record store?
willie@gagarin:~$ safe register create -n register01
Built with git version: 8faf662 / main / 8faf662
Instantiating a SAFE client...
🔗 Connected to the Network Successfully created register 'register01' at 6ae110abc2b582d97516de1d21840b77e91dd2fe9724314ded0be36c75feb8b5807f7df5442fa2b487761c3e89add11d064f2f76952061b71e204abee39e9068d5cb7995f1d6288159bbd63b6e6ca9bd!
willie@gagarin:~$ safe register edit -n register01 "1st entry"
Built with git version: 8faf662 / main / 8faf662
Instantiating a SAFE client...
🔗 Connected to the Network Trying to retrieve Register from 6ae110abc2b582d97516de1d21840b77e91dd2fe9724314ded0be36c75feb8b5807f7df5442fa2b487761c3e89add11d064f2f76952061b71e204abee39e9068d5cb7995f1d6288159bbd63b6e6ca9bd
Did not retrieve Register 'register01' at 6ae110abc2b582d97516de1d21840b77e91dd2fe9724314ded0be36c75feb8b5807f7df5442fa2b487761c3e89add11d064f2f76952061b71e204abee39e9068d5cb7995f1d6288159bbd63b6e6ca9bd from all nodes in the close group! Protocol error Register not found: 6ae110abc2b582d97516de1d21840b77e91dd2fe9724314ded0be36c75feb8b5807f7df5442fa2b487761c3e89add11d064f2f76952061b71e204abee39e9068d5cb7995f1d6288159bbd63b6e6ca9bd.
Error: Protocol error Register not found: 6ae110abc2b582d97516de1d21840b77e91dd2fe9724314ded0be36c75feb8b5807f7df5442fa2b487761c3e89add11d064f2f76952061b71e204abee39e9068d5cb7995f1d6288159bbd63b6e6ca9bd.
Caused by:
Register not found: 6ae110abc2b582d97516de1d21840b77e91dd2fe9724314ded0be36c75feb8b5807f7df5442fa2b487761c3e89add11d064f2f76952061b71e204abee39e9068d5cb7995f1d6288159bbd63b6e6ca9bd
Location:
/rustc/5680fa18feaa87f3ff04063800aec256c3d4b4be/library/core/src/convert/mod.rs:716:9
I really really would like to report success with RewardNet but Ive failed again attempting a 28Mb upload from AWS…
Error: Failed to send tokens due to Network Error Not enough store cost quotes returned from the network to ensure a valid fee is paid.
28M /usr/share/doc
ubuntu@RewardNetNodesouthside01:~$ time safe files upload -c 10 /usr/share/doc/
Built with git version: 8faf662 / main / 8faf662
Instantiating a SAFE client...
🔗 Connected to the Network Preparing (chunking) files at '/usr/share/doc/'...
Making payment for 5865 Chunks that belong to 2955 file/s.
Error: Failed to send tokens due to Network Error Not enough store cost quotes returned from the network to ensure a valid fee is paid.
Location:
sn_cli/src/subcommands/wallet.rs:343:16
real 1m11.775s
user 0m51.780s
sys 0m9.129s
smaller uploads complete OK but are very slow
6 mins for ~400k
Uploaded "NAT-HOWTO-2.html" in 5 minutes 28 seconds
Successfully stored 'NAT-HOWTO-2.html' to fc974e806a7634263af0c78183bbc1b1c25ecdb40b2445095d5ae0b427fdd1c9
Writing 3093 bytes to "/home/ubuntu/.local/share/safe/client/uploaded_files/file_names_2023-09-06_03-07-47"
real 6m23.645s
user 3m54.809s
sys 0m16.349s
ubuntu@RewardNetNodesouthside01:~$ du -h /usr/share/doc/iptables/
376K /usr/share/doc/iptables/html
404K /usr/share/doc/iptables/
Big uploads seem to be a no-no, which is sad…
446M ./MD-11
446M .
ubuntu@RewardNetNodesouthside01:~/uploads$ export SAFE_PEERS=/ip4/24.199.126.17/tcp/34181/p2p/12D3KooWMzWbX6oZtNidygRYwDwD2ykaosQsDk6m7GebrjWhDac3
ubuntu@RewardNetNodesouthside01:~/uploads$ time safe files upload -c 20 MD-11/
Built with git version: 8faf662 / main / 8faf662
Instantiating a SAFE client...
🔗 Connected to the Network Preparing (chunking) files at 'MD-11/'...
Making payment for 2662 Chunks that belong to 648 file/s.
Error: Failed to send tokens due to Network Error Not enough store cost quotes returned from the network to ensure a valid fee is paid.
Location:
sn_cli/src/subcommands/wallet.rs:343:16
real 1m9.561s
user 0m47.442s
sys 0m9.111s