ZeroTestNet [20/12/23 Testnet] [Offline]

Development Releases
42

Ever see a race condition in the old DEC SYSTEMS mainframes operating system itself during the 60’s and 70’s. 60 or more terminals become inoperative and the address lights on the CPU cabinet become a cyclic blink. Oh and the silence was golden or fearful depending on who you were. Wasn’t much one could do and just powering off a device to cause a fault condition to break the deadlock was not an option, so it was powering off the mainframe and bring it up - not as easy as switch off, switch on IT Crowd

Just a bit of trivia, nothing productive for the testnet.

4 Likes
43

Zip problems (not the first time…)

This should be a bit more useful.

“logs2.zip” bc05d36e5efd7fcfd124c8beaeee145dc600761e956cfa8ff607816fd659422c

2 Likes
44

Hi, All,

It seems the testnet is now running with around 3200 nodes.
Wondering if anyone still see an empty earning nodes ?

8 Likes
45

Three here all earning. One was slow to start but has nanos now. No RecordRejected errors apart from the standard NoPaymentToOurNode one

7 Likes
46

nope, all earning for me

7 Likes
47

Nope, all earning. Variation is huge though, from 171 nanos to 762115 nanos.

9 Likes
48

right. the huge variation of earning is somehow expected.
According to the sim, the variation could be min 33 vs. max 7406164 .

Some further detailed pricing curve + payee selection algorithm discussion and work will to be carried out for sure, to reduce the variation.

11 Likes
49

Do you plan to revert the client to select cheapest node?

I’m assuming this was an experiment but not a proposed modification, because I think it will just make people run higher charging nodes. I was tempted to do that just to see the effect but don’t want to mess up your test.

7 Likes
50

yeah, highly possible we will switch back to select cheapest node.
However that will be with other pricing curve tweaks to ensure fairness to nodes getting more unpaid replication copies .
There is sim showing promissing (select cheapest, with no empty-earning node, and a much reduced variation range).
Still need further discussion on it.

14 Likes
51

My node seems to be running smoothly, but when I go to check my wallet balance I get the following:

Logging to directory: “C:\Users\Taylor\AppData\Roaming\safe\client\logs\log_2023-12-21_08-27-14”
Built with git version: 8bf4df9 / main / 8bf4df9
Error:
0: ←[91mBincode error:: deserialized bytes don’t encode a group element←[0m
1: ←[91mdeserialized bytes don’t encode a group element←[0m

Location:
←[35msn_cli\src\subcommands\wallet.rs←[0m:←[35m156←[0m

Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.

Anyone have any ideas about what’s up here?

5 Likes
52

that seems a wrong commit?
what’s the version of your client?

find it, it’s 0.83.3. bit old, we are now at 0.86.76
you can try safeup client --version 0.86.76 to upgrade

7 Likes
53

That did the trick - thank you.

6 Likes
54

I’ve had a couple of ‘RecordRejected’ that aren’t ‘NoPaymentToOurNode’

ls $HOME/.local/share/safe/node/ | while read f; do echo ${f} ; cat $HOME/.local/share/safe/node/${f}/logs/safenode.log* | grep 'RecordRejected' | grep -v 'NoPaymentToOurNode' ; echo ; done;
12D3KooWAJGVdijxrezktvgZVXmC3WNsPRmzRZre2jM7PhRAAsnj

12D3KooWFrLFmWRxfvHrVMVci4XX3DeB4Jyf3kP7grQVfhYcxKWW

12D3KooWGMBaLd1sfF9guxMbQnpNhp3H46xuNVbCRwptcZz4QcjN
[2023-12-21T21:30:37.901603Z INFO sn_node::log_markers] RecordRejected(560b97(a60821086e600f8ea26c756eb4d8c862f712240c62356a21f6be86cf5f75dccb), Network(GetRecordError(RecordNotFound)))
[2023-12-21T21:30:43.862184Z INFO sn_node::log_markers] RecordRejected(560b97(a60821086e600f8ea26c756eb4d8c862f712240c62356a21f6be86cf5f75dccb), Network(GetRecordError(RecordNotFound)))
[2023-12-21T21:30:52.194739Z INFO sn_node::log_markers] RecordRejected(560b97(a60821086e600f8ea26c756eb4d8c862f712240c62356a21f6be86cf5f75dccb), Network(GetRecordError(RecordNotFound)))

12D3KooWREToZpvLXCPQgUYLJ9PTjb5eiHA2pkH6mpoAcYUi7FDc

12D3KooWSECj5YWuiB22Exk4M4sbfY1SnZB3bb9Raq3BWMmGeWWi
[2023-12-21T19:54:28.799457Z INFO sn_node::log_markers] RecordRejected(0f6d4d(e56aef9601043ff31ff6df80b4c69424e6c7c91a4472d29e7ed782645c7f325b), Network(InvalidTransfer("GetRecord Query Error NotEnoughCopies { record_key: 90fa1a(5850c8b58aa8c063ba714ff1198c89c03a5c9577408e580dd15c1e41a4f8e55c), expected: 5, got: 4 }")))

Do you want the whole logs?

2 Likes
55

I have similar…

12D3KooWApP1ocQM7kvyyHuKcnMjTXLma8g6EUu2KFv74HqVdAeH
[2023-12-21T00:45:38.323033Z INFO sn_node::log_markers] RecordRejected(e02fc0(ecac998c900ba63ac581954ca898be0aa610a9411c2e0e6ca62dce41955f0a00), Network(GetRecordError(RecordNotFound)))
[2023-12-21T00:45:42.232971Z INFO sn_node::log_markers] RecordRejected(e02fc0(ecac998c900ba63ac581954ca898be0aa610a9411c2e0e6ca62dce41955f0a00), Network(GetRecordError(RecordNotFound)))
[2023-12-21T00:45:48.617578Z INFO sn_node::log_markers] RecordRejected(e02fc0(ecac998c900ba63ac581954ca898be0aa610a9411c2e0e6ca62dce41955f0a00), Network(GetRecordError(RecordNotFound)))

12D3KooWCYx4yPtnBe9Jtak6aCsvyQsMxuNfvnQ9yf8kpv7vvhsC
[2023-12-21T07:39:53.186606Z INFO sn_node::log_markers] RecordRejected(b169bf(83cbd0a2d435ce650fda053de4a417bd35366b6cf4e95368f3098531bb289a45), Network(GetRecordError(RecordNotFound)))
[2023-12-21T07:39:58.500843Z INFO sn_node::log_markers] RecordRejected(b169bf(83cbd0a2d435ce650fda053de4a417bd35366b6cf4e95368f3098531bb289a45), Network(GetRecordError(RecordNotFound)))
[2023-12-21T07:40:06.603796Z INFO sn_node::log_markers] RecordRejected(b169bf(83cbd0a2d435ce650fda053de4a417bd35366b6cf4e95368f3098531bb289a45), Network(GetRecordError(RecordNotFound)))


12D3KooWGLf2Ss7hMuRuPH2futHws11Atz2mpcBqCj5iN4QG8FpY
[2023-12-21T00:07:30.505828Z INFO sn_node::log_markers] RecordRejected(eadf7a(67391049d708f95b9faefe6a2573dd9c706ce6ab4b4b210c6b70c9620a427091), Network(GetRecordError(RecordNotFound)))
[2023-12-21T00:07:37.379042Z INFO sn_node::log_markers] RecordRejected(eadf7a(67391049d708f95b9faefe6a2573dd9c706ce6ab4b4b210c6b70c9620a427091), Network(GetRecordError(RecordNotFound)))
[2023-12-21T00:07:44.339810Z INFO sn_node::log_markers] RecordRejected(eadf7a(67391049d708f95b9faefe6a2573dd9c706ce6ab4b4b210c6b70c9620a427091), Network(GetRecordError(RecordNotFound)))

12D3KooWGSK2hLdX8HpmrZaKgsDoVv17C5fjyAHMWWFmNqyfWzGi
[2023-12-21T07:36:12.752798Z INFO sn_node::log_markers] RecordRejected(108b7e(0b55f79af5319e92fe332c01e1c54faf3a4bcce2d74c4e357ada783d08318da6), Network(GetRecordError(RecordNotFound)))
[2023-12-21T07:36:17.216977Z INFO sn_node::log_markers] RecordRejected(108b7e(0b55f79af5319e92fe332c01e1c54faf3a4bcce2d74c4e357ada783d08318da6), Network(GetRecordError(RecordNotFound)))
[2023-12-21T07:36:23.970619Z INFO sn_node::log_markers] RecordRejected(108b7e(0b55f79af5319e92fe332c01e1c54faf3a4bcce2d74c4e357ada783d08318da6), Network(GetRecordError(RecordNotFound)))
[2023-12-21T07:36:31.110135Z INFO sn_node::log_markers] RecordRejected(108b7e(0b55f79af5319e92fe332c01e1c54faf3a4bcce2d74c4e357ada783d08318da6), Network(GetRecordError(RecordNotFound)))

12D3KooWKrSZzUnDLhVm7DBSnbbgH6Wm1sbshtYsDAZk3xEmeRTm
[2023-12-21T07:38:26.376997Z INFO sn_node::log_markers] RecordRejected(0ec8a6(7355184e0256c5290e8b796c868945643bc2243938a10b2ae1120112755c39eb), Network(GetRecordError(RecordNotFound)))
[2023-12-21T07:38:31.468114Z INFO sn_node::log_markers] RecordRejected(0ec8a6(7355184e0256c5290e8b796c868945643bc2243938a10b2ae1120112755c39eb), Network(GetRecordError(RecordNotFound)))
[2023-12-21T07:38:37.588690Z INFO sn_node::log_markers] RecordRejected(0ec8a6(7355184e0256c5290e8b796c868945643bc2243938a10b2ae1120112755c39eb), Network(GetRecordError(RecordNotFound)))

12D3KooWLPMbYfNPZkkGAagigpdrZb6LW5xWGkfDR5KCmxFXYEJB
[2023-12-20T19:45:55.081982Z INFO sn_node::log_markers] RecordRejected(e41437(3c9f49aaaab0696b03131cf73adab71acdcbf7e7cb68b3ee6e655f8abc821ca6), Network(GetRecordError(RecordNotFound)))
[2023-12-20T19:46:02.996756Z INFO sn_node::log_markers] RecordRejected(e41437(3c9f49aaaab0696b03131cf73adab71acdcbf7e7cb68b3ee6e655f8abc821ca6), Network(GetRecordError(RecordNotFound)))
[2023-12-20T19:46:11.372153Z INFO sn_node::log_markers] RecordRejected(e41437(3c9f49aaaab0696b03131cf73adab71acdcbf7e7cb68b3ee6e655f8abc821ca6), Network(GetRecordError(RecordNotFound)))
[2023-12-21T00:04:55.195452Z INFO sn_node::log_markers] RecordRejected(f85528(3ce669ee561079c3acbbc1fb1bd22f5d512189018b4404aa754ec56802b88ded), Network(GetRecordError(NotEnoughCopies { record_key: 75906e(5ea0c509789a185fbc141dd2ba703590ff07ceb9375f7222ee083e7bef28d91e), expected: 5, got: 3 })))
[2023-12-21T00:05:02.898390Z INFO sn_node::log_markers] RecordRejected(f85528(3ce669ee561079c3acbbc1fb1bd22f5d512189018b4404aa754ec56802b88ded), Network(GetRecordError(NotEnoughCopies { record_key: 75906e(5ea0c509789a185fbc141dd2ba703590ff07ceb9375f7222ee083e7bef28d91e), expected: 5, got: 4 })))
[2023-12-21T00:05:11.145929Z INFO sn_node::log_markers] RecordRejected(f85528(3ce669ee561079c3acbbc1fb1bd22f5d512189018b4404aa754ec56802b88ded), Network(GetRecordError(NotEnoughCopies { record_key: 75906e(5ea0c509789a185fbc141dd2ba703590ff07ceb9375f7222ee083e7bef28d91e), expected: 5, got: 4 })))


12D3KooWLYf4pk66N6PqHcU5R7fqFS1bty7qWupJWT15GBKTfGiE
[2023-12-21T07:37:44.770816Z INFO sn_node::log_markers] RecordRejected(8838ff(7854181eb78d4e6e5f5c3925c3a2133b2c41fe3ea7a5904655d4bd220e36c9e8), Network(GetRecordError(RecordNotFound)))
[2023-12-21T07:37:50.274301Z INFO sn_node::log_markers] RecordRejected(8838ff(7854181eb78d4e6e5f5c3925c3a2133b2c41fe3ea7a5904655d4bd220e36c9e8), Network(GetRecordError(RecordNotFound)))
[2023-12-21T07:37:56.279123Z INFO sn_node::log_markers] RecordRejected(8838ff(7854181eb78d4e6e5f5c3925c3a2133b2c41fe3ea7a5904655d4bd220e36c9e8), Network(GetRecordError(RecordNotFound)))

12D3KooWLgwjySUeTxKFbdxSMGdg7SXYsEXLMbejefL9yTJ9Kcb5
[2023-12-20T19:59:20.578089Z INFO sn_node::log_markers] RecordRejected(347015(3dc7fbdf334a2d4ba34f8414e01e92582513ae1dc4665b7d3c8e5969189da0f9), Network(InvalidTransfer("GetRecord Query Error NotEnoughCopies { record_key: 218263(0a5317a576423220b270d95146df90d399dedbeb42a8a95e011a79cb618b3e76), expected: 5, got: 4 }")))


12D3KooWM99cKMj51hvcE1vK2ZeLv4m5qpDQNxCAVpLaY1v7tuxN
[2023-12-21T00:06:20.793944Z INFO sn_node::log_markers] RecordRejected(864bf4(171f9ad3b6f809398f70ea480ac156504c439e85ec6954ce4a2bdc6a2e324ecd), Network(GetRecordError(RecordNotFound)))
[2023-12-21T00:06:27.173413Z INFO sn_node::log_markers] RecordRejected(864bf4(171f9ad3b6f809398f70ea480ac156504c439e85ec6954ce4a2bdc6a2e324ecd), Network(GetRecordError(RecordNotFound)))
[2023-12-21T00:06:35.093483Z INFO sn_node::log_markers] RecordRejected(864bf4(171f9ad3b6f809398f70ea480ac156504c439e85ec6954ce4a2bdc6a2e324ecd), Network(GetRecordError(RecordNotFound)))
[2023-12-21T00:44:26.701877Z INFO sn_node::log_markers] RecordRejected(7b6b4f(174aa15730ec3ba4000e0351279acbabbd3ad44be1d7942fcad8755a78f2cd48), Network(GetRecordError(RecordNotFound)))
[2023-12-21T00:44:31.149037Z INFO sn_node::log_markers] RecordRejected(7b6b4f(174aa15730ec3ba4000e0351279acbabbd3ad44be1d7942fcad8755a78f2cd48), Network(GetRecordError(RecordNotFound)))
[2023-12-21T00:44:37.930076Z INFO sn_node::log_markers] RecordRejected(7b6b4f(174aa15730ec3ba4000e0351279acbabbd3ad44be1d7942fcad8755a78f2cd48), Network(GetRecordError(RecordNotFound)))


12D3KooWNDgtv4bGxEUzR4sBtTPXR9xHqUiXradMkvUtLHQzZXwq
[2023-12-21T08:05:49.802962Z INFO sn_node::log_markers] RecordRejected(f49721(b4eda5bea4f316370f6524acf80aa855d73f92343ecb89999b78f7d4bd775cb8), Network(InvalidTransfer("GetRecord Query Error NotEnoughCopies { record_key: 408201(b58421e29d6f09f06885a945d76004442c57900460e3b5ad0823bdddd8f17856), expected: 5, got: 4 }")))

12D3KooWPQPBHXNJhmKKbLv8BH3aCLUoJPv4LPytY6omkAB4XTUz
[2023-12-20T23:03:40.833905Z INFO sn_node::log_markers] RecordRejected(acee69(d15013fef6179a3ca8c53051d9421a1f964bb50b45274465404fdd6e2876c685), Network(GetRecordError(RecordNotFound)))
[2023-12-20T23:03:51.438452Z INFO sn_node::log_markers] RecordRejected(acee69(d15013fef6179a3ca8c53051d9421a1f964bb50b45274465404fdd6e2876c685), Network(GetRecordError(RecordNotFound)))


12D3KooWQUwJQHCTm45WWCfFActtrVRdDCKJKypkWaoXVAuAB1Kh
[2023-12-21T07:39:53.712700Z INFO sn_node::log_markers] RecordRejected(b169bf(83cbd0a2d435ce650fda053de4a417bd35366b6cf4e95368f3098531bb289a45), Network(GetRecordError(RecordNotFound)))
[2023-12-21T07:39:58.603123Z INFO sn_node::log_markers] RecordRejected(b169bf(83cbd0a2d435ce650fda053de4a417bd35366b6cf4e95368f3098531bb289a45), Network(GetRecordError(RecordNotFound)))
[2023-12-21T07:40:06.713598Z INFO sn_node::log_markers] RecordRejected(b169bf(83cbd0a2d435ce650fda053de4a417bd35366b6cf4e95368f3098531bb289a45), Network(GetRecordError(RecordNotFound)))

12D3KooWRCrcohKefYjwhUWu2jcMG5UL7HBg2WDGy9tGXMEQz28T
[2023-12-20T19:45:55.941925Z INFO sn_node::log_markers] RecordRejected(e41437(3c9f49aaaab0696b03131cf73adab71acdcbf7e7cb68b3ee6e655f8abc821ca6), Network(GetRecordError(RecordNotFound)))
[2023-12-20T19:46:03.062177Z INFO sn_node::log_markers] RecordRejected(e41437(3c9f49aaaab0696b03131cf73adab71acdcbf7e7cb68b3ee6e655f8abc821ca6), Network(GetRecordError(RecordNotFound)))
[2023-12-20T19:46:11.477700Z INFO sn_node::log_markers] RecordRejected(e41437(3c9f49aaaab0696b03131cf73adab71acdcbf7e7cb68b3ee6e655f8abc821ca6), Network(GetRecordError(RecordNotFound)))

12D3KooWRT1449PEW7SsvNfBfxqaVtMkGnFGQsyBSQUTS98VhFCN
[2023-12-20T20:04:32.669041Z INFO sn_node::log_markers] RecordRejected(b5f20b(931d8057a1a6b07cb27b9ffb2a1c3e12f3d006d448e0571e33194e0ee911f367), Network(GetRecordError(RecordNotFound)))
[2023-12-21T00:05:48.341016Z INFO sn_node::log_markers] RecordRejected(9ce835(92d4eaaf3fb832bd978bd9e222b22dbd5f469109890e0019061d14303db242ee), Network(GetRecordError(RecordNotFound)))
[2023-12-21T00:05:54.457783Z INFO sn_node::log_markers] RecordRejected(9ce835(92d4eaaf3fb832bd978bd9e222b22dbd5f469109890e0019061d14303db242ee), Network(GetRecordError(RecordNotFound)))
[2023-12-21T00:06:00.901072Z INFO sn_node::log_markers] RecordRejected(9ce835(92d4eaaf3fb832bd978bd9e222b22dbd5f469109890e0019061d14303db242ee), Network(GetRecordError(RecordNotFound)))

14% of my nodes have this type of error. My 80 Gb disk is at 62% so I have a few hours yet to pull these logs if needed.

@storage_guy nice one-liner :+1:t4:

1 Like
56

Just remember that if the devs implement something that is “fair” to nodes but the wider community is not happy with higher than necessary payments then a mod to the client will be fast incoming to make the client select the cheapest.

So any algorithm must be fair to the user of clients as well otherwise the mod to do what is cheapest will be made and become the defacto normal client.

Remember people will gravitate to the lowest cost for the one product model if all else is the same.

This sounds like a promising path.

Maybe if something else is considered that you always select the node with no earnings if price is same. But then a mod to node code is to say you have no earnings in order to increase your chances of being selected

8 Likes
57

Don’t worry, we;re very aware of this. The algo under testing basically allows nodes to check how many times they’ve been paid. We could potentially expose this to allow operators to choose their tolerance to low pay or some such… But aye, allowing this means if they’re not receiving actual rewards, they can pull their price down (though it’s still grounded in relevant records).

Which means clients can keep on going for the cheapest…

5 Likes
58

You could also mix the approaches, and select nodes randomly after throwing out outliers, something like Interquartile range but between 0th and 75th percentile. But…

Probably there could also be a mod to the node, which would give smaller price, to grab all the client’s requests and earn even more.

1 Like
59

An off topic but I have found that lately the uploads end up damaging my connection through VPN (protonVPN).
At first everything goes fine but after a while the connection slows down to the point of being unusable.
I don’t think it’s my router because if I turn off the VPN or change the VPN server the connection works correctly again.
Does this happen to anyone else?

2 Likes
60

Upload over my mobile broadband hotspot has been unreliable and slow for some time. Only very small uploads succeed, of less than ten chunks. Downloads are much better.

When I leave something uploading it is generally very slow, 1 chunk every two minutes or worse, often much worse.

While this is going on other devices on the same hotspot don’t get a look in. Some things on the uploading computer still work, such as browsing the forum, but loading other websites times out.

IDK but wonder if it takes too many connections and that the forum website keeps one open. I tried batch size 4 but don’t think it helped, though then I was looking more at upload success so I’m not sure if the effect on my connection was unchanged.

4 Likes
61

Yes, would like to have a check on the logs if you carn share them.
Thank you very much.