ReduceConnectionsNet [ 06/12/23 Testnet] [Offline]

I started 8 nodes and they were all chugging along for 2 hours or so, but are now slowly dying one by one with the NAT error. Is NAT really the problem or are they dying for another reason? Since I have the ports forwarded and they worked for a while, I suspect maybe another reason?

8 Likes

I am currently running 80 nodes behind NAT and single public IP. I never had nodes dying with the NAT error, but anything is possible - it could be some setting or stupid limitation in the router or bug in firmware.

Is the computer connected over cable or wifi? Could be wifi loosing connection for brief moments.

5 Likes

They are dying cos of the NAT error. AIUI, these nodes never really connected to the network. Sure they got a list of peer addresses and did all the local setup but after 5-10 mins of apparent normal activity it comes back with the NAT error.

I hope we can get over/around this soon as it is very frustrating and is a serious impediment to community testing.

EDIT - just read your post more carefully. You say you had some running for 2 hours before an error? That’s new.

Can you look in ~/.local/share/safe/node/12K…blah…/record_store/ and see if anything got stored?

4 Likes

Yes, and the nodes that died with NAT error seemed to have rewards wallet balance, which I assume means they were indeed connected for a while at least. I am on a wired connection to the router.

Logging to directory: "/home/tom/.local/share/safe/client/logs/log_2023-12-06_12-56-19"
Built with git version: 93a9010 / main / 93a9010
Node's rewards wallet balance (PeerId: 12D3KooWAtcXzctGEK57t2StahB2kBKjG68w9zfVt8KAZXsyN9Qd): 0.000000035
5 Likes

Chunking 1 files…
Input was split into 211 chunks
Will now attempt to upload them…
Uploaded 211 chunks in 77 minutes 45 seconds


  •      Payment Details           *
    

Made payment of 0.000007060 for 211 chunks
Made payment of 0.000001137 for royalties fees


  •      Uploaded Files            *
    

“iceicebaby.mp4” f7cbbf6883bd404fcb814deb2fd9ca6ef90557dd626d1404fdfad010a757fce8

If anyone wants to grab it… its NSFW.

EDIT: Tried to self download

Client (read all) download progress 1/210
Client (read all) download progress 2/210
Client (read all) download progress 3/210
Client (read all) download progress 4/210
Client (read all) download progress 5/210
Client (read all) download progress 6/210
Client (read all) download progress 7/210
Client (read all) download progress 8/210
Error downloading “iceicebaby.mp4”: Chunks error Chunk could not be retrieved from the network: 079626(00000111)…

3 Likes

Going to put my neck on the line, this one is going to outlive all predecessors!

Connections are way more reasonable and for the first time in recent tests it looks like memory is flat.

I have always been able to see a slight climb by now, if it is not fixed it is significantly better.

:raised_hands:

My apologies if I jinxed it :rofl:

…flat!..

16 Likes

Same here …

1 Like

I’ve had success uploading in the past from both home and cloud, but home is hitting problems:

Chunking 58 files...
Input was split into 82 chunks
Will now attempt to upload them...
**************************************
*              Failures              *
**************************************
Failed to pay for 2 chunks with:
[
    Transfers(
        CouldNotSendMoney(
            "Could not get enough peers (5) to satisfy the request, found 4",
        ),
    ),
    Transfers(
        CouldNotSendMoney(
            "No Store Cost Responses",
        ),
    ),
]
Failed to upload 82 chunks with:
[]
Uploaded 82 chunks in 6 minutes 56 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of 0.000000000 for 82 chunks
Made payment of 0.000000000 for royalties fees
New wallet balance: 300.000000000
**************************************
*          Uploaded Files            *
**************************************

I’m repeating the upload and will update this when it finishes.

Second attempt managed to pay but still failing…

Starting to chunk "safe-dash" now.
Input was split into 82 chunks
Will now attempt to upload them...
**************************************
*              Failures              *
**************************************
Failed to pay for 1 chunks with:
[
    Transfers(
        CouldNotSendMoney(
            "Could not get enough peers (5) to satisfy the request, found 4",
        ),
    ),
]
Failed to upload 64 chunks with:
[]
Uploaded 82 chunks in 6 minutes 42 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of 0.000000569 for 82 chunks
Made payment of 0.000000090 for royalties fees
New wallet balance: 299.999999341
**************************************
*          Uploaded Files            *
**************************************
"post-update.sample" efa7027103d6cb6a0fbcc3ef6e105afbe7fd6cab612ea844181af2fc29c4b4e9
"commit-msg.sample" f86a15da47642ae89116913f5355a61ad88e2cd620e655de242e1937a4d90720
"master" d4947df4fd1fdd1018e7868dedcc37b8ecb597d4518d428b0c7915c830aad352
"pre-applypatch.sample" 65f9d51279f4774ac9d35c211b768cd6a37aa866136963e4d8412bb50abdfadc
"704aae16098814f75ee351d9a5161b69286978" fc3d59ea2b5e11e8316b651ae6c0c3e0389d4b98bd3bffb278df7d1a1c09aec9
"5c8d7296aac4631f33c392903243ad62ecb436" 2fda080816b9f5cbb810bedcf247fa8c4c7f02fc4a80d5d12dc0e8afe9665b78
"prepare-commit-msg.sample" 50fa5437d83918c07255ac91c63ee9a0c2f4500c24ea6baade18bfe4340a6c9f
"applypatch-msg.sample" 9c3f4859e52fa7bb8ffd8fe308df64af41a84e767d6167278e9effd22afcd797
"master" 0bd018a252ef6adbb0ce66a52a2beb1d2dcb9477c21dd104f2a224fb6bcfe4d0
"56d17f8351c3ee35fc9e64b31da9e679e53881" 625dea85e51c1535892751f9fd5a481c9168e91a91376c9052cf6f111496d8cd
"53e513a559b207ded2b2127967889c6498c3c1" b3b69eee802191b95c03b1743b74341a1824aac34aaece491ccfc617cd41aacd
"event.rs" bf9983cc6608bc0c6f3a252aacb5c59aa94b619dacacaddbd31aaf80819a28c7
"ecf3e1a027bb10dc35f901df708ac083615456" cb9b5a29167cb729b91a3c74653769191966242239b86d32968d6f05af139eda
"HEAD" e48a49ba10e35a6e4213b46572aadccbfe6be7b02991f2545aac09c89f95ae5f
"26b3a9b2a3cb77ec43f30be4062bb66dfb9d11" 4844571f761d7e9c9eff8113c2247c2518eda46d079e027c0ba9c727c41cd33c
"664a569a567663285bc53e5c8b686e17551b30" 27f72359c5a8405e2fdc57366409087114e78c2994b5a9cd053e05d10583fb08
"1c8a48a8c2d7f61bac7d57cae9cb7731eda3ea" 25c3f522c2901b9767d5babf9805daad981d93b7b171fb7107cdc4d12464a430

Third time…

Complete failure although the error message is contradictory saying both it uploaded and failed to upload:

Starting to chunk "safe-dash" now.
Input was split into 64 chunks
Will now attempt to upload them...
**************************************
*              Failures              *
**************************************
Failed to pay for 1 chunks with:
[
    Transfers(
        CouldNotSendMoney(
            "Could not get enough peers (5) to satisfy the request, found 0",
        ),
    ),
]
Failed to upload 64 chunks with:
[]
Uploaded 64 chunks in 5 minutes 1 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of 0.000000000 for 64 chunks
Made payment of 0.000000000 for royalties fees
New wallet balance: 299.999999341
**************************************
*          Uploaded Files            *
**************************************
"post-update.sample" efa7027103d6cb6a0fbcc3ef6e105afbe7fd6cab612ea844181af2fc29c4b4e9
"commit-msg.sample" f86a15da47642ae89116913f5355a61ad88e2cd620e655de242e1937a4d90720
"master" d4947df4fd1fdd1018e7868dedcc37b8ecb597d4518d428b0c7915c830aad352
"pre-applypatch.sample" 65f9d51279f4774ac9d35c211b768cd6a37aa866136963e4d8412bb50abdfadc
"704aae16098814f75ee351d9a5161b69286978" fc3d59ea2b5e11e8316b651ae6c0c3e0389d4b98bd3bffb278df7d1a1c09aec9
"5c8d7296aac4631f33c392903243ad62ecb436" 2fda080816b9f5cbb810bedcf247fa8c4c7f02fc4a80d5d12dc0e8afe9665b78
"prepare-commit-msg.sample" 50fa5437d83918c07255ac91c63ee9a0c2f4500c24ea6baade18bfe4340a6c9f
"applypatch-msg.sample" 9c3f4859e52fa7bb8ffd8fe308df64af41a84e767d6167278e9effd22afcd797
"master" 0bd018a252ef6adbb0ce66a52a2beb1d2dcb9477c21dd104f2a224fb6bcfe4d0
"56d17f8351c3ee35fc9e64b31da9e679e53881" 625dea85e51c1535892751f9fd5a481c9168e91a91376c9052cf6f111496d8cd
"53e513a559b207ded2b2127967889c6498c3c1" b3b69eee802191b95c03b1743b74341a1824aac34aaece491ccfc617cd41aacd
"event.rs" bf9983cc6608bc0c6f3a252aacb5c59aa94b619dacacaddbd31aaf80819a28c7
"ecf3e1a027bb10dc35f901df708ac083615456" cb9b5a29167cb729b91a3c74653769191966242239b86d32968d6f05af139eda
"HEAD" e48a49ba10e35a6e4213b46572aadccbfe6be7b02991f2545aac09c89f95ae5f
"26b3a9b2a3cb77ec43f30be4062bb66dfb9d11" 4844571f761d7e9c9eff8113c2247c2518eda46d079e027c0ba9c727c41cd33c
"664a569a567663285bc53e5c8b686e17551b30" 27f72359c5a8405e2fdc57366409087114e78c2994b5a9cd053e05d10583fb08
"1c8a48a8c2d7f61bac7d57cae9cb7731eda3ea" 25c3f522c2901b9767d5babf9805daad981d93b7b171fb7107cdc4d12464a430

And the above keeps repeating with each retry.

3 Likes

I’ve had this when there were network issues. (Yes, I’m behind a NAT but with a port forwarding rule). I think some issue with connectivity makes the node think it is NAT related so kills it and says that is why.

4 Likes

Out of all the nodes I started this morning, all died except the very fist one, coincidence?

3 Likes

I started 66 right at the start, all behind NAT.
None have died.

Do you have each on a different port?

5 Likes

Did you start them all with --port=9999? Cos that would lead to problems…
Each node needs its own port.

5 Likes

Each had different port. The very first one was actually on port 7878 which I randomly picked. That one is still up and running. The other eight were on 12001-12008. Maybe it’s something about that port range :thinking:

2 Likes

Oh yes, of course! I already forward ports 10000-20000 to another computer LOL - that must have been it. User error.

6 Likes

Users huh! Oh, and AIs :rofl:

2 Likes

A little game for anyone who is desperately bored.

"guess.html" a208ac0e6a1bd009cee9b0d41cdb798153fc4d231bde4af372fbd62cea3d1c78

4 Likes

Snarky little sh*t isn’t it? And it failed to congratulate me properly for guessing in 4. Not playing any more. I miss the days of 2048

5 Likes

Well deserving of a comeback!

Midway through a buck bunny upload, I dont seem to have upload issues. :crossed_fingers:

Edit:

Is it too late to add a caveat to my earlier prediction :joy: memory is doing great, but that sneaky chunk error is back.

Error downloading "bunny.mp4": Chunks error Chunk could not be retrieved from the network: 0d6c4e(00001101)...
6 Likes

I don’t understand. How many replicas of a chunk does this mean then? Two?

What’s the aim of this change?

5 Likes

Hosaka says no in any case:

Client (read all) download progress 940/1004
Client (read all) download progress 941/1004
Error downloading "Neuromancer.mp4": Chunks error Chunk co
uld not be retrieved from the network: e32c62(11100011)

Many positives, but what’s the explanation for these missing chunks?
Data integrity is crucial…

3 Likes