[ValentinesNet] [14/2/24 Testnet] [Offline]

I just shut down vps 6 and vps 15 and guess what?

the upload that was failing by 4 chunks went up straight away.

"linuxmint-21.2-mate-64bit.iso" d239d34f77f73f4dc60ef3e8a12ffc87ded440dd886536d5aaaea0b2c15e2963
Among 4 chunks, found 0 already existed in network, uploaded the leftover 4 chunks in 19 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of 0.000005267 for 4 chunks
Made payment of 0.000000926 for royalties fees
New wallet balance: 99.999201231
ubuntu@safe-hamilton:~/safe/images$

5 Likes

Yeah, I don’t even have all my machines powered up and am certainly running less than I could.

I do monitor my connection and thus far the 70ish I run doesn’t do a whole lot to it.

2 Likes

My 2 diffcult chunks still don’t find a taker. :neutral_face:

How many node you have or had total? How many were closed now?

I had about 800 there minus 80 from the two vps I just shut down

4 Likes

I have 4 nodes that are not receiving any records.
Ill kill them too and see if @Toivo finds a home for his chunks.

If it is individual nodes throwing spanners in the works, what is the solution?

FYI @neik all 4 were on the same machine. hmmm seems something rhymes here.

Edit: :man_facepalming: never mind the 4 that were not getting records had already been killed. moving on :laughing:

6 Likes
Downloading "Springsteen.zip" from e680de86debc1c15a23728dc2775fe19831884ec35efada11c5161454fb61f6a with batch-size 16
Error downloading "Springsteen.zip": Chunks error Chunk could not be retrieved from the network: 6be1be(01101011)...

Seems that bigger files are failing to download.

2 Likes

just fired up ubuntu iso no bother.

Chunking 1 files...
Uploading 9412 chunks
ā ’ [00:11:15] [#######################################>] 9397/9412                                                                                Retrying failed chunks 14 ...
ā ™ [00:11:45] [#######################################>] 9411/9412                                                                                Retrying failed chunks 0 ...
**************************************
*          Uploaded Files            *
**************************************
"ubuntu-23.04-desktop-amd64.iso" 80d88c666263718d9ee271acdf38710065d4cc235837eed7fa7314f0a53d8080
Among 9412 chunks, found 0 already existed in network, uploaded the leftover 9412 chunks in 11 minutes 45 seconds
**************************************
*          Payment Details           *
**************************************
Made payment of 0.017611038 for 9412 chunks
Made payment of 0.003103305 for royalties fees
New wallet balance: 99.978486888

2 Likes

How are the nodes organized on that line? Are they XOR -neighbours?

Might be in the eye of beholder, but seems to me, that for both of the holes the graphs taper down from the left to the hole, and then shoot up sharply on the right.

No cigar…

But I found that there are no

Did not get a valid response in my logs, but there were

When paying 1 chunks, got error CouldNotSendMoney("Wallet has pre-unconfirmed transactions. Resend, and try again.")

Got new wallet, and it worked!

I wish there was an error message in CLI that would tell what was going on!

2 Likes

You may try a download with smaller batch size.
I failed to download my 2 GB file with batch_size 16,
but then succeeded with batch_size 8

5 Likes

Punishment - not implemented while trying to find bugs in node code.

3 Likes

Actually it is that mis-performing nodes will be removed from routing tables in the other nodes.

My understanding from the talk is that there is no mechanism for punishment since there is no sections, elders, age etc

2 Likes

That did the trick! Had to go down to 3 for one file.

2 Likes

And my understanding is that it is difficult task. Who gets to decide when node is not performing well enough and should get booted?

Indeed, punishment (by shunning) isn’t necessarily easy. That will be a very interesting phase of testing.

To answer you question, other nodes decide. Exactly how they decide to drop a neighbour and how effective that will be is going to be tricky and interesting to study.

5 Likes

Yeah I think clients cannot be trusted in their evaluation of nodes. Could become an attack. Maybe nodes should make requests from each other somewhat randomly and then somehow vote.

@josh can answer better but the nodes are arranged in the bar graph but VPS number then inside that VPS by the order they start.

So the black gaps was all on one vps if you want a look at them up close check out NTracking

2 Likes

Yes this is correct.

2 Likes

0.3 SNT for 7.34GB (5KB files) - 158,668 chunks >25hrs
0.03 SNT for 9.0GB (single file) - 17,602 chunks > 146mins

Big disparity here.

7 Likes

Definitely. A massive one.

But from what has been said it is basically that when a node is not receiving responses from another node then that other node is removed from its routing table. Not receiving responses could also include too many erroneous replies.

So it will be individual nodes that decide independently and when enough nodes have removed that node then its effectively removed from the network. As David says its a probabilistic network.

What levels of error or lack of response will trigger that removal will be tricky, but I’d say not too much.

The honest node that loses responses from other nodes (ie being shunned) will have the more difficult task of knowing when to restart in order to see if that fixes its problems.

The bad actor node rightly gets shunned.

6 Likes

Let me see if I can help to spread some light on this

So its 158,668 x 5/3KB chunks uploaded.

  • 5/3KB due to self encryption splitting into at least 3 chunks
  • 158,668 * 5/3 ==> 264MB
    • either the average file size is a lot more than 5KB or the 7.34GB is wrong or the number of chunks is wrong
    • 7.34GB ==> 7.34GB / 158,668 ==> 46.26K per chunk and 138.7K per file.
  • there is 158,668 requests for costs waiting for responses from different places around the world
    • Lets say 100mS average for a response to return for each prices check (used fr rest of analysis)
      • that is up to 4.4 hours overall just for price checking
  • there is 158,668 * 2 (317,336 payments (node pay & royalty pay)
    • Lets say its the 100mS for each. That is > 4.4 hours and < 8.8 hours for sending payments
  • there is 158,668 * 5 (793,340) data store requests in batches of 10 chunks (50 data stores) . Assume a degree of async occurs
    • that is effectively 15,867 lots. Each lot will be >100mS since can still only send one packet at a time
      • assume 1 second for the 50 data store requests (1 block of chunks).
      • that is 15,867 seconds (4.4 hours)

And that is on a good day

For the 9GB file - 17,602 chunks

  • 1/2 MB per chunk approx
  • 17,602 price checks
    • 1760 seconds at 100mS each ==> approx 30 minutes
  • 17,602 * 2 payments
    • time is >30 minutes and < 60 minutes.
  • data uploads in batches of 10 chunks (50 uploads)
    • time is >30 minutes for all (plus extra for link upload times which now is not insignificant compared to the approx 50K)
    • assume 40Mbps upload speed (achieve 6MB/s) gives about 25MB/6MBps (4 seconds) per block
    • 1760 blocks * 4 seconds ==> >120 minutes instead of >30 just because of the data to be uploaded.
    • I don’t know your upload speeds, so it may take less if you have faster.

Its not so bad when you break it down and perhaps any differences is down to when the upload occurred because of the changing layout of this tiny network and all the churning happening at different rates. This churning rate can vary massively in this tiny testnet

As for the cost, it is quite close to being right since the payment is per chunk.

6 Likes