Routers for advanced setups

You did very well with Vdash, you stepped up and did the work, that is amazing.

I am just trying to understand if the nodes are working well and what the cause might be if they are suffering. Hopefully Autonomi team will add some low cpu usage metrics to show if nodes are healthy, earned nanos and such.

1 Like

You could pass a path to vdash for one or a few (say 20) nodes and just check those.

1 Like

To set a path range sounds good, how to do that? Would it look like example
vdash ā€œ$HOME/.local/share/safe/node/safenode1/logs/safenode.logā€-ā€œ$HOME/.local/share/safe/node/safenode20/logs/safenode.logā€

No, you could just pass individual paths one after the other. bash can do it more effectively but don’t know exactly what that would look like without messing about.

3 Likes

Maybe it’s because I have not wiped my old nodes during upgrade. I am seeing a factor of 2x on upstream.
Probably it will be better to start with fresh nodes…

I have split my two ISPs, one for home networking, one for autonomi/homelab. Best move ever - I am getting so many compliments now, about how responsive the home network has become. :slight_smile:

I have upgraded my router (a dedicated UDM-PRO MAX) with plenty of CPU (50%) and memory, and upgraded my ISP. Unfortunately, doubling ISP bandwidth does not always translate in doubling the number of connections. Now I am probably ISP-limited; a problem with ISP’s equipment, the ONT maybe. That’s as far as I am going to get utilizing my ā€œspare resources.ā€

3 Likes

A warning can be put in the vdash thread, I confirm the observations of @tobbetj


Privacy. Security. Freedom

3 Likes

I’ve added a note to the vdash OP. :+1:

6 Likes

A post was merged into an existing topic: Assemble at the Start Line. The Beta is About to Begin

What about this one for $649 with 32GB RAM

They are reselling generic chinese boxes, you can find it under SZBox, Topdon and other brands.
https://www.aliexpress.com/item/1005006026499800.html
You can probably find real manufacturer on Alibaba and have it made with your name/logo on it if you want.

Specifications look good, but noise/heat/thermal throttling on full load you will hate to try, I wasn’t able to find solid review.

2 Likes

Hey so I got my mikrotik rb5009 router setup I just have it on the default settings pretty much just plugged it in put my modem in bridge mode and started 150 nodes but my internet now is a bit bogged down, the cpu on my router is only at 15% and I think I should be able to run like 500 nodes through this router is there any settings I need to mess around with to get this router to handle more nodes?

Can anyone tell me approximately how many nodes I can handle with a router that delivers 30,000 simultaneous connections. I have plenty of everything else like a 1.5 fibre connection, etc. I’m effortlessly running 20 nodes from home now. I would like to run more. Any help is welcome, thanks

1 Like

Rough estimate is 500 connections per node so around 60 nodes.

3 Likes

Great info thanks I’ll give it a try.

What is the upload bandwidth of your internet link. That is the first thing to check.

You say the internet is bogged down. How are you measuring this metric? By other machines plugged into the router or your own PC response?

You could look into the concept of ā€˜DMZ Host’ … a machine placed in this slot gets exposed directly to all incoming traffic…and negates the requirement to port forward.

I’m doing this with my lowly 2 core netcomm as a last resort to receive chunks without --home-network, alas I had many peers but zero data.

So I continue with DMZ Host, but with --home-network …this, together with disabling logging gets me 50 nodes (thin client) whilst maintaining stable internet/ Kayo (sports streaming) on a 20Mbs uplink.

End of month I upgrade to a massive 40mbs uplink…so more headroom.

1 Like

well my connection is cutting in and out. and I’m seeing it on my own pc which is plugged into the router (all my devices are plugged into the router and I have no wifi atm)

My connect speed is slower than normal dl is about 500 mbps (should be 8-900) and my ul is 85mbps (should be over 100)

Following @Josh’s suggestion that udp-timeout be changed to 30s to match what nodes do I had a look at this and other settings available.

udp-timeout
The default is 10s which it was still set to. That doesn’t seem like a lot.

udp-stream-timeout
The default is 3 mins which it was still set to. That seems like a lot.

I think that one is potentially the more relevant one for nodes.

So what I’ve done is set both:-
udp-timeout
udp-stream-timeout

to 40s. I don’t want to set them to exactly 30s and a node ever has to establish a connection again for something it was still using. There doesn’t seem to be much penalty to an extra 10 seconds.

Changing udp-timeout from 20s to 40s made no difference at all.

Changing udp-stream-timeout from 3 mins to 40s has made a huge difference to the number of connections open on the router. For running 10 nodes it has gone down from between 8 to 10k to 2 to 3K. There has been no apparent change to the behaviour of nodes and no increase in the error rate.

Just for a laugh I set both udp-timeout and udp-stream-timeout to 1s. The number of connections went down to 1.8k to 2k for the 10 nodes as expected. It seemed that there were more errors but not a huge amount more.

So it looks like connections are established and used for a bit and the router keeps them in the NAT table for an unnecessary amount of time if udp-stream-timeout is higher than 40s so that’s the figure I’ve settled on for both.

I think it’s bandwidth rather than number of connections that is holding me back from being able to run more nodes but I’ll be putting that to the test!

I wonder what the setting for udp-stream-timeout is on consumer routers? I wonder if they’d be able to handle more if the setting can be changed?

It could be a highly ironic situation where a consumer grade or carrier supplied router would be able to handle more nodes if the udp-stream-timeout could be reduced so it’s not overloaded with keeping unused connections open but it can’t because that setting is not changeable. So you need an over specced router like the MikroTik RB5009 to be able to change the setting. But a router like that can handle the increased number anyway…

5 Likes

hey I’m having what i think is the same issue as yours where do you change those settings? Do you mess with it in winbox or somewhere else?