Update 27th June, 2024

An incremental update this week as we edge towards Wave 2. So not much new to report, just general improvements to key apps, testing and the back end. The long delay experienced on resetting Autonomi Node Launchpad and safenode-manager should be things of the past now. Replication has been tightened up to be less wasteful, we’re looking at reducing node bandwidth, and we’ve moved on to a new version of the DiscordBot ahead of Wave 2.

So lots going on, but not too much to see on the pitch this week (a familiar picture for fans of Scotland, England, France, Italy, Serbia…). Down in the dugout, though, it’s heads down and pencils out as we make fine adjustments and strategise for the next stage. Probably best end the :soccer: analogy there.

Big shout out to @riddim, @neo, @mendrit and everyone else who has been helping people out over on Discord. Thanks for all your efforts guys.

A quick word from @roland for advanced users and devs who want to monitor the health of individual nodes. Rather than scraping the logs directly, you can use the metrics service for this.

Users of safenode-manager can monitor specific nodes by setting --enable-metrics-server during the add command and specifying the port or port range, e.g. --metrics-port 12000-12004, during the add process. You can then monitor the metrics from that port at, for example, http://127.0.0.1:12000/metrics. This feature is also enabled in the Launchpad by default, but you will have to scrape the logs to obtain the URL as you cannot manually set the ports. Look for something like this: ...INFO sn_networking::metrics_service] Metrics server on http://127.0.0.1:12000/metrics]

Performing GET on this URL ( http://127.0.0.1:12000/metrics) will return the node’s metrics in the OpenMetrics format. There are various clients that can parse and analyse this data, which can be used to build a dashboard.

General progress

@jimcollinson has been working on the coordination of an upcoming Network update, which should :crossed_fingers: land early next week. It’ll require a reset of nodes, as we bounce over to an upgraded network. There are quite a few moving parts with this one (so thanks for bearing with us!) but the good news is the transition should be smooth, with little impact to the rewards program, and should improve performance all round!

@bochaco is back after a sabbatical, and he’s got straight to work debugging the self-encryption of small files.

@bzee has been tightening up spend edge cases, testing out scenarios where nodes don’t act as we expect them to. And to aid in all such endeavours, @shu has been steadily improving our dashboards and metrics so we can better see what’s running where.

@chriso has reworked the node registry refresh, which should hopefully fix issues with the node manager and launchpad hanging for long periods of time while refreshing the registry. Basically the refresh process was very slow. In tests it is now super-quick and working well with Linux and Windows. He has also rejigged the status command, which was similarly sluggish.

@joshuef has mostly been working on our internal alpha testing network. He’s also found some problems with the uploader clients, which were running out of space and having problems with wallets stalling.

Digging into that issue, @qi_ma raised a PR to identify and restore such wallets. He also investigated the high traffic we’ve observed over recent testnets. This is non-fatal but suboptimal and slightly mysterious. Qi raised another PR as a first attempt at traffic taming, reducing the frequency of identification communications and avoiding excessive replication.

Over in Discordville, @mazzi deployed a new version of the DiscordBot to improve performance, logging and error handling. We now have a service that grabs the information from the audit service hourly and saves the information into a database. He continued to work on supporting multiple DAGs on the snapshot collector, which is how we are building the leaderboard and rankings.

Meanwhile, @roland raised a PR to display version strings in the Launchpad, and also added some important tests for valid spends.

54 Likes

first!!!

18 Likes

second!

(10 chars)

18 Likes

Third. Now to read.

17 Likes

Here. Ten characters.

20 Likes

Welcome back!

11 Likes

Sixth … Now to subject

11 Likes

I’ve been needing this in my life. I run too many nodes on a server and vdash doesn’t like it. Will absoluetly be giving this a shot. Time for some sed magic and a restart.

Is there a way to use sed magic on this? I created a new node with the flags above, it only adds --metrics-server-port 12000 to the startup service command. New server posts metrics. An existing node with that added to the service file fails to start.
Not sure what I did, but copy pasting from existing working service file and changing node number worked. I obviously fat-fingered something… Carry on.

14 Likes

Could this be the issue that’s been killing me? :pray:

Mini awe Update

While waiting for the hoped for bugfix above…

I spent three days on a one day task :laughing: to script a test page which uploads to a network (local or public) and allows me to check the behaviour is as expected for page navigation and loading resources into pages using different custom protocols, with and without versioning. All that could pass did pass first time which was quite a surprise. :+1:

Today I’ve been exploring a better ‘under the hood’ implementation (iframe → Webview) and have the basics of that working thanks to the awesome support of Fabian at Tauri. Ultimately I hope this will make for a more realistic and possibly more robust demo, but even using an iframe to show content works well enough to show the principle.

Great to see @bochaco back too. A well earned break but you were missed man!

25 Likes

:heart_eyes:
And RAM too please :smiley:

12 Likes

fantastic stuff looking forward to the big upgrade and in particular for the big unveiling of @happybeing’s latest creation :slight_smile:

13 Likes

Thx 4 the update Maidsafe devs

Node bandwidth reduction is great news. Got a new computer and more storage for my nodes.

Thx to all involved

Keep coding/hacking/testing super ants.

11 Likes

Thanks for the update team and your hard work. And as usual, thanks to all in the community for all the efforts you are putting in to support the project.

:sparkler: :fireworks: :man_bowing:

Cheers :beers:

11 Likes

RAM usage seems to be driven by number of connections so I’m not hopeful that bandwidth usage reductions will help directly. Unless they are both driven by the same thing of course.

8 Likes

Very interesting, can the server send metrics like some form of api, so maybe a phone app can be made to observe how the nodes are doing?

7 Likes

The ants are coming

12 Likes

No thank you for building this awesome network, and to all those who chime in answering questions people have.

The one big and I mean big tool that all of us who help would benefit from is one that allows us to request a quote off a peer as a CLI. The number one concern the people needing help is is if their node is connecting correctly. “I have no nanos, is my node working right” and we have to ask questions on how they set it up, blah blah and 1/2 hour later we make a best estimation in many cases, sometimes its certain. But to get a quote from their peer or not get one is a simple yes/no result. At least 30% and upto 60% of cases, they have working nodes.

Please it would help. And I know everyone is busy, so its a “Please Sir can I have my quote cli” :pleading_face:

15 Likes

Thanks so much to the entire Autonomi team for all of your hard work! :muscle: :muscle: :muscle:

And many thanks to all of the testers and mods! :thankyou:

12 Likes