The nodes have all been running for hours but none of them has gained any nano. Why?
2 of them have been shunned few times and 8 are connected
1 Like
Anybody got a clue what I should do next?
willie@gagarin:~/safespace/node$ sudo /home/willie/.local/bin/safenode-manager reset
=================================================
Reset Safenode Services
=================================================
WARNING: all safenode services, data, and logs will be removed.
Do you wish to proceed? [y/n]
y
=================================================
Stop Safenode Services
=================================================
Error:
0: missing field `home_network` at line 1 column 494
Location:
/home/runner/work/safe_network/safe_network/sn_node_manager/src/cmd/node.rs:339
Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.
willie@gagarin:~/safespace/node$ sudo /home/willie/.local/bin/safenode-manager home_network reset
error: unrecognized subcommand 'home_network'
Usage: safenode-manager [OPTIONS] <COMMAND>
For more information, try '--help'.
willie@gagarin:~/safespace/node$ sudo /home/willie/.local/bin/safenode-manager --home_network reset
error: unexpected argument '--home_network' found
Usage: safenode-manager [OPTIONS] <COMMAND>
For more information, try '--help'.
willie@gagarin:~/safespace/node$
sn-node-manager 0.7.5-alpha.3
Pretty sure - - home-network is only for “add” so it knows to use the flag when it starts the node. Reset I would imagine doesn’t take any arguments. Try just reset?
Edit: ignore this. I missed the command on the first line. *doh! *
Try sub command first, then flags.
Reset --home-network
1 Like
safenode-manager add --home-network
safenode-manager start
instant chunkers for 1 node
After a reset on manager, I had to install alpha.5 in order to upload from home
Latest version of safe is 0.91.0-alpha.5
Current version of safe is 0.91.0-alpha.4
sadly no…
willie@gagarin:~/safespace/node$ /home/willie/.local/bin/safenode-manager reset --home-networ
error: unexpected argument '--home-network' found
maybe do a stop first?
1 Like
same problem.
willie@gagarin:~/safespace/node$ sudo !!
sudo /home/willie/.local/bin/safenode-manager stop
[sudo] password for willie:
=================================================
Stop Safenode Services
=================================================
Error:
0: missing field `home_network` at line 1 column 494
Location:
/home/runner/work/safe_network/safe_network/sn_node_manager/src/cmd/node.rs:339
Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.
willie@gagarin:~/safespace/node$ safenode-manager -V
sn-node-manager 0.7.5-alpha.3
Location:
/home/runner/work/safe_network/safe_network/sn_node_manager/src/cmd/node.rs:339
Im chucking it for tonight, we’ll see whats new tomorrow.
1 Like
Are these “old” nodes and new safenode manager?
See PunchNet [24/04/24 Testnet] - #77 by chriso
Did you tear down fully (including node registry) and restart with new version?
1 Like
2 hours of uptime, nodes behind a NAT:
Error count seems a bit higher than before but haven’t had a chance to dig in yet. Fantastic job team. Hole punching has been on the wishlist for many years and it’s awesome to see it happening!
EDIT:
Digging in a bit. This is a new error for me, and seems to make up about 20% of my errors - resource limit exceeded.
This machine has 20 nodes and plenty of headroom. Not sure what it’s referring to.
/var/log/safenode/safenode9/safenode.log:[2024-04-26T02:13:24.051814Z WARN sn_networking::event] OutgoingConnectionError to PeerId("12D3KooWC5f9zgwvZpCGauK3HWLSDpZpSKRBKRQHKmuENWPbB8ma") on ConnectionId(13474) - Transport([("/ip4/165.227.239.118/udp/57961/quic-v1/p2p/12D3KooWRnuha9Fj92TASSJoKVg6kAX3rM3MVpX927qyKSAhEeNX/p2p-circuit/p2p/12D3KooWC5f9zgwvZpCGauK3HWLSDpZpSKRBKRQHKmuENWPbB8ma", Other(Custom { kind: Other, error: Left(Left(Left(ResponseFromBehaviourCanceled(Canceled)))) })), ("/ip4/142.93.43.67/udp/37334/quic-v1/p2p/12D3KooWGZwo5MbV9h5J9mVkegUShLo1xnejuJ2FVvrCfDVARBNx/p2p-circuit/p2p/12D3KooWC5f9zgwvZpCGauK3HWLSDpZpSKRBKRQHKmuENWPbB8ma", Other(Custom { kind: Other, error: Left(Left(Left(Connect(ResourceLimitExceeded)))) })), ("/ip4/167.71.132.8/udp/47239/quic-v1/p2p/12D3KooWAVDdZQrMuPhNjdVTc6udb2UgWSE6BC6YAL2sqHZrbuUS/p2p-circuit/p2p/12D3KooWC5f9zgwvZpCGauK3HWLSDpZpSKRBKRQHKmuENWPbB8ma", Other(Custom { kind: Other, error: Left(Left(Left(Connect(ResourceLimitExceeded)))) })), ("/ip4/173.66.211.98/udp/53239/quic-v1/p2p/12D3KooWC5f9zgwvZpCGauK3HWLSDpZpSKRBKRQHKmuENWPbB8ma", Other(Custom { kind: Other, error: Right(Custom { kind: Other, error: Custom { kind: Other, error: HandshakeTimedOut } }) }))])
/var/log/safenode/safenode9/safenode.log:[2024-04-26T02:13:24.052077Z ERROR sn_networking::event] OutgoingTransport error : Other(Custom { kind: Other, error: Left(Left(Left(Connect(ResourceLimitExceeded)))) })
/var/log/safenode/safenode9/safenode.log:[2024-04-26T02:13:24.052092Z ERROR sn_networking::event] OutgoingTransport error : Other(Custom { kind: Other, error: Left(Left(Left(Connect(ResourceLimitExceeded)))) })
mav@safe-01:~$ egrep "esource" /var/log/safenode/safenode*/*.log | wc -l
12428
Another new and interesting error I’m seeing quite a few of - I think specifically the unexpected EOF ones:
/var/log/safenode/safenode9/safenode.log:[2024-04-26T03:08:55.599051Z ERROR sn_networking::event] IncomingConnectionError from local_addr:?"/ip4/142.93.43.67/udp/37334/quic-v1/p2p/12D3KooWGZwo5MbV9h5J9mVkegUShLo1xnejuJ2FVvrCfDVARBNx/p2p-circuit", send_back_addr "/p2p/12D3KooWJUTDtpZW9EJqLXxLq8pwqnjmEMQdXGw9YjHJVMVvKmb2" on ConnectionId(18897) with error Transport(Other(Custom { kind: Other, error: Left(Left(Right(Select(Failed)))) }))
/var/log/safenode/safenode9/safenode.log:[2024-04-26T03:08:55.683921Z ERROR sn_networking::event] IncomingConnectionError from local_addr:?"/ip4/142.93.43.67/udp/37334/quic-v1/p2p/12D3KooWGZwo5MbV9h5J9mVkegUShLo1xnejuJ2FVvrCfDVARBNx/p2p-circuit", send_back_addr "/p2p/12D3KooWJRSeCZLVVQKXnvxKiSkYiHaVMPxHeMKb3nszuFYgVNtY" on ConnectionId(18928) with error Transport(Other(Custom { kind: Other, error: Left(Left(Right(Select(Failed)))) }))
/var/log/safenode/safenode9/safenode.log:[2024-04-26T03:09:08.141668Z ERROR sn_networking::event] IncomingConnectionError from local_addr:?"/ip4/134.209.187.32/udp/60124/quic-v1/p2p/12D3KooWG8FA96P5PTZttNuQR3RYXvF5p3cB4jrD3FzKxbhSvGWZ/p2p-circuit", send_back_addr "/p2p/12D3KooWKJJExQsZWjtzN4k6cpKBByJuSJscKx6zYhsHgsqUsbb4" on ConnectionId(19040) with error Transport(Other(Custom { kind: Other, error: Left(Left(Right(Apply(Io(Custom { kind: UnexpectedEof, error: "eof" }))))) }))
mav@safe-01:~/download$ egrep "IncomingConnectionError" /var/log/safenode/safenode*/*.log | wc -l
11423
3 Likes
Chunking 65036 files…
Splitting and uploading into 197225 chunks
Error:
0: Failed to upload chunk batch: The maximum specified repayments were made for the address: 34e730(00110100)…
Error:
0: Failed to upload chunk batch: The maximum specified repayments were made for the address: 722b64(01110010)…
Some new files hitting the net. Great PDF / book on the pi pico (fantastic devices) and some 3d models:
“RPi_PiPico_Digital_v10.pdf” 24d3d06e553de6fed0a5ce87535610f808f3d415b0ccaf6e20c7d17a31f9a9b0
“Hex_Holder__3551184.zip” f23b52c230ce3eb3be2495ace0b90eb89900fe338e41f3e8755ecd18b2622789
“medieval-castle-model_files.zip” 3119016001d4e1e1d674204765caa6ec0fad081a6973f62e09b94531bc33f980
Just to clarify, are nodes started from cloud without the --home-network not meant to get any chunks/rewards?
Because that’s the case for me, home node getting rewards, the others not.
Mm
safe files download “RPi_PiPico_Digital_v10.pdf” 24d3d06e553de6fed0a5ce87535
610f808f3d415b0ccaf6e20c7d17a31f9a9b0
Logging to directory: "/home/ubuntu/.local/share/safe/clie
nt/logs/log_2024-04-26_04-10-24"
Built with git version: 15b2690 / alpha-punch / 15b2690 /
2024-04-24
Instantiating a SAFE client...
Trying to fetch the bootstrap peers from https://sn-testne
t.s3.eu-west-2.amazonaws.com/alpha-punch-network-contacts
Connecting to the network with 51 peers
🔗 Connected to the Network
Downloading "“RPi_PiPico_Digital_v10.pdf”" from 24d3d06e55
3de6fed0a5ce87535610f808f3d415b0ccaf6e20c7d17a31f9a9b0 wit
h batch-size 16
Error downloading "“RPi_PiPico_Digital_v10.pdf”": Network
Error GetRecord Query Error RecordNotFound.
Second one worked though
safe files downloa
d “Hex_Holder__3551184.zip” f23b52c230ce3eb3be2495ace0b90e
b89900fe338e41f3e8755ecd18b2622789
Logging to directory: "/home/ubuntu/.local/share/safe/clie
nt/logs/log_2024-04-26_04-13-34"
Built with git version: 15b2690 / alpha-punch / 15b2690 /
2024-04-24
Instantiating a SAFE client...
Trying to fetch the bootstrap peers from https://sn-testne
t.s3.eu-west-2.amazonaws.com/alpha-punch-network-contacts
Connecting to the network with 51 peers
🔗 Connected to the Network
Downloading "“Hex_Holder__3551184.zip”" from f23b52c230ce3
eb3be2495ace0b90eb89900fe338e41f3e8755ecd18b2622789 with b
atch-size 16
Saved "“Hex_Holder__3551184.zip”" at /volume1/“Hex_Holder_
_3551184.zip”
1 Like
95MB in 20 minutes
Made payment of NanoTokens(116627) for 432 chunks
Made payment of NanoTokens(20355) for royalties fees
hmmmm - did you make it public when uploading?
doesn’t even start to download anything for me
or is this because i’m running nodes on a different pc in the same network?
1 Like
Again this error:
Error:
0: Failed to upload chunk batch: The maximum specified repayments were made for the address: 4c416d(01001100)…
This time I have the logs…
Logs.zip (2.5 MB)
3 Likes
I think we could also store the network’s protocol version alongside the wallet. So we don’t end up using a wallet on a different network.
7 Likes
Looking at the code, it seems like there is a /.safe folder created inside the folder that you’re tying to sync. Maybe can you try removing that?
if you are needing to do a hard reset after upgrading safenode manager
#!/usr/bin/env bash
# stop nodes
# nuke safe node manager services
for i in {1..100}
do
# your-unix-command-here
sudo systemctl disable --now safenode$i
done
sudo rm /etc/systemd/system/safenode*
sudo systemctl daemon-reload
sudo rm -rf /var/safenode-manager
sudo rm -rf /var/log/safenode