DataPaymentNet [26/7/23 Testnet] [Offline]

The wallet is installing, the tap is working, I got 10 DBCs, how about you? :laughing:

I get an error when trying to upload a file to the network - did I enter the wrong path?

5 Likes

You don’t need the “<directory” bit

Should be safe files upload E:\gggg\Pictures\VID...mp4

5 Likes

I managed to save an mp.4 file of 98 MB but I do not think everything is ok.

" Did not store all chunks of file ‘VID_20210505_113014.mp4’ to all nodes in the close group: Network Error Could not retrieve the record after storing it: "

2 Likes

I have seen that error too. Maybe try with a smaller file?

2 Likes

Does anyone know if this will work on a pi4 please?

1 Like

99.9% sure yes. I am running my nodes on something similar without issue.

3 Likes

A small 7 MB file also mp.4 saved without any problem:

PS C:\Users\gggg> safe files upload E:\gggg\Pictures\2021-01\VID-20210114-WA0003.mp4
Built with git version: 1262368 / main / 1262368
Instantiating a SAFE client...
⠄ 0/20 initial peers found.
The client still does not know enough network nodes.
🔗 Connected to the Network
Preparing (chunking) files at 'E:\gggg\Pictures\2021-01\VID-20210114-WA0003.mp4'...
Making payment for 15 Chunks that belong to 1 file/s.
Successfully made payment for 15 Chunks.
Successfully stored wallet with cached payment proofs, and new balance 9.999999791.
Successfully paid for storage and generated the proofs. They can now be sent to the storage nodes when uploading paid chunks.
Storing file 'VID-20210114-WA0003.mp4' of 7097855 bytes (15 chunk/s)..
Successfully stored 'VID-20210114-WA0003.mp4' to 18f253661d1cf33c9c49edd944af54b374b6cfbac82169307e759d3195bd650c
Writing 71 bytes to "C:\\Users\\gggg\\AppData\\Roaming\\safe\\client\\uploaded_files\\file_names_2023-07-26_20-24-05"
3 Likes

I recommend heaptrack myself (on ubuntu at least). It’s supposedly a bit easier to use than valgrind, though potentially not as detailed. it’s been more than enough for us thus far.

5 Likes

When downloading from the network - jpg files saved in previous tests and a large 98MB mp.4 file uploaded to the network today have a “network error” status.

PS C:\Users\gggg> safe files download
Built with git version: 1262368 / main / 1262368
Instantiating a SAFE client...
⠄ 0/20 initial peers found.
The client still does not know enough network nodes.
🔗 Connected to the Network
Trying to download files recorded in uploaded_files folder
Loading file names from index doc "file_names_2023-07-11_15-48-42"
Downloading file "SafeNet.png" with address 89de4a59dc58cad845c64475eda0a3333e5ce778a505116a25bc087844a851d0
Did not get file "SafeNet.png" from the network! Network Error Record was not found locally.
Loading file names from index doc "file_names_2023-07-20_17-34-00"
Downloading file "road_to_freedom.jpg" with address 1f4ec6026f84fdc825d048a25495f4627a1b155746a3c322734ba637afbcc095
Did not get file "road_to_freedom.jpg" from the network! Network Error Record was not found locally.
Loading file names from index doc "file_names_2023-07-26_19-35-58"
Downloading file "VID_20210505_113014.mp4" with address 021fe98b3298470a5f2c4ec106f829eaefb465bcb0f904245e309c4796fc0bb0
Did not get file "VID_20210505_113014.mp4" from the network! Network Error Record was not found locally.
Loading file names from index doc "file_names_2023-07-26_20-24-05"
Downloading file "VID-20210114-WA0003.mp4" with address 18f253661d1cf33c9c49edd944af54b374b6cfbac82169307e759d3195bd650c
Client download progress 14/14
Successfully got file VID-20210114-WA0003.mp4!
Writing 7097855 bytes to "C:\\Users\\gggg\\AppData\\Roaming\\safe\\client\\downloaded_files\\VID-20210114-WA0003.mp4"
2 Likes

Thanks Josh. I posted about using Valgrind on mastodon and someone suggested MIRI which I also tried but doesn’t support inotify. Looks quite nice and easy to run. Valgrind seems quite easy too but will probably look at heaptrack. :pray:

2 Likes

@Shu What are your thoughts about the latest testnet?

3 Likes

Just back from a very physically and emotionally draining trip and very encouraged to see the progress. I will grab a couple of hours kip and read through the thread and dive in myself.
Well done to all who have got us so far and thank you to everyone who has been testing.

laters

11 Likes

Thanks for asking @Knosis . I unfortunately am not getting any PUTs or GETs requests, all it keeps doing is a few events over and over again (this was the case with this current testnet, and the prior MoreStabilityNet), and I am not sure where the problem is (my environment or not).

Note: I didn’t really change anything except running safeup instructions. I didn’t even restart the LXC container for days on end:

safe-build-122:/tmp/safe_logs/node-6# uptime
 19:45:57 up 40 days, 18:50,  0 users,  load average: 0.41, 0.48, 0.69

The only errors I see are connection closed with num_established = 0:

[2023-07-26T19:28:45.080972Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/176.62.229.135/tcp/12203/p2p/12D3KooWNSocxLmvpfBM4UYVXwUH7XaqckuUspJkhrmUYpb7VLuv) peer_id=12D3KooWNSocxLmvpfBM4UYVXwUH7XaqckuUspJkhrmUYpb7VLuv connection_id=ConnectionId(24169) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:28:45.587769Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/161.35.171.99/tcp/35477/p2p/12D3KooWD9HkamanBA19AQnGdv2tEZSPJTqydEA84s5W41YWaWaN) peer_id=12D3KooWD9HkamanBA19AQnGdv2tEZSPJTqydEA84s5W41YWaWaN connection_id=ConnectionId(24174) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:28:46.607151Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/143.110.169.118/tcp/40905/p2p/12D3KooWKH77XbGL1LwWHCPEavHEFBJWqEsZ5hD9pmtd1qZKbKQ7) peer_id=12D3KooWKH77XbGL1LwWHCPEavHEFBJWqEsZ5hD9pmtd1qZKbKQ7 connection_id=ConnectionId(24179) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:28:46.608584Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/134.122.96.155/tcp/40415/p2p/12D3KooWJxggCM6KVgViGQKovCVWDS1ahJBQ98KyFbhr48rno8ce) peer_id=12D3KooWJxggCM6KVgViGQKovCVWDS1ahJBQ98KyFbhr48rno8ce connection_id=ConnectionId(24176) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:28:46.610001Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/142.93.34.76/tcp/36689/p2p/12D3KooWLQ9NMAg93Qyt3jLvUFPDCVhpL3nE1LJm7HBJ4Jzp4eYR) peer_id=12D3KooWLQ9NMAg93Qyt3jLvUFPDCVhpL3nE1LJm7HBJ4Jzp4eYR connection_id=ConnectionId(24177) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:07.627006Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/142.93.34.76/tcp/37567/p2p/12D3KooWLtdFHmvof7tm4jnhaiKRhXShuDR9g2jNik3NZbVtQEvW) peer_id=12D3KooWLtdFHmvof7tm4jnhaiKRhXShuDR9g2jNik3NZbVtQEvW connection_id=ConnectionId(24186) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:07.627562Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/142.93.42.92/tcp/42853/p2p/12D3KooWKsPKyJyXpSVnj23KFVJf51SefozY7kSD31YY9sXBqohH) peer_id=12D3KooWKsPKyJyXpSVnj23KFVJf51SefozY7kSD31YY9sXBqohH connection_id=ConnectionId(24188) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:07.627692Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/142.93.34.76/tcp/46449/p2p/12D3KooWJb6GbdANYXZDbwSMztDRMtDAaTa5dAX7oBv9UZfgNA1D) peer_id=12D3KooWJb6GbdANYXZDbwSMztDRMtDAaTa5dAX7oBv9UZfgNA1D connection_id=ConnectionId(24190) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:07.627800Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/178.62.66.188/tcp/34647/p2p/12D3KooWB8y2Bw3cPMSHPsxzTwtaSHL7Jk6VYNkjD3cpaKiTqC89) peer_id=12D3KooWB8y2Bw3cPMSHPsxzTwtaSHL7Jk6VYNkjD3cpaKiTqC89 connection_id=ConnectionId(24191) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:07.627900Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/167.99.199.20/tcp/44399/p2p/12D3KooWPYpCTu7bitAYe7YLffciTmdBn4qco3JmeE4vmE7NejYC) peer_id=12D3KooWPYpCTu7bitAYe7YLffciTmdBn4qco3JmeE4vmE7NejYC connection_id=ConnectionId(24192) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:07.628079Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/142.93.42.92/tcp/40517/p2p/12D3KooWQACR45wKDkmPUDYVuXdQighd42pZMzewQ7xA7wGuTwXh) peer_id=12D3KooWQACR45wKDkmPUDYVuXdQighd42pZMzewQ7xA7wGuTwXh connection_id=ConnectionId(24197) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:07.628276Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/167.99.195.200/tcp/34047/p2p/12D3KooWPVGUpTtqnLVtayJqL3HathA62h2drEHYkUTP3zznj1wb) peer_id=12D3KooWPVGUpTtqnLVtayJqL3HathA62h2drEHYkUTP3zznj1wb connection_id=ConnectionId(24185) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:07.634787Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/142.93.34.193/tcp/35377/p2p/12D3KooWNPg4w2ZE445t5hbugkBAJwgWbbzFZ5wNJEmumfL7niVj) peer_id=12D3KooWNPg4w2ZE445t5hbugkBAJwgWbbzFZ5wNJEmumfL7niVj connection_id=ConnectionId(24196) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:07.635586Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/142.93.34.193/tcp/40957/p2p/12D3KooWFDuWBA5eGCnCS8EvE5rBZWReBvgBKzuW9nTbX6j89BbC) peer_id=12D3KooWFDuWBA5eGCnCS8EvE5rBZWReBvgBKzuW9nTbX6j89BbC connection_id=ConnectionId(24194) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:07.638804Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/68.183.45.46/tcp/42361/p2p/12D3KooWMJayEcPeFTkYAniBKaHXsMTN2wnWThisLZ8gjm5zoEiQ) peer_id=12D3KooWMJayEcPeFTkYAniBKaHXsMTN2wnWThisLZ8gjm5zoEiQ connection_id=ConnectionId(24193) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:07.644077Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/142.93.34.193/tcp/35551/p2p/12D3KooWAwbaQs33xJ6nWxYwyoiQyS3v2F6uZ8o2zXr6JNf6nPR2) peer_id=12D3KooWAwbaQs33xJ6nWxYwyoiQyS3v2F6uZ8o2zXr6JNf6nPR2 connection_id=ConnectionId(24189) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:07.644735Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/167.99.199.20/tcp/36819/p2p/12D3KooWLCvaJ9zzg33qr7hCymYFpEk57H8QX8XW5VUaZJ39v9Pt) peer_id=12D3KooWLCvaJ9zzg33qr7hCymYFpEk57H8QX8XW5VUaZJ39v9Pt connection_id=ConnectionId(24187) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:07.649230Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/167.99.195.200/tcp/37473/p2p/12D3KooWApQa4n4Egc227ssahXHuLHH31hkek8jav1owSsknFijm) peer_id=12D3KooWApQa4n4Egc227ssahXHuLHH31hkek8jav1owSsknFijm connection_id=ConnectionId(24195) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0
[2023-07-26T19:29:08.329452Z DEBUG sn_networking::event] ConnectionClosed: outgoing (/ip4/142.93.42.92/tcp/37815/p2p/12D3KooWSGZKaVwWgsvbqVJEqMpVFe21p1KPcHxQZ5LYx5gLE1cm) peer_id=12D3KooWSGZKaVwWgsvbqVJEqMpVFe21p1KPcHxQZ5LYx5gLE1cm connection_id=ConnectionId(24198) cause=Some(IO(Custom { kind: Other, error: Error(Closed) })) num_established=0

Safenode version:

safe-build-122:/tmp/safe_logs/node-6# safenode --version
safenode cli 0.87.1

Quick grep on aggregated safenode logs shows 1000s of ConnectionClosed as is, :frowning: :

safe-build-122:/tmp/safe_logs/node-6# cat safe.log | grep -i "Chunk"
safe-build-122:/tmp/safe_logs/node-6# cat safe.log | grep -i "PUT "
safe-build-122:/tmp/safe_logs/node-6# cat safe.log | grep -i "GET "
safe-build-122:/tmp/safe_logs/node-6# cat safe.log | grep -i "error" | grep -i "ConnectionClosed"  | wc -l
23523

[2023-07-26T10:51:49.517014Z INFO sn_node::log_markers] NodeConnectedToNetwork

It says it connected to the network, but either way, clearly its not doing some of other more exciting events, as I would have expected, :frowning: . Anyone able to reproduce this on a LXC Alpine container (behind a NAT with NAT port forward rules set on the router)?

safe-build-122:/tmp/safe_logs/node-6# cat /etc/os-release 
NAME="Alpine Linux"
ID=alpine
VERSION_ID=3.17.0
PRETTY_NAME="Alpine Linux v3.17"
HOME_URL="https://alpinelinux.org/"
BUG_REPORT_URL="https://gitlab.alpinelinux.org/alpine/aports/-/issues"
``
6 Likes

This feels like a bit of a watershed moment!

Preparing (chunking) files at '1000x1KB'...

Making payment for 1004 Chunks that belong to 1001 file/s.

Successfully made payment for 1004 Chunks.

Successfully stored wallet with cached payment proofs, and new balance 9.999998995.

Successfully paid for storage and generated the proofs. They can now be sent to the storage nodes when uploading paid chunks.

Storing file '1KB_457' of 1024 bytes (1 chunk/s)..

Successfully stored '1KB_457' to 0012edc8070a252d0c2b2c6d85020bbdc0269aa6cd2bd122c5b90c11d38809de

Storing file '1KB_443' of 1024 bytes (1 chunk/s)..

Successfully stored '1KB_443' to 0030c1a85e61f1c96a5bd723d626feaa8558d71c21442aa7d10eb4552ce21254

Storing file '1KB_803' of 1024 bytes (1 chunk/s)..

etc

I can’t believe the pace of progress at the moment! :dizzy:

12 Likes

Thanks for the feed back! :pray:

5 Likes

It should run no problem. I have OrangePi PC (similar HW, just older) with latest Raspbian and everything works nicely.

7 Likes

Does anyone know if a brief loss of connectivity will affect the a node.
Will it reestablish the connection.

Not at home, storm caused a 2 minute outage.
Nodes and router are on UPS but of course I haven’t got around to the ONT yet.

@bzee is this your department :hugs:

5 Likes

I’m on :partying_face: (still no node) did we find out how to send the dbc that is created?

scott@scott-desktop:~$ safe wallet send 1.2345 b1a8c9c878d8f59c6c7c0d96db57a870e6cdbcf189086974210c38349b728c939448c5758dba906786a559e67f0b4bf0
Built with git version: 1262368 / main / 1262368
Instantiating a SAFE client...
⠂ 0/20 initial peers found.                                                     The client still does not know enough network nodes.
🔗 Connected to the Network                                                     Sent Token(1234500000) to PublicAddress(PublicKey(11a8..d8b5))
Successfully stored wallet with new balance 8.765500000.
Successfully stored new dbc to wallet dir. It can now be sent to the recipient, using any channel of choice.

4 Likes

We’ve not tested this thoroughly yet, but it’s a very interesting topic. I guess in theory, the node should just reconnect, but it might take a while as other nodes have detected the disconnect.

4 Likes

Thanks, will post what happened later :crossed_fingers:

3 Likes