ThePriceIsRightNet [14/08/23 Testnet] [Offline]

Development Releases
102

I’m running my script that uploads batches of 100 1MB random files and the uploads have really slowed down the last few hours.

It was previously taking about 40 minutes to upload the files. For the last 12 hours or so it’s been taking about 3 hours to upload them.

I’ve only ever seen a cost of 4 or 8 tokens per record. But maybe those blips up to 16 tokens per record were too brief for me to catch. I think what I’ll do next is write something that will just upload 1 random file to get much better resolution data on the cost over time.

6 Likes
103

On most of today’s uploads the cost has been 8 except for the last one which has risen to 16.

BTW. Yesterday, on some uploads, I got the familiar error:

Network Error Could not retrieve the record after storing it

Once a file gives that error it seems to always do it every time you try to re-upload it.

My upload speed is around 140KB/sec although the initial connection to the network is quite slow.

3 Likes
104

Update regarding my two nodes:
#1 with 40 hours of uptime: at 24 hours mark it got bunch of records (~132) and slowly getting more since then (182 right now).
#2 with 24 hours of uptime: have 0 records. I decided not to wait more and stop it, because it uses its own console window, which is not convenient for me.

6 Likes
105

@joshuef explained this further up the thread. Try altering one bit of the file and re-uploading it - which is a faff but may be instructive.

106

Just anecdotal until I verify this a few times…

When uploading, it seems to start off well with good upload speed, then slows down and I get a LOT of incoming traffic and only when that slackens does the upload rate increase…

image
image1528×887 84.7 KB

Getting charged 8 tokens/chunk on this

willie@gagarin:~$ SN_LOG=all safe files upload ~/Videos/cooking/madhur/madhur.jaffrey\'s.flavours.of.india.episode.01.avi 
Built with git version: aba95fb / main / aba95fb
Instantiating a SAFE client...
🔗 Connected to the Network                                                                                                   Loaded wallet from "/home/willie/.local/share/safe/client/wallet" with balance Token(99999976754)
Preparing (chunking) files at '/home/willie/Videos/cooking/madhur/madhur.jaffrey's.flavours.of.india.episode.01.avi'...
Making payment for 703 Chunks that belong to 1 file/s.
Successfully made payment of 5624 for 703 records. (At a cost per record of Token(8).)
Successfully stored wallet with cached payment proofs, and new balance 99.999971130.
Successfully paid for storage and generated the proofs. They can now be sent to the storage nodes when uploading paid chunks.
Storing file 'madhur.jaffrey's.flavours.of.india.episode.01.avi' of 358941706 bytes (703 chunk/s)..
9 Likes
107

Screenshot_20230816_053711
Screenshot_20230816_0537111440×2124 130 KB

1 Like
108

more evidence of the client getting flooded with msgs during upload.
I cannot do other internet stuffs on this box right now, my connection is saturated

image
image1528×887 80.2 KB

EDIT: Its like you are telling someone about some subject and a great deal of info has to be transferred. THen they start asking questions, looking for confirmationand the volume of the responses causes you to be unable to continue imparting the info. The responses become a flood and you are effectively silenced. Only when they pause for breath can you return to delivering the requested info. - or something like that…

I have logging turned on so if/when this upload completes, I will have a look at the logs - but I suspect quic is getting VERY chatty about something.

image
image1528×887 94 KB

9 Likes
109

tcp. we’re not using the quic transport yet as it does not provide reliable autonat :frowning:

8 Likes
110

OK - do you want these logs? It seems the same pattern repeats every 2 mins or so…

I will adjust the graph to show a 20-30min window to see if indeed the pattern repeats reliably with different files. But certainly have seen similar over past day or two.

Also - despite kicking this off a good while back, I have seen ZERO confirmation of any blocks stored - or is that only for downloads for now?

image
image1535×452 128 KB

3 Likes
111

Yeh, send them over please :bowing_man:

3 Likes
112

Errr err - where are the client logs stored? I cant see them in $HOME/.local/share/safe/client

I ran the command with SN_LOG=all safe files upload ~/Videos/cooking/madhur/madhur.jaffrey\'s.flavours.of.india.episode.01.avi

1 Like
113

Hmm, it may be that there’s more bugs in the storage/verification flow here. We’re reworking the naiive implementation at the moment to avoid some issues this testnet has raised. (If the testnet isn’t working well I’ll perhaps just can it; we’ve learnt a good deal from this already).

6 Likes
114

Before you bring it down is there any point in stopping the upload and grabbing the latest from GitHub?

I see there are new releases…

115

What’s gone in today/yesterday isn’t super helpful.

Once feat(client): do not use cached proofs by joshuef · Pull Request #644 · maidsafe/safe_network · GitHub is merged, reuploading should get files up at the new price, so that mayyy sort some issues. But the pricing is still network avg, which is likely the main thing we’re facing here…

And then we’ve a couple of breaking changes going in soon, so at that point we’ll have to start fresh anyway.

7 Likes
116

Any idea why I am getting so much traffic down when I am trying to upload?
Or am I interpreting this wrongly?

117

I suspect it’s the validation trying to download, and that’s failing but it’s looping. If you’ve a lot of chunks, it’ll be doing that for each.

if you run no-verify do you see similar traffic levels?

2 Likes
118

oops - clumsy editing

with the -n flag the command completed suspiciously quickly

willie@gagarin:~$ SN_LOG=all time safe files upload -n ~/Videos/cooking/madhur/madhur.jaffrey\'s.flavours.of.india.episode.03.avi 
Built with git version: aba95fb / main / aba95fb
Instantiating a SAFE client...
🔗 Connected to the Network                                                                                                                                                                                                                                          Loaded wallet from "/home/willie/.local/share/safe/client/wallet" with balance Token(99999959962)
Preparing (chunking) files at '/home/willie/Videos/cooking/madhur/madhur.jaffrey's.flavours.of.india.episode.03.avi'...
Making payment for 705 Chunks that belong to 1 file/s.
Successfully made payment of 5640 for 705 records. (At a cost per record of Token(8).)
Successfully stored wallet with cached payment proofs, and new balance 99.999954322.
Successfully paid for storage and generated the proofs. They can now be sent to the storage nodes when uploading paid chunks.
Storing file 'madhur.jaffrey's.flavours.of.india.episode.03.avi' of 360133404 bytes (705 chunk/s)..
Successfully stored 'madhur.jaffrey's.flavours.of.india.episode.03.avi' to 62901265b7a2caf437983ddedb9d1adc90d6581d15521f40914da87fc95017ad
Writing 97 bytes to "/home/willie/.local/share/safe/client/uploaded_files/file_names_2023-08-16_12-47-24"
12.87user 5.62system 1:12.54elapsed 25%CPU (0avgtext+0avgdata 760132maxresident)k
703392inputs+11264outputs (0major+1654581minor)pagefaults 0swaps
willie@gagarin:~$ safe files download madhur.jaffrey’s.flavours.of.india.episode.03.avi 62901265b7a2caf437983ddedb9d1adc90d6581d15521f40914da87fc95017ad
Built with git version: aba95fb / main / aba95fb
Instantiating a SAFE client...
🔗 Connected to the Network                                                                                                                                                  Downloading file "madhur.jaffrey’s.flavours.of.india.episode.03.avi" with address 62901265b7a2caf437983ddedb9d1adc90d6581d15521f40914da87fc95017ad
Did not get file "madhur.jaffrey’s.flavours.of.india.episode.03.avi" from the network! Network Error Record was not found locally.

As I suspected… Network Error Record was not found locally


willie@gagarin:~$ safe files download madhur.jaffrey’s.flavours.of.india.episode.03.avi 62901265b7a2caf437983ddedb9d1adc90d6581d15521f40914da87fc95017ad
Built with git version: aba95fb / main / aba95fb
Instantiating a SAFE client...
🔗 Connected to the Network                                                                                                                                                  Downloading file "madhur.jaffrey’s.flavours.of.india.episode.03.avi" with address 62901265b7a2caf437983ddedb9d1adc90d6581d15521f40914da87fc95017ad
Did not get file "madhur.jaffrey’s.flavours.of.india.episode.03.avi" from the network! Network Error Record was not found locally.
119

@joshuef

with SN_LOG=all safe files upload where can I find the logs? I’m failing here…

find -newermt '8 hours ago'|grep .log is not showing anything that could be a testnet log.

1 Like
120

you need --log-output-dest=data-dir and it’ll print out the location

1 Like
121

So in effect SN_Log=all without a --log-output-dest=data-dir param will do zilch?

I may need to withdraw my offer of these logs, sorry…

OK what should this command be?

willie@gagarin:~$ SN_LOG=all time safe files upload -n --log-output-dest=data-dir   ~/Videos/cooking/madhur/madhur.jaffrey\'s.flavours.of.india.episode.04.avi 
error: unexpected argument '--log-output-dest' found

  tip: to pass '--log-output-dest' as a value, use '-- --log-output-dest'

Usage: safe files upload -n <DIRECTORY>

For more information, try '--help'.
Command exited with non-zero status 2
0.00user 0.00system 0:00.00elapsed 100%CPU (0avgtext+0avgdata 4352maxresident)k
0inputs+0outputs (0major+323minor)pagefaults 0swaps

Sorry, Im feeling particularly dumb today.