Upload Checker: Trust, but Verify

latest release is doing us proud I managed to upload the missing chunks and can now download my files again :slight_smile:

I intend to run this checker script daily and post the output.

14 Likes

Have any uploads come back from the dead?

2 Likes

no i had to reupload some missing chunks to get these working again they were uploaded just before the everything everything went a bit sideways for a few weeks. thats why the age is 1 day the counter starts now :slight_smile:

6 Likes

I have a suggestion for the topic name:

Upload Checker: Trust, but Verify

Upload Checker: The Moment of Truth

Upload Checker or Schrödinger’s File

:happyant:


Check out the Impossible Futures!

3 Likes

any one can test these files by running the script direct from the git hub

curl -s https://raw.githubusercontent.com/safenetforum-community/upload-download-and-verify/refs/heads/main/uploads.txt -o uploads.txt && bash <(curl -s https://raw.githubusercontent.com/safenetforum-community/upload-download-and-verify/refs/heads/main/download_and_verify.sh)

4 Likes

second run of the day with some extra files added so far so good :slight_smile:

9 Likes

for those playing with the ant cli you can set these options in ~/.bashrc to increse the upload download speed.

#Settings
export EVM_NETWORK=arbitrum-one
#Uploads
export CHUNK_UPLOAD_BATCH_SIZE=24
export FILE_UPLOAD_BATCH_SIZE=24
export UPLOAD_FLOW_BATCH_SIZE=50
#Downloads
export CHUNK_DOWNLOAD_BATCH_SIZE=30
export MAX_IN_MEMORY_DOWNLOAD_SIZE=30
export STREAM_DECRYPT_BATCH_SIZE=30
1 Like

Can I suggest that mileage will vary depending on the person’s upload speed and router they have.

upload batch size will be affected by both those factors and people may have to find their own limits for their setup. Just a suggestion and warning.

Similar for download but maybe will not have the same impact.

3 Likes

I’m still playing around with them but yea default is 1 :joy:

1 Like

9 bell’s sand all is well :slight_smile:

Did you manage to upload any of these 2 GB files through Dave? I’m struggeling to upload anything larger than 200mb with it.

1 Like

I am using ant cli from command line.

Alright, figured. It seems to be a Dave thing. I tried to run it from my home network, which the home nodes could interfere with. But recently also tried from my mobile hotspot, without success too.

How long does getting a quote take for you for a 2 GB file?

depends on how i set the batch sizes so currently i use upload_flow_batch_size of 50 so it quotes 50 chunks at a time then uploads them.

I am guessing Dave dosent have these settings available at the moment to play with.

Do you (or anyone else) have a quick guide available how to test uploading via ant cli. With the wallet setup etc.

It would help Chriso if I could test this on my connection but I’m not at all familiar with this.

if on linux open your ~/.bashrc and paste in these lines

#Secrets
export WALLET_ADDRESS="<walletaddress>"
export SECRET_KEY="<wallet private key>"
#Settings
export EVM_NETWORK=arbitrum-one
#Uploads
export CHUNK_UPLOAD_BATCH_SIZE=24
export FILE_UPLOAD_BATCH_SIZE=24
export UPLOAD_FLOW_BATCH_SIZE=50
#Downloads
export CHUNK_DOWNLOAD_BATCH_SIZE=15
export MAX_IN_MEMORY_DOWNLOAD_SIZE=15
export STREAM_DECRYPT_BATCH_SIZE=15

close the terminal and reopen it then you can upload with

time ant --network-id 1 file upload -p --no-archive --retry-failed 0 --max-fee-per-gas market linuxmint-22.2-cinnamon-64bit.iso

Most values should be 1 for default

1 Like

Hah! I had to do it on windows, but managed to figure everything out with your help. Cheers! Upload was successful using ant cli so it looks like there is an issue with Dave still. Thanks for helping out

1 Like

Is there an update on the file reachability? Mine seem to be unreachable, unfortunately.

3 Likes

Newly uploaded files?

A combination of both. My old files, unreachable, which was to be expected. 4 other files, varying between 100mb and 600mb a file. uploaded 3 of them last week using Dave 0.4.2 and 1 of which uploaded through ant CLI a few days ago. All of them are unreachable for me.

4 Likes