NewYearNewNet [04/01/2024 Testnet] [Offline]

Great to see a new testnet, and feedback so far seems good! Just starting to upload a big file… will see how it goes.

Just to note a small typo in the first comment here:

safe file upload -p [directory/filename]

The ‘s’ is missing after ‘file’. Using file gives an error, as I expect the command should be files.

Great work, and let’s see how this flies :smiley:

10 Likes

trying to upload a 900Mb file with batch size 5

failing with this error :frowning:

sn_cli 0.86.92
🔗 Connected to the Network                                                                  "The Crow (1994).mkv" will be made public and linkable
Starting to chunk "The Crow (1994).mkv" now.
Chunking 1 files...
Uploading 1733 chunks
Error: 
   0: Failed to upload chunk batch: Transfer Error Failed to send tokens due to Wallet has pre-unconfirmed tx, resent them and try later..

Location:
   sn_cli/src/subcommands/files/mod.rs:330

Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.

Logs

upload logs

4 Likes

Have you cleaned out your old ~/.local/share/safe/client ?

I had similar earlier. Interestingly when I went to the faucet first time around, my wallet was incremented by 100 and the balance shown from the previous testnet + 100.
But when I tried to upload, I got a similar error to yours.

Blowing the old ~/.local/share/safe/client away and a quick fill-up from the faucet did the trick.

6 Likes

just had same error on my 40gb upload :frowning:

3 Likes

Exactly the same happened to me too.

3 Likes

And they’re off!!!

upload of
-rw-rw-r-- 1 safe safe 38378760128 Jan 4 18:27 mixtral-8x7b-instruct-v0.1.Q6_K.gguf has commenced.
Lets see how long chunking of 38Gb takes this time.
And then we’ll worry about the upload.

Ooops

Skipping file “/home/safe/mixtral-8x7b-instruct-v0.1.Q6_K.gguf”/PathXorName(“186593626bd3eb91e672a76e3950c8465edccb9d69c024963bb77707407f68ff”) as it could not be chunked: Chunks(SelfEncryption(Io(Os { code: 28, kind: StorageFull, message: “No space left on device” })))
Error:
0: The provided path does not contain any file. Please check your path!
Exiting…

I could have sworn I managed this all in an 80Gb volume previously.
There will be a short delay while I attach a bigger volume…

4 Likes

Yes each new genesis (testnet) makes all previous tokens fakes, so they will not spend.

2 Likes

My old version of this is just under 36gb, and took just over 10 minutes to chunk, which is not a big problem given the time to upload at the moment! Currently chugging along at a not-too-rapid 21 chunks per minute.

7 Likes

Earlier you wrote:

I let it boot - no effect, I started a second session - again it did not boot.

I sent the client logs to your personal messages.

2 Likes

Im getting 18-19 chunks/min

323/73219 so far - lets see what happens when I upload a chunk that you have already got into the network.

2 Likes

IIRC upload order is randomised now so it may take a while.

P.S. you guys remembered to use -p I hope? :man_facepalming:

2 Likes

Am I right in thinking that the datamap is in the uploads directory?

Regardless, how do we download a file uploaded without -p?

3 Likes

safe files upload -p --batch-size 11 ~/mixtral-8x7b-instruct-v0.1.Q6_K.gguf &

I too am interested in how to retreive non-public files.

3 Likes

I see on this testnet we are connecting with 47 peers. The last testnet was 98 peers.
The reduction is welcome but the mystery is why not 96?


Cos any excuse… :slight_smile:

Unfortunately stopped with this error:

0: Failed to upload chunk batch: Transfer Error Failed to send tokens due to Wallet has pre-unconfirmed tx, resent them and try later…

I wondered if I hadn’t cleared out client data sufficiently, so cleared everything again from \AppData\Roaming\safe\client\ but unfortunately hit the same error again.

Same issue as Neik’s I guess.

1 Like

Yep - just noticed mine has failed with the same error

Error: 
   0: Failed to upload chunk batch: Transfer Error Failed to send tokens due to Wallet has pre-unconfirmed tx, resent them and try later..

Location:
   sn_cli/src/subcommands/files/mod.rs:330

I’ll move the logs somewhere safe and restart. Wonder how many chunks it will say it has to upload?
I suppose it would be a smart idea to check with @DavidMc0 and any other potential uploaders just exactly what filename this is saved as and what the checksum is
I renamed the download just for neatness
mv mixtral-8x7b-instruct-v0.1.Q6_K.gguf\?download\=true mixtral-8x7b-instruct-v0.1.Q6_K.gguf

safe@NeerdayNetSouthside01:~/safespace$ md5sum mixtral-8x7b-instruct-v0.1.Q6_K.gguf 
446270ef052e0570d0bdd3bb87f70ca7  mixtral-8x7b-instruct-v0.1.Q6_K.gguf

So I restarted the upload 0/71392 chunks done

Haven’t tried to run a node yet and would like to do it for the first time. However I still see the warning that nodes from home might not be running yet.
What’s the status here? Can I already avoid the cloud?

My main OS is GNU/Linux and I know how to handle port forwarding in the router if that’s needed. In case of positive answer, I might give it a try.

1 Like

Whats the worst that can happen? Go for it :slight_smile:

1 Like

nodes from home are working with port forwarding here is my script for starting and stoping nodes you can have a look at that and see if its of some help

#!/usr/bin/env bash

CLIENT=0.86.90
NODE=0.100.36
FAUCET=134.209.21.136:8000

NODE_PORT_FIRST=4700
NUMBER_NODES=40
NUMBER_COINS=1
NODE_START_DELAY=0

export NEWT_COLORS='
window=,white
border=black,white
textbox=black,white
button=black,white
'

############################################## select test net action

SELECTION=$(whiptail --title "Safe Network Testnet" --radiolist \
"Testnet Actions                              " 20 70 10 \
"1" "Upgrade Client & Node to Latest" OFF \
"2" "Upgrade Client to Latest" ON \
"3" "Stop Nodes" OFF \
"4" "Get Test Coins" OFF \
"5" "Start Vdash" OFF \
"6" "Update all and Restart" OFF \
"7" "Josh comnet" OFF 3>&1 1>&2 2>&3)

if [[ $? -eq 255 ]]; then
exit 0
fi

################################################################################################################ Upgrade Client & Node to Latest
if [[ "$SELECTION" == "1" ]]; then
NUMBER_NODES=$(whiptail --title "Number of Nodes to start" --inputbox "\nEnter number of nodes" 8 40 $NUMBER_NODES 3>&1 1>&2 2>&3)
if [[ $? -eq 255 ]]; then
exit 0
fi

############################## count nodes directories and close fire wall
PORTS_TO_CLOSE=$(ls $HOME/.local/share/safe/node | wc -l)
sudo ufw delete allow $NODE_PORT_FIRST:$(($NODE_PORT_FIRST+$PORTS_TO_CLOSE-1))/tcp comment 'safe nodes'
############################## Stop Nodes and delete safe folder
curl -sSL https://raw.githubusercontent.com/maidsafe/safeup/main/install.sh | bash

pkill -e safenode
rm -rf $HOME/.local/share/safe

rm -rf $HOME/ip_cache.txt
rm -rf $HOME/node_registry.conf
rm -rf $HOME/resources_*.log
rm $HOME/ntracking/*.log
rm -rf $HOME/ntracking/logs
sudo rm /var/www/ntracking/index.html

sleep 2
############################## install client node and vdash
safeup client --version "$CLIENT"
safeup node --version "$NODE"
cargo install vdash
############################## open ports 
sudo ufw allow $NODE_PORT_FIRST:$(($NODE_PORT_FIRST+$NUMBER_NODES-1))/tcp comment 'safe nodes'
sleep 2
############################## start nodes
for (( c=$NODE_PORT_FIRST; c<=$(($NODE_PORT_FIRST+$NUMBER_NODES-1)); c++ ))
do 
   sleep $NODE_START_DELAY && safenode --port $c --max_log_files 10 --max_archived_log_files 0 2>&1 > /dev/null & disown
   echo "starting node on port $c with $NODE_START_DELAY second delay"
   NODE_START_DELAY=$(($NODE_START_DELAY+1))
done
sleep 2

############################# get 200 test coins
for (( c=1; c<=2; c++ ))
do 
   safe wallet get-faucet "$FAUCET"
   sleep 1
done

############################# exit to Vdash
#vdash --glob-path "$HOME/.local/share/safe/node/*/logs/safenode.log"

######################################################################################################################## Upgrade Client to Latest
elif [[ "$SELECTION" == "2" ]]; then
############################## Stop client and delete safe folder
rm -rf $HOME/.local/share/safe/client
# upgrade client and get some Coins
safeup client
sleep 2
safe wallet get-faucet "$FAUCET"

######################################################################################################################## Stop Nodes
elif [[ "$SELECTION" == "3" ]]; then
############################## count nodes directories and close fire wall
PORTS_TO_CLOSE=$(ls $HOME/.local/share/safe/node | wc -l)
sudo ufw delete allow $NODE_PORT_FIRST:$(($NODE_PORT_FIRST+$PORTS_TO_CLOSE-1))/tcp comment 'safe nodes'
############################## Stop Nodes and delete safe folder
pkill -e safenode
rm -rf $HOME/.local/share/safe

rm -rf $HOME/ip_cache.txt
rm -rf $HOME/node_registry.conf
rm -rf $HOME/resources_*.log
rm $HOME/ntracking/*.log
rm -rf $HOME/ntracking/logs
sudo rm /var/www/ntracking/index.html

######################################################################################################################## Get Test Coins
elif [[ "$SELECTION" == "4" ]]; then
NUMBER_COINS=$(whiptail --title "Number of Coins" --inputbox "\nEnter number of deposits 100 each" 8 40 $NUMBER_COINS 3>&1 1>&2 2>&3)
if [[ $? -eq 255 ]]; then
exit 0
fi

for (( c=1; c<=$NUMBER_COINS; c++ ))
do 
   safe wallet get-faucet "$FAUCET"
   sleep 1
done
######################################################################################################################### Start Vdash
elif [[ "$SELECTION" == "5" ]]; then
vdash --glob-path "$HOME/.local/share/safe/node/*/logs/safenode.log"

######################################################################################################################### update and restart
elif [[ "$SELECTION" == "6" ]]; then
rustup update
sudo apt update -y && sudo apt upgrade -y
sudo reboot

############################################################################################################################################# comnet
elif [[ "$SELECTION" == "7" ]]; then
NUMBER_NODES=$(whiptail --title "Number of Nodes to start" --inputbox "\nEnter number of nodes" 8 40 $NUMBER_NODES 3>&1 1>&2 2>&3)
if [[ $? -eq 255 ]]; then
exit 0
fi

############################## count nodes directories and close fire wall
PORTS_TO_CLOSE=$(ls $HOME/.local/share/safe/node | wc -l)
sudo ufw delete allow $NODE_PORT_FIRST:$(($NODE_PORT_FIRST+$PORTS_TO_CLOSE-1))/tcp comment 'safe nodes'
############################## Stop Nodes and delete safe folder
pkill -e safenode
rm -rf $HOME/.local/share/safe
rm -rf $HOME/ntracking/*.log

sleep 2
############################## install client node and vdash and set up comnet  make sure and change download and unzip instructions and peer
cd
mkdir comnet
cd comnet
wget https://comnet-sn.s3.eu-west-2.amazonaws.com/maidsafe/main/safe-beta-x86_64-unknown-linux-musl.tar.gz
wget https://comnet-sn.s3.eu-west-2.amazonaws.com/maidsafe/main/safenode-beta-x86_64-unknown-linux-musl.tar.gz
sleep 1
tar -xvzf safe-beta-x86_64-unknown-linux-musl.tar.gz
tar -xvzf safenode-beta-x86_64-unknown-linux-musl.tar.gz
sleep 1
rm *.gz

cargo install vdash
############################## open ports 
sudo ufw allow $NODE_PORT_FIRST:$(($NODE_PORT_FIRST+$NUMBER_NODES-1))/tcp comment 'safe nodes'
sleep 2
############################## start nodes
for (( c=$NODE_PORT_FIRST; c<=$(($NODE_PORT_FIRST+$NUMBER_NODES-1)); c++ ))
do 
   sleep $NODE_START_DELAY && /home/ubuntu/comnet/safenode --peer /ip4/46.101.5.184/tcp/36301/p2p/12D3KooWBVHdavXJqggn396jQQevJvXtjTN1pwb8YqS65wyitTrx --port $c --max_log_files 2 --max_archived_log_files 1 2>&1 > /dev/null & disown
   echo "starting node on port $c with $NODE_START_DELAY second delay"
   NODE_START_DELAY=$(($NODE_START_DELAY+30))
done
sleep 2

############################# exit to Vdash
vdash --glob-path "$HOME/.local/share/safe/node/*/logs/safenode.log"

fi
4 Likes

I have still have 2 zero earners, dunno if that is worth mentioning, 2 out of 133 to be exact.

4 Likes