Kind of. On 1 of my nodes running at home. But it’s actually now gone huge now!
I have quite a spread of Storage Costs at the moment:-
AWS Instance - starttime 2023-09-24 morning
9811
Home 1 - starttime 2023-09-22 afternoon
12068
(That’s the one with the dip but then the big increase - screenshot above)
Home 2 - starttime 2023-09-22 afternoon
482844!
That one has a wallet balance of 0.028973577 so I don’t want to mess with it now because it’s making me rich! 
Bah - large upload failed with
Uploaded chunk #43e5e3.. in 15 seconds
Error:
0: Chunks error Failed to get find payment for record: de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8.
1: Failed to get find payment for record: de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8
Location:
sn_cli/src/subcommands/files.rs:297
I’ve kept the client logs if useful
Lines in safe.log that mention that record
[2023-09-25T17:27:34.469534Z INFO sn_networking] Getting record of de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8 attempts 1/1
[2023-09-25T17:27:45.685597Z INFO sn_networking::event] Query task QueryId(12787) NotFound record de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8 among peers [PeerId(“12D3KooWGTPj5JoAChhoZ1GoiSwmm7nFNtAoMCVQ4z53teER4dYa”>
[2023-09-25T17:30:04.849996Z TRACE sn_client::api] Getting store cost at NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8), with tolerance of 1.5 times the cost
[2023-09-25T17:30:18.783228Z DEBUG sn_networking] send_and_get_responses for Query(GetStoreCost(NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8)))
[2023-09-25T17:30:18.784029Z DEBUG sn_networking] Got response for the req: Query(GetStoreCost(NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8))), res: OutboundError(D>
[2023-09-25T17:30:18.784065Z DEBUG sn_networking] Got response for the req: Query(GetStoreCost(NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8))), res: OutboundError(D>
[2023-09-25T17:30:18.784089Z DEBUG sn_networking] Got response for the req: Query(GetStoreCost(NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8))), res: OutboundError(D>
[2023-09-25T17:30:18.784112Z DEBUG sn_networking] Got response for the req: Query(GetStoreCost(NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8))), res: OutboundError(D>
[2023-09-25T17:30:18.784137Z DEBUG sn_networking] Got response for the req: Query(GetStoreCost(NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8))), res: OutboundError(D>
[2023-09-25T17:30:19.324099Z DEBUG sn_networking] Got response for the req: Query(GetStoreCost(NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8))), res: Query(GetStoreC>
[2023-09-25T17:30:19.380492Z DEBUG sn_networking] Got response for the req: Query(GetStoreCost(NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8))), res: Query(GetStoreC>
[2023-09-25T17:30:19.774379Z DEBUG sn_networking] Got response for the req: Query(GetStoreCost(NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8))), res: Query(GetStoreC>
[2023-09-25T17:30:19.836845Z DEBUG sn_networking] Got response for the req: Query(GetStoreCost(NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8))), res: Query(GetStoreC>
[2023-09-25T17:30:19.836878Z DEBUG sn_networking] Received all responses for Query(GetStoreCost(NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8)))
[2023-09-25T17:30:19.837039Z WARN sn_client::wallet] Cannot get store cost for NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a87408cb8) with error CouldNotSendMoney("Network E>
[2023-09-25T17:31:04.081076Z TRACE sn_client::file_apis/get_local_payment_and_upload_chunk] Client upload started for chunk: NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb6a874>
[2023-09-25T17:31:09.074094Z WARN sn_client::file_apis/get_local_payment_and_upload_chunk] Failed to get payment proof for chunk: NetworkAddress::ChunkAddress(de47d5(11011110)… - - de47d5e80e72f8ff8c2ba5871b5530446b165ae28e8b150a59ccbb>
Yesterday I was testing how long it is possible to have a node disconnected from the network and it still recover and be fine. I’d been thinking it would be just a couple of minutes so was increasing the time I had the node’s network interface down by a few seconds each time and giving it time to recover in between each test.
Then today I accidentally disconnected everything in the house from the internet for more than an hour while trying to tidy up some cabling… 
Both home based nodes came back absolutely fine and are getting records again. This is good news.
There’s no mechanism in place for punishing nodes yet so I think this will change.
It’s an interesting question, how long can a node ‘misbehave’ before it is ostracised. Too short and to many good notes are lost, too long and to many bad nodes remain.
That seems very good as it would allow for breaks for ISP maintenance, updating OS and such. 
Only 7 of my 57 nodes got chunks; they have been running for a long time, almost since the start.
Timestamp: Mon Sep 25 21:43:05 EDT 2023
Number: 0
Node: 12D3KooWHtrxfjv5j9oNcAaMcyq7W3qEGysnSBJCyLE4bvXWpq81PID: 177043
Memory used: 17.5469MB
CPU usage: 0.0%
File descriptors: 670
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:05 EDT 2023
Number: 1
Node: 12D3KooWCfxHUvUqre6p3dW3cFP7NkfPDVFc6dxmVW37qfWh6hVsPID: 176749
Memory used: 15.9492MB
CPU usage: 0.0%
File descriptors: 439
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:06 EDT 2023
Number: 2
Node: 12D3KooWLaqmfSrwhxr9HVAUqF5xBbCeQtKkxq6EJHYZ46H1XKiwPID: 176845
Memory used: 16.0938MB
CPU usage: 0.0%
File descriptors: 516
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:06 EDT 2023
Number: 3
Node: 12D3KooWAzo4YFuYbBDufzWXozdX9eqn65G2kyDozhdEF8ZuPBNxPID: 176997
Memory used: 17.375MB
CPU usage: 0.0%
File descriptors: 635
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:06 EDT 2023
Number: 4
Node: 12D3KooWHfz7a71N5kCGMVokGckndabj9Lf1PMZRFRfiR5Joh2SZPID: 176829
Memory used: 16.6055MB
CPU usage: 0.0%
File descriptors: 502
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:06 EDT 2023
Number: 5
Node: 12D3KooWLYuh5qiSjpfusoR1vaNPYry3x212TNdXm75LshYdr7xdPID: 176961
Memory used: 16.5625MB
CPU usage: 0.0%
File descriptors: 607
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:06 EDT 2023
Number: 6
Node: 12D3KooWRenuQr8VUXqvWe9xrAMFGfEkfnsSjnCQHoURWCCNKAfEPID: 176791
Memory used: 16.457MB
CPU usage: 0.0%
File descriptors: 474
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:06 EDT 2023
Number: 7
Node: 12D3KooWJMv3SE5TjWaNV8YcmqpBH5ap4ePZQ4B4LdQWLZVY7GTXPID: 176813
Memory used: 16.543MB
CPU usage: 0.0%
File descriptors: 490
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:07 EDT 2023
Number: 8
Node: 12D3KooW9tQMthCjFR6s6aCkUR4j2d4Jq7F9qQb4DNobVevVPDPDPID: 176725
Memory used: 16.1523MB
CPU usage: 0.0%
File descriptors: 425
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:07 EDT 2023
Number: 9
Node: 12D3KooWEXF5E9bBWGs48gXyYTPeixAEuWMSU4GNnB6F7BN6pUk8PID: 176915
Memory used: 15.8594MB
CPU usage: 0.0%
File descriptors: 572
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:07 EDT 2023
Number: 10
Node: 12D3KooWMxaCaLDGVad4naVSQyNHdT5o7qCrKFaLpD5PVJUtLnisPID: 176861
Memory used: 16.2188MB
CPU usage: 0.0%
File descriptors: 530
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:07 EDT 2023
Number: 11
Node: 12D3KooWBRPvMW1QxLyvfJmzhq3meCXZ9xugx4L6UMdnw8UHmghGPID: 177027
Memory used: 17.5117MB
CPU usage: 0.0%
File descriptors: 656
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:07 EDT 2023
Number: 12
Node: 12D3KooWRSxA9fXstf5M1jQdT3RzEZEGV8FPgmF5nEEb1GH1qEkQPID: 173585
Memory used: 99.4336MB
CPU usage: 1.7%
File descriptors: 986
Records: 335
Disk usage: 130MB
Rewards balance: 0.000336360
------------------------------------------
Timestamp: Mon Sep 25 21:43:07 EDT 2023
Number: 13
Node: 12D3KooWSLqDCZiZS9Pz8WSptuGqMyTRBUDtfDqgWoQeMnqWgSiSPID: 176709
Memory used: 16.0156MB
CPU usage: 0.0%
File descriptors: 411
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:08 EDT 2023
Number: 14
Node: 12D3KooWNhjQuVu9Zt1rAwTgoUFCYk2G8c4wc8ZZVdyLpRJerM7VPID: 177005
Memory used: 17.5234MB
CPU usage: 0.0%
File descriptors: 642
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:08 EDT 2023
Number: 15
Node: 12D3KooWG3yVNp6JDYxvr3T4mD4hdHAKXKD9EZA3iGcYf1Sa6cHrPID: 176257
Memory used: 15.6875MB
CPU usage: 0.0%
File descriptors: 341
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:08 EDT 2023
Number: 16
Node: 12D3KooWMiDNT9vzuQT2gepUo6DJbP9epiRpxUQHAhWdm2UmvfYxPID: 173579
Memory used: 86.918MB
CPU usage: 1.4%
File descriptors: 944
Records: 311
Disk usage: 126MB
Rewards balance: 0.000121038
------------------------------------------
Timestamp: Mon Sep 25 21:43:08 EDT 2023
Number: 17
Node: 12D3KooWBWJJS5aiJgqGd7ZiykNc3uFuxh8X3x6hgiAE3CVXDg6ePID: 176673
Memory used: 15.9688MB
CPU usage: 0.0%
File descriptors: 383
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:08 EDT 2023
Number: 18
Node: 12D3KooWAheVV1EReLzv7RVeAbFZ5WQvvUGBjXVRrjGf653rsAFuPID: 176923
Memory used: 16.6602MB
CPU usage: 0.0%
File descriptors: 579
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:08 EDT 2023
Number: 19
Node: 12D3KooWRn2rZSPXfLx6d2bKBYcXtnGiYAEuXSLLbQ2BiXe9oX3WPID: 176783
Memory used: 16.2852MB
CPU usage: 0.0%
File descriptors: 467
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:09 EDT 2023
Number: 20
Node: 12D3KooWMtBQqfGDQibMCkpuuTxMUUpvP7a2FahHYpPCAQTSPd1PPID: 173561
Memory used: 117.363MB
CPU usage: 2.1%
File descriptors: 1087
Records: 596
Disk usage: 228MB
Rewards balance: 0.001010632
------------------------------------------
Timestamp: Mon Sep 25 21:43:09 EDT 2023
Number: 21
Node: 12D3KooWDZ1bg3mVBqL77ZVLDP5Q4YrckWXkpCH2oWPFuHeM8rBPPID: 176907
Memory used: 16.4531MB
CPU usage: 0.0%
File descriptors: 565
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:09 EDT 2023
Number: 22
Node: 12D3KooWKme3KykwyroR8yhUShwx5arC7B46tg6LfQmAZCiQpkLMPID: 176899
Memory used: 16.9375MB
CPU usage: 0.0%
File descriptors: 558
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:09 EDT 2023
Number: 23
Node: 12D3KooWBpnbkMS96RCuFtdvtTEY5hRCS2T2VyWwm7kckd5SkdehPID: 176821
Memory used: 16.582MB
CPU usage: 0.0%
File descriptors: 495
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:09 EDT 2023
Number: 24
Node: 12D3KooWNBKYVmVYw1Zt6DuEusK3YmVtcMG7thS8q2H769CzCkQaPID: 173567
Memory used: 105.391MB
CPU usage: 1.9%
File descriptors: 1077
Records: 564
Disk usage: 224MB
Rewards balance: 0.002051832
------------------------------------------
Timestamp: Mon Sep 25 21:43:09 EDT 2023
Number: 25
Node: 12D3KooWJKJBLni5jWC7LktpGsHdcVzmHY37q6V19yrkiUR7BqR7PID: 176238
Memory used: 15.2812MB
CPU usage: 0.0%
File descriptors: 326
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:10 EDT 2023
Number: 26
Node: 12D3KooWMmC9pyr4qrMeS6awqS1nRWYZVFV8Aa5F8ox8HS8N3A9kPID: 176889
Memory used: 16.3008MB
CPU usage: 0.0%
File descriptors: 553
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:10 EDT 2023
Number: 27
Node: 12D3KooWGGVrvPcFTeyt71rx1cz18H1dcneR8j914xbnRfPKHCBTPID: 176265
Memory used: 14.9336MB
CPU usage: 0.0%
File descriptors: 348
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:10 EDT 2023
Number: 28
Node: 12D3KooWSW3DtoHS6qz1CtGcnVhch5eo3UsrEfiHrd7SnBQk68rHPID: 176664
Memory used: 15.9336MB
CPU usage: 0.0%
File descriptors: 376
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:10 EDT 2023
Number: 29
Node: 12D3KooWMThry7YnFKNrDGwQuJDvYbVR1djWcKL7G6Va6FECcDinPID: 176291
Memory used: 15.8242MB
CPU usage: 0.0%
File descriptors: 371
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:10 EDT 2023
Number: 30
Node: 12D3KooWLGYULzgsxWDgeVrnMtkaSdHfygEzfmmSuMoeUm3coV2jPID: 176773
Memory used: 16.2305MB
CPU usage: 0.0%
File descriptors: 460
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:11 EDT 2023
Number: 31
Node: 12D3KooWQwwuEXNgotA6WDTCt7Mtvjmk11UB5uTTMFGATQ6kikqePID: 176757
Memory used: 16.1797MB
CPU usage: 0.0%
File descriptors: 446
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:11 EDT 2023
Number: 32
Node: 12D3KooWMNzzVG9T2PDxwA9RsUEKrQnPwkn6MaTv1oCUjsxceczYPID: 176799
Memory used: 16.5MB
CPU usage: 0.0%
File descriptors: 481
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:11 EDT 2023
Number: 33
Node: 12D3KooWKfv97DcwPn8VSGCcMPoQS2jjp2HghaCHA3NriQWtyuA2PID: 176717
Memory used: 16.0508MB
CPU usage: 0.0%
File descriptors: 418
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:11 EDT 2023
Number: 34
Node: 12D3KooWSGGHWvTLBprEz2p7R13mxcrqA92zcwWEPwU7HotfAd2aPID: 177035
Memory used: 17.5195MB
CPU usage: 0.0%
File descriptors: 663
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:11 EDT 2023
Number: 35
Node: 12D3KooWB5iXuDjX2MfaPmyqRchw3AyNtkZJCMndfqDtgBveyTDbPID: 176273
Memory used: 15.4648MB
CPU usage: 0.0%
File descriptors: 355
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:11 EDT 2023
Number: 36
Node: 12D3KooWQgbW4PsSZCsxsVHwktMur4eUPLS6dy6kFSjAb5Lky7tdPID: 176683
Memory used: 15.9375MB
CPU usage: 0.0%
File descriptors: 390
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:12 EDT 2023
Number: 37
Node: 12D3KooWLDVbgamjyTUxyKTK2w6vU5T5Snm7gutLzQUtcG1q4e49PID: 176971
Memory used: 16.8789MB
CPU usage: 0.0%
File descriptors: 616
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:12 EDT 2023
Number: 38
Node: 12D3KooWFqddvdyhNNtDuC3d9mfboE31ECd1GuUEQnkoA585ebg8PID: 176871
Memory used: 16.5352MB
CPU usage: 0.0%
File descriptors: 537
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:12 EDT 2023
Number: 39
Node: 12D3KooWFMbceyYiDhnPRhfJqYj2bh362Wr9ZMkvAfNBPbW56JwsPID: 176737
Memory used: 16.2422MB
CPU usage: 0.0%
File descriptors: 432
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:12 EDT 2023
Number: 40
Node: 12D3KooWD8nByBdo3oiqrvGHQEhjcnq5JePHvEVXaH7cs3k8ug33PID: 177017
Memory used: 16.7227MB
CPU usage: 0.0%
File descriptors: 649
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:12 EDT 2023
Number: 41
Node: 12D3KooWFTL1aDqe8ZGvGHtoYTHU5pGA4Kpz5RYeboQJcfwJka8sPID: 176989
Memory used: 17.3789MB
CPU usage: 0.0%
File descriptors: 628
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:12 EDT 2023
Number: 42
Node: 12D3KooWQRymTfLvUxDghTkC6YH84wWP1P5MWVfVS1sguXjXoRjAPID: 176951
Memory used: 17.1797MB
CPU usage: 0.0%
File descriptors: 602
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:13 EDT 2023
Number: 43
Node: 12D3KooWKBUtJYmP2uZoy5VrNFd2PAn5vJoDNENww5xHVh7KddnDPID: 176837
Memory used: 16.793MB
CPU usage: 0.0%
File descriptors: 509
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:13 EDT 2023
Number: 44
Node: 12D3KooWLnj6i5uDHLrwX1kqPTo8BKimUEtHtfGySWh6eejbLwvQPID: 176701
Memory used: 15.8828MB
CPU usage: 0.0%
File descriptors: 404
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:13 EDT 2023
Number: 45
Node: 12D3KooWHZebBX4u9UYrxWRuXW5ufxaTvn6CHcyEGsT6QquFgCgmPID: 176281
Memory used: 15.75MB
CPU usage: 0.0%
File descriptors: 362
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:13 EDT 2023
Number: 46
Node: 12D3KooWBoreYq2oFcfVWvC7b4BGkUwSM5WobkE7W7BASEqfp96GPID: 176931
Memory used: 17.1875MB
CPU usage: 0.0%
File descriptors: 586
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:13 EDT 2023
Number: 47
Node: 12D3KooWR6XUCKw6XGGoNkAqSUn1e5jKDxFrnfSLdcjZcMznxtkMPID: 173549
Memory used: 110.844MB
CPU usage: 1.9%
File descriptors: 1196
Records: 286
Disk usage: 113MB
Rewards balance: 0.000035795
------------------------------------------
Timestamp: Mon Sep 25 21:43:13 EDT 2023
Number: 48
Node: 12D3KooWPmsJ9tDsmkZgVDvDnf6SmDN8DNPNpoUa6RWK3k8UUJW1PID: 173573
Memory used: 111.617MB
CPU usage: 2.0%
File descriptors: 1172
Records: 431
Disk usage: 165MB
Rewards balance: 0.001995726
------------------------------------------
Timestamp: Mon Sep 25 21:43:14 EDT 2023
Number: 49
Node: 12D3KooWDZXEvREU5gmLG3GzPBYVdsQZr5pnPvpYQKDttVX5R1QkPID: 176979
Memory used: 17.3203MB
CPU usage: 0.0%
File descriptors: 621
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:14 EDT 2023
Number: 50
Node: 12D3KooWHK7awih7j2cUSXdj2UAVTBw1GaqrofpeV1Bsja6GMGQtPID: 176941
Memory used: 17.1914MB
CPU usage: 0.0%
File descriptors: 595
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:14 EDT 2023
Number: 51
Node: 12D3KooWMPpKmFQfWGoRjQKH3o34rXykJ2onSSxxeazUUFHRERf3PID: 176765
Memory used: 15.6641MB
CPU usage: 0.0%
File descriptors: 453
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:14 EDT 2023
Number: 52
Node: 12D3KooWDZAGDzN5FTX9xVpryCf2k9mR4996kKX1mVPZDxanLZ54PID: 176693
Memory used: 16.0234MB
CPU usage: 0.0%
File descriptors: 399
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:14 EDT 2023
Number: 53
Node: 12D3KooWQgVsnaocY4YbW1a8q9YjB8MJuFJWj6gZcDcUB8wrFaeRPID: 176879
Memory used: 16.3555MB
CPU usage: 0.0%
File descriptors: 544
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:14 EDT 2023
Number: 54
Node: 12D3KooWRDK9cvtNhzGSLEBYbaGVVn7S7r6p9u5GUyXRVjZw1HpFPID: 173555
Memory used: 109.988MB
CPU usage: 1.9%
File descriptors: 1247
Records: 322
Disk usage: 125MB
Rewards balance: 0.000126012
------------------------------------------
Timestamp: Mon Sep 25 21:43:15 EDT 2023
Number: 55
Node: 12D3KooWF96bM4Pos7GaErrfZ2orNBefHiVQX4fd9ECdT1D815FwPID: 176853
Memory used: 16.7695MB
CPU usage: 0.0%
File descriptors: 523
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Timestamp: Mon Sep 25 21:43:15 EDT 2023
Number: 56
Node: 12D3KooWBdoaFJGPfswokohzLWh47acMLgV3ZjCtE5RrKzNGaHhcPID: 176247
Memory used: 15.6523MB
CPU usage: 0.0%
File descriptors: 334
Records: 0
Disk usage: 4.0K
Rewards balance: 0.000000000
------------------------------------------
Is that normal?
Are you using the correct node version. The first version did not work.
Yeap:
safenode -V
safenode cli 0.90.34
Most likely user error; I launced a few nodes manually, and then used Chriso script
#!/bin/bash
for i in {1..50}
do
SN_LOG=all $HOME/.local/bin/safenode --log-output-dest data-dir &
echo $i
sleep 5
done
Looking at the logs:
Not enough peers in the k-bucket to satisfy the request
So I probably forgot to set peers 
Hmm, what was your CPU doing here? I’m wondering if the self-encryption side of things perhaps broke down or hung, here… cc @qi_ma . Right now we dont have any laaaarge file tests, but we’re in a good place to start looking at this.
Is it longer for each and every batch? I dont think we have a log per batch do we, but it may be good to get one to investigate this more 
if you have the latest releases that shouldnt matter.
I think that’s the client (which I updated straight away).
Node is a different matter…
Edit: I stand corrected, see below
Node also should not need peers set anymore actually, @Southside speaks truth!
So we can mix nodes as well?! 
maybe try
unset SAFE_PEERS
and try again?
Starded fresh, 50 nodes now running. Let’s see how many my cloud instance can take…
Theres that sneaky bugger Old Father Time trying to creep in again…
an interesting question indeed. Solving it without time or magic numbers would be nice.
Ah, yes. I’d not taken into account they might not have implemented punishing a node that isn’t available. But it’s still a good sign that it was able to pickup where it left off.
When there is a way of detecting a node has gone offline and punishing it if it’s out of commission for too long maybe there could be a way of announcing a node is going offline to avoid punishment for OS maintenance like upgrades, disk expansion, etc?
No, more of a general upward trend.
My 2,1 GB uploaded stopped with:
Uploaded 20 chunks in 131.122356906s. Current progress is 3520/4058.
Cannot get store cost for NetworkAddress::ChunkAddress(324627(00110010).. - - 324627c2294cade08335a0408406b28f9465eb79694d0b20b7b31d5cc2fc295e) with error
CouldNotSendMoney("Network Error Not enough store cost prices returned from the network to ensure a valid fee is paid.")
My node has high sounding earnings, 0.712427027
According to Vdash he price at the moment is:
28146939 (1044 - 28146939)
What does that (1044 - 28146939) mean, @happybeing ?
Range is the min and max Storage Cost within the time window displayed, which is the period stated, such as “in the last 34 hours” etc.