Largest Single File Size - Public Uploads

Hi all - I am looking towards the community if folks have uploaded public files > 4GB, specifically 16GB or more to the network successfully.

If so, can you please provide the data address to that upload (assuming the content is open source and legal to download & distribute). I am conducting further tests on throughput (download specifically), and I wanted to get larger file size payloads to determine any foreseeable bottlenecks, if any, are encountered on throughput.

I personally haven’t tinkered around with metamask (funding it) to upload a random large file to the network, hence the question above :slight_smile: .

8 Likes

here are some public files

ant file download --retries 20 3b7f320f24e9f2274ea6917f9dc34f5df3386123c70b3fd3b2161fcdf6c0505f ubuntu-16.04.6-desktop-i386.iso                  #md5sum feefb18e7916c9a16bb09923ed98df64  1.6Gb
ant file download --retries 20 f2e49a420cc6796361fdf836cc573dedf63c3b3b11f93bbd1a15962a9830cd8f ubuntu-24.04.2-desktop-amd64.iso                 #md5sum 094aefdb1dbbdad8aa99600f8413789b  5.8Gb 
ant file download --retries 20 ccc401961cc29a0d9fce5e6dd10ff4107d594485678e17fedcdd545ae2f1934d ubuntu-25.04-desktop-amd64.iso                   #md5sum d79522031c673fe5ff1c037038806012  5.8Gb
ant file download --retries 20 1e447d05a7a57f9157e9c22b19be4d7d5445b0e895582787db91db7413080e3e ubuntu-24.04.3-desktop-amd64.iso                 #md5sum 9fdef04b6b8d1406c9e6cbd41d5637ed  6.0Gb
ant file download --retries 20 ec7efd1b11ea7107205fe3d39208ba4a513d71f2d7579584cb791e95a8e82de6 edubuntu-24.04.3-desktop-amd64.iso               #md5sum a1516a4d70374f4e454480a761cb4bb7  6.0Gb
ant file download --retries 20 93b9f7ff6835b2a76d310db2dae493d52be88c688f4c68dd54de3a31b9d9bdd7 ubuntu-20.04.6-desktop-amd64.iso                 #md5sum eeabb7996e94b2f0a6eaf73f8943d19f  4.1Gb cost $2.38
ant file download --retries 20 53f853e10a8905f03804b21a2809aaa4e12cc236fcf883bfcc3946b8906f0f3c ubuntu-22.04.5-desktop-amd64.iso                 #md5sum b39ffce30a4b36eff097d8bd1954819c  4.5Gb cost $2.56
ant file download --retries 20 537629deca52c848a322c7e4296c36a9c431c404aab84b1b7c8c63cc02a8a740 ubuntu-24.04-beta-desktop-amd64.iso              #md5sum f1dc1eac7e6a53cf040cbdba2f5f65c3  5.3Gb cost $3.03
ant file download --retries 20 f0a170fffe854ce1246e2838c25b19ab4a8262bca52ca5b06580e7cb9b6e98f4 ubuntu-14.04.6-desktop-i386.iso                  #md5sum c16ec8b927849cbba7b900d25eb49bfd  1.1G c ost $0.68
ant file download --retries 20 f1594c7f501d4c1b5e635ed11d2df80496ec9aabf8bdfacc54e9e0dda04fac88 kali-linux-2025.3-installer-amd64.iso            #md5sum 8d97df58242de813391a02b534581741  4.3Gb
ant file download --retries 20 fc0cd45cd653855489d1549f6149f055030d8bd6f5de7b2c342bf80b6d5b3454 kali-linux-2025-W42-installer-arm64.iso          #md5sum db77f67c6321c178c01aab0b93d20648  4.5Gb
ant file download --retries 20 aaeb6271144a7bb4529a08e580062d9de7b7a1bb7ec6ec9b5498deb7afb94035 2022-07-01-raspios-bullseye-i386.iso             #md5sum e57f42852306ac5ed0d9e97bdc3513cb  3.4Gb
ant file download --retries 20 a9bdf8ce7423d6a14b373db5d056beec8dd91227d3e5184f824e8359fdbadad8 2025-05-13-raspios-bookworm-arm64-full.img.xz    #md5sum 7bf17963c4fc2d8716f53f89c90c0fba  3.1Gb
ant file download --retries 20 e990f4c13b3978f26f0d6531086f24a92c8dfc22283a36888b450d3c78457623 Fedora-KDE-Desktop-Live-42-1.1.x86_64.iso        #md5sum 1db4bd673e0cc72202578b6c2296e485  2.7Gb
ant file download --retries 20 e42dca760e71158aacea4b6f71e33de861fb02901c16c13ecfd0714337cad454 Fedora-KDE-Desktop-Live-42-1.1.aarch64.iso       #md5sum 531804fcc615d34cb130a2623e64fdf3  2.6Gb
ant file download --retries 20 33cc094b8386605c9c61f73c4629f21984bf070625684366c8c926fda34cfd19 Fedora-KDE-Desktop-Live-42-1.1.ppc64le.iso       #md5sum 3b9c846cf4369bc15f2902afa3eae020  2.6Gb   
ant file download --retries 20 e322cc021ecc9f5c51d7ac73786ffcf0244d52ff41c48e1a12594833ffb33995 livegui-amd64-20250720T165240Z.iso               #md5sum 338eadd1a40dc4a71963547e34905f83  3.7Gb
ant file download --retries 20 9f1c51fd6eb12be85dadc4815c5b3cec07e899826fbeb907d34369d56384c746 2025-05-13-raspios-bookworm-armhf.img.xz         #md5sum f1cdb4cb7e1d0d1fa24ea2e0468537e5  1.2Gb
ant file download --retries 20 b1a16a0d7b14e0bfc91511dcdcb6b4fefcf428aa768ae37d40dbf29c51efc5c0 2025-05-13-raspios-bookworm-armhf-full.img.xz    #md5sum f43d8bc191501491148f302cdfc73d29  2.8Gb
ant file download --retries 20 58f546c93e031987d5a13e12d23da283be479debb9cba148e39bb8d2c68a983a linuxmint-22.1-xfce-64bit.iso                    #md5sum 7ed0eb51afeb3009aa042bbbfc902474  2.7GB
ant file download --retries 20 8d462cc4556de60482669ede64ffc4bd604ad464f251d62e82d87dab55f926c9 linuxmint-22.2-cinnamon-64bit.iso                #md5sum 725e0a5bf98d2b5c9c0f13d8c38cae79  2.9Gb
ant file download --retries 20 0b4f7d21d932c573c99cee9811f951c320aa38277660ad4dd70855d870de534c debian-12.11.0-amd64-DVD-1.iso                   #md5sum 39a31c7218b4606cf7f4408c0b261a2f  3.7Gb
ant file download --retries 20 81c97fd2385d3dc0c9c17a61ec393386480fd46c86989b7cbbf82839c467a6c2 debian-12.11.0-arm64-DVD-1.iso                   #md5sum 916173947d0507c673a36b6950482f05  3.8Gb
ant file download --retries 20 e751cb98326ba5e11b5e0cf3dc02e96e3b53d30819247b1f230072907c21d9b7 cachyos-desktop-linux-250713.iso                 #md5sum 7c84485fc91ec645b6235727ff4adcef  2.8Gb
ant file download --retries 20 4ea3a7d2300aa96b03009e84443a0923fabb688fe0ef14c48c87e5281319e82a cachyos-handheld-linux-250713.iso                #md5sum d1354a944600d9088540c18da07add78  2.6Gb

using these upload settings uploads are going very fast from an oracle instance about 10 min for a 4Gb file if i remember correctly

export EVM_NETWORK=arbitrum-one
export SECRET_KEY=<private key>
#Uploads
export CHUNK_UPLOAD_BATCH_SIZE=24
export FILE_UPLOAD_BATCH_SIZE=24
export UPLOAD_FLOW_BATCH_SIZE=250
#Downloads
export CHUNK_DOWNLOAD_BATCH_SIZE=64
export MAX_IN_MEMORY_DOWNLOAD_SIZE=250

8 Likes

Just zip a combination of those files to >16GB and the goal is reached, are you up to take on that quest @aatonnomicc ? You seem to have a good setup for testing uploads/downloads.

1 Like

Iv topped 16gb already but it was a movie file that is a personal back up so can’t be publicly posted.

5 Likes

I tried to time the 6GB edubuntu file but I failed after about 10%


Fetching chunk 137/1519 ...
Fetching chunk 137/1519 [DONE]
Fetching chunk 138/1519 ...
Fetching chunk 138/1519 [DONE]
Fetching chunk 139/1519 ...
Fetching chunk 139/1519 [DONE]

   0: Failed to fetch data from address
   1: Failed to download file
   2: Failed to decrypt data.

Location:
   ant-cli/src/actions/download.rs:147

Backtrace omitted. Run with RUST_BACKTRACE=1 environment variable to display it.
Run with RUST_BACKTRACE=full to include source snippets.
Successfully downloaded chunks were cached.
Please run the command again to obtain the chunks that were not retrieved and complete the download.

real	15m27.807s
user	0m25.560s
sys	0m20.446s

Both from home and Hetzner VPS it craps out at chunk 139

== DO WE HAVE DATA LOSS ??? ==

somebody please confirm with
time ant file download ec7efd1b11ea7107205fe3d39208ba4a513d71f2d7579584cb791e95a8e82de6 edubuntu-24.04.3-desktop-amd64.iso

2 Likes

I am experiencing the same problem at the same chunk 139. Trying a third time to download, same problem.

2 Likes

I am having similar issue downloading this file from my computer, with and without parallelism. I have brought it up to the team’s attention as and when folks sign online (soonish).

5 Likes

also

1e447d05a7a57f9157e9c22b19be4d7d5445b0e895582787db91db7413080e3e ubuntu-24.04.3-desktop-amd64.iso

failed at Fetching chunk 569/1513 [DONE]

took over an hour both from home and VPS which is alarmingly slow.

2 Likes

I too am not able to fully download that data address from my home computer. I also tried the prior 6GB address file posted earlier with –retries 20 and was unsuccessful as well.

Thanks for the update @Southside .

I have escalated the issue with the team for further investigation.

7 Likes

And theres more :frowning:

3b7f320f24e9f2274ea6917f9dc34f5df3386123c70b3fd3b2161fcdf6c0505f ubuntu-16.04.6-desktop-i386.iso

fails fetching chunk 109/400

2 Likes

Download test of my files uploaded with Dave in the last 30 days: out of 36 files, 2 are not downloading:

d858ab728c2d29f260e0ccb73fb684d5d4d19a7f865fdf04db169298af10b5d8 .mp4

f7fa8ac0a2b7fc7d6e488ccedeba839f050199c39bae0b021feed852ad9ce6e4 .mkv

I re-uploaded this one d858ab728c2d29f260e0ccb73fb684d5d4d19a7f865fdf04db169298af10b5d8 (without paying) and it is now downloading successfully. I have not re-uploaded the other one in case the team wants to do tests.


Check out the Impossible Futures!

10 Likes

both the failing downloads are recent uploads I did to get them uploaded with the latest client so uploads would have the latest data map.

the original upload of ubuntu 16.04.6 was done about 6 months ago and still downloads fine

ant file download e7bb1b87c1f0e07cdb76ba5e82a425a8da712940c2d3553aa6791494e92aa54d . #md5sum feefb18e7916c9a16bb09923ed98df64  ubuntu-16.04.6-desktop-i386.iso 1.6Gb
7 Likes

Just to note here, please don’t reupload failed downloads at this time.

The team should be online shortly, and will do a deeper dive soonish!

7 Likes

Do you recall what time frame you uploaded those failed downloads? Roughly what day UTC? And what version of ant? 2025.10.1.6?

yes i did not try any re uploading so the team can have a look.

for time those uploads is within the last 5 weeks sorry I cant be more specific on the time frame

1 Like

here is another old upload around 6 months that is around 6Gb and downloading fine

ant file download 8d715daa99904615210449f53681c2f9f4bce871d5fc1312d2b571a537a5bb5d . #md5sum d79522031c673fe5ff1c037038806012  ubuntu-25.04-desktop-amd64.iso 5.8Gb
3 Likes

d858ab728c2d29f260e0ccb73fb684d5d4d19a7f865fdf04db169298af10b5d8
on 16.10 Dave 3.0

f7fa8ac0a2b7fc7d6e488ccedeba839f050199c39bae0b021feed852ad9ce6e4
on 20.10 Dave 3.0


Check out the Impossible Futures!

5 Likes

@Dimitar - if its not too much off an ask, was it only these 2 files from you in past 30 - 36 days that you are noticing chunks missing when downloading?

Seeking clarity whether you uploaded 1 file a day for past 30 days, or 36 files in past 36 days, off which 2 files in 2 different time windows were not able to be downloaded now?

2 Likes

This did work now with Antsnest link. Based on non-immediate start of the playback, maybe it was not from cache, but from network?

2 Likes

Today I tested all the files from my topic for Dave, my uploads cover 25 calendar days. Of these, there are a total of 36 uploaded files, at least 1 file per day. Of these, the two files mentioned above have a problem at the moment. I have indicated on which dates I uploaded them, then they were downloaded successfully. As I already mentioned, I uploaded the first file again today without being asked for a second payment.


Check out the Impossible Futures!

5 Likes