this post was submitted on 17 Oct 2025
1466 points (99.3% liked)

linuxmemes

27754 readers
1831 users here now

Hint: :q!


Sister communities:


Community rules (click to expand)

1. Follow the site-wide rules

2. Be civil
  • Understand the difference between a joke and an insult.
  • Do not harrass or attack users for any reason. This includes using blanket terms, like "every user of thing".
  • Don't get baited into back-and-forth insults. We are not animals.
  • Leave remarks of "peasantry" to the PCMR community. If you dislike an OS/service/application, attack the thing you dislike, not the individuals who use it. Some people may not have a choice.
  • Bigotry will not be tolerated.
  • 3. Post Linux-related content
  • Including Unix and BSD.
  • Non-Linux content is acceptable as long as it makes a reference to Linux. For example, the poorly made mockery of sudo in Windows.
  • No porn, no politics, no trolling or ragebaiting.
  • 4. No recent reposts
  • Everybody uses Arch btw, can't quit Vim, <loves/tolerates/hates> systemd, and wants to interject for a moment. You can stop now.
  • 5. πŸ‡¬πŸ‡§ Language/язык/Sprache
  • This is primarily an English-speaking community. πŸ‡¬πŸ‡§πŸ‡¦πŸ‡ΊπŸ‡ΊπŸ‡Έ
  • Comments written in other languages are allowed.
  • The substance of a post should be comprehensible for people who only speak English.
  • Titles and post bodies written in other languages will be allowed, but only as long as the above rule is observed.
  • 6. (NEW!) Regarding public figuresWe all have our opinions, and certain public figures can be divisive. Keep in mind that this is a community for memes and light-hearted fun, not for airing grievances or leveling accusations.
  • Keep discussions polite and free of disparagement.
  • We are never in possession of all of the facts. Defamatory comments will not be tolerated.
  • Discussions that get too heated will be locked and offending comments removed.
  • Β 

    Please report posts and comments that break these rules!


    Important: never execute code or follow advice that you don't understand or can't verify, especially here. The word of the day is credibility. This is a meme community -- even the most helpful comments might just be shitposts that can damage your system. Be aware, be smart, don't remove France.

    founded 2 years ago
    MODERATORS
     

    Does lemmy have any communities dedicated to archiving/hoarding data?

    top 50 comments
    sorted by: hot top controversial new old
    [–] eah@programming.dev 4 points 16 hours ago

    This post foreshadowed today's AWS outage.

    [–] possiblylinux127@lemmy.zip 9 points 1 day ago* (last edited 1 day ago)

    I would also add Openstreetmap to the list

    [–] GreenKnight23@lemmy.world 42 points 2 days ago (3 children)

    I have been archiving Linux builds for the last 20 years so I could effectively install Linux on almost any hardware since 1998-ish.

    I have been archiving docker images to my locally hosted gitlab server for the past 3-5 years (not sure when I started tbh). I've got around 100gb of images ranging from core images like OS to full app images like Plex, ffmpeg, etc.

    I also have been archiving foss projects into my gitlab and have been using pipelines to ensure they remain up-to-date.

    the only thing I lack are packages from package managers like pip, bundler, npm, yum/dnf, apt. there's just so much to cache it's nigh impossible to get everything archived.

    I have even set up my own local CDN for JS imports on HTML. I use rewrite rules in nginx to redirect them to my local sources.

    my goal is to be as self-sustaining on local hosting as possible.

    [–] SitD@lemy.lol 23 points 2 days ago

    respectable level of hoarding πŸ…

    [–] foster@lemmy.hangdaan.com 5 points 2 days ago* (last edited 2 days ago)

    Everyone should have this mindset regarding their data. I always say to my friends and family, "If you like it, download it.". The internet is always changing and that piece of media that you like can be moved, deleted, or blocked at any time.

    load more comments (1 replies)
    [–] mesamunefire@piefed.social 17 points 2 days ago (1 children)

    Did I miss something? Whats happening to debian stable?

    [–] ulterno@programming.dev 4 points 1 day ago

    debian stable became the go to distro for long term usage in case our FOSS support structure goes haywire due to wars

    [–] MTZ@lemmy.world 12 points 2 days ago

    This is just minor datahoarding. I do it, on an extreme level.

    [–] Allero@lemmy.today 23 points 2 days ago (1 children)

    I can answer one part of your question. Yes, it's not as big as you think it is.

    [–] axEl7fB5@lemmy.cafe 7 points 2 days ago (2 children)
    [–] Allero@lemmy.today 5 points 2 days ago (5 children)

    With images, it is 111,08 GB

    [–] Khrux@ttrpg.network 7 points 2 days ago

    That's still incredibly low, I'd have assumed an enormous increase.

    [–] FalschgeldFurkan@lemmy.world 4 points 2 days ago (1 children)

    Compressed or uncompressed? Can it be directly read?

    [–] Allero@lemmy.today 3 points 1 day ago (1 children)

    Can be read directly, like normal Wikipedia.

    [–] FalschgeldFurkan@lemmy.world 1 points 1 day ago (1 children)

    That's very nice. Does it also include other languages, or would that take more space?

    [–] Allero@lemmy.today 2 points 20 hours ago

    This is English only. Other languages are downloaded separately, though they typically take less space.

    load more comments (3 replies)
    [–] Dagamant@lemmy.world 16 points 2 days ago (3 children)

    I would add in some rom collections and book repositories as well. The whole library of Nintendo games is under a gig and would go a long way for entertaining people.

    load more comments (3 replies)
    [–] pyrflie@lemmy.dbzer0.com 83 points 3 days ago* (last edited 3 days ago) (5 children)

    Welcome to datahoarders.

    We've been here for decades.

    Also follow 3-2-1 people. 3 Backups, 2 storage mediums, 1 offsite.

    load more comments (5 replies)
    [–] Retro_unlimited@lemmy.world 33 points 2 days ago (3 children)

    I also recommend downloading β€œFlashpoint archive” to have flash games and animations to stay entertained.

    There is a 4gb version and a 2.3TB version.

    [–] kadu@scribe.disroot.org 15 points 2 days ago (1 children)

    There is a 4gb version and a 2.3TB version.

    That's quite the range

    load more comments (1 replies)
    load more comments (2 replies)
    [–] kayzeekayzee@lemmy.blahaj.zone 195 points 3 days ago (21 children)

    For wikipedia you'll want to use Kiwix. A full backup of wikipedia is only like 100GB, and I think that includes pictures too.

    load more comments (21 replies)
    [–] Valmond@lemmy.world 6 points 2 days ago (1 children)

    Okay so where do I find some cheap hard drives? Europe if possible :-)

    look for dvr's they have huge hdds in them and you can find them at thrift stores for cheap

    [–] hayvan@feddit.nl 26 points 2 days ago (2 children)

    Is there a context to this or just random thought?

    [–] WoodScientist@lemmy.world 45 points 2 days ago (11 children)

    You can ignore politics, but politics will not ignore you.

    load more comments (11 replies)

    gestures at everything

    [–] gerowen@lemmy.world 42 points 3 days ago* (last edited 3 days ago) (1 children)

    Neither are that bad honestly. I have jigdo scripts I run with every point release of Debian and have a copy of English Wikipedia on a Kiwix mirror I also host. Wikipedia is a tad over 100 GB. The source, arm64 and amd64 complete repos (DVD images) for Debian Trixie, including the network installer and a couple live boot images, are 353 GB.

    Kiwix has copies of a LOT of stuff, including Wikipedia on their website. You can view their zim files with a desktop application or host your own web version. Their website is: https://kiwix.org/

    If you want (or if Wikipedia is censored for you) you can also look at my mirror to see what a web hosted version looks like: https://kiwix.marcusadams.me/

    Note: I use Anubis to help block scrapers. You should have no issues as a human other than you may see a little anime girl for a second on first load, but every once and a while Brave has a disagreement with her and a page won't load correctly. I've only seen it in Brave, and only rarely, but I've seen it once or twice so thought I'd mention it.

    load more comments (1 replies)
    [–] Maroon@lemmy.world 32 points 3 days ago (13 children)

    I thought the whole point of torrenting was to decentralise distribution. I use torrents to get my distros.

    In my own little bubble, I thought that's how most people got their distro.

    load more comments (13 replies)
    [–] drbluefall@toast.ooo 111 points 3 days ago (3 children)

    The English Language Wikipedia probably wouldn't be hard, or Debian Stable.

    All of Debian's packages might be a tad more expensive, though.

    load more comments (3 replies)
    [–] zephiriz@lemmy.ml 17 points 2 days ago

    Years ago I bought a physical encyclopedia. I remember having one as a kid and using it for school reports. Also just looking through it can be cool. Learning about something you never knew existed is just a unique experience and doing it through a physical book just deepens the whole experience.

    I also learned the practice of printing a physical encyclopedia is going out of fashion. I think there is only one company the still prints a yearly encyclopedia and it's not Encyclopedia Britannica of all things. Might have change since I bought my copy but go give some physical media some love if you can.

    old pcs off amazon usually come with good reliable 1/2tb harddrive.

    [–] utopiah@lemmy.world 32 points 3 days ago (9 children)

    FWIW :

    fabien@debian2080ti:/media/fabien/slowdisk$ ls -lhS offline_prep/
    total 341G
    -rw-r--r-- 1 fabien fabien 103G Jul  6  2024 wikipedia_en_all_maxi_2024-01.zim
    -rw-r--r-- 1 fabien fabien  81G Apr 22  2023 gutenberg_mul_all_2023-04.zim
    -rw-r--r-- 1 fabien fabien  75G Jul  7  2024 stackoverflow.com_en_all_2023-11.zim
    -rw-r--r-- 1 fabien fabien  74G Mar 10  2024 planet-240304.osm.pbf
    -rw-r--r-- 1 fabien fabien 3.8G Oct 18 06:55 debian-13.1.0-amd64-DVD-1.iso
    -rw-r--r-- 1 fabien fabien 2.6G May  7  2023 ifixit_en_all_2023-04.zim
    -rw-r--r-- 1 fabien fabien 1.6G May  7  2023 developer.mozilla.org_en_all_2023-02.zim
    -rw-r--r-- 1 fabien fabien 931M May  7  2023 diy.stackexchange.com_en_all_2023-03.zim
    -rw-r--r-- 1 fabien fabien 808M Jun  5  2023 wikivoyage_en_all_maxi_2023-05.zim
    -rw-r--r-- 1 fabien fabien 296M Apr 30  2023 raspberrypi.stackexchange.com_en_all_2022-11.zim
    -rw-r--r-- 1 fabien fabien 131M May  7  2023 rapsberry_pi_docs_2023-01.zim
    -rw-r--r-- 1 fabien fabien 100M May  7  2023 100r-off-the-grid_en_2022-06.zim
    -rw-r--r-- 1 fabien fabien  61M May  7  2023 quantumcomputing.stackexchange.com_en_all_2022-11.zim
    -rw-r--r-- 1 fabien fabien  45M May  7  2023 computergraphics.stackexchange.com_en_all_2022-11.zim
    -rw-r--r-- 1 fabien fabien  37M May  7  2023 wordnet_en_all_2023-04.zim
    -rw-r--r-- 1 fabien fabien  23M Jul 17  2023 kiwix-tools_linux-armv6-3.5.0-1.tar.gz
    -rw-r--r-- 1 fabien fabien  16M Oct  6 21:32 be-stib-gtfs.zip
    -rw-r--r-- 1 fabien fabien 3.8M Oct  6 21:32 be-sncb-gtfs.zip
    -rw-r--r-- 1 fabien fabien 2.3M May  7  2023 termux_en_all_maxi_2022-12.zim
    -rw-r--r-- 1 fabien fabien 1.9M May  7  2023 kiwix-firefox_3.8.0.xpi
    
    

    but if you want the easier version just get Kiwix on whatever device in front of you right now (yes, even mobile phone assuming you have the space) then get whatever content you need.

    If need a bit of help I recorded TechSovereignty at home, episode 11 - Offline Wikipedia, Kiwix and checksums with a friend just 3 weeks ago.

    I also wrote randomly update https://fabien.benetou.fr/Content/Vademecum and coded https://git.benetou.fr/utopiah/offline-octopus but tbh KDE-Connect is much better now.

    The point though is having such a repository takes minutes. If you don't have the space, buy a 512Go microSD for 50EUR then put that on, stuff it in a drawer then move on. If you want to every 3 months or whenever you feel like it, updated it.

    TL;DR: takes longer to write such a meme than actually do it.

    load more comments (9 replies)
    load more comments
    view more: next β€Ί