Local LLMs, I'm surprised no one brought that up yet. I've got an old GPU in my server, and I'm running some local models with openweb-ui for use in the browser and Maid for an Android app to connect to it.
this post was submitted on 03 May 2025
119 points (96.1% liked)
Selfhosted
46595 readers
1506 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
founded 2 years ago
MODERATORS
To add to this, I host Confusion for image generation
You’re a brave one admitting that on here. Don’t you know LLM’s are pure evil? You might as well be torturing children!
I think looking through the comments on this post about AI stuff is a pretty good representation of my experience on lemmy. Definitely some opinions, but most people are pretty reasonable 🙂
Ais fine as a tool, trying to replace workers and artists while blatantly ripping stuff off is annoying, it can be a timesaver or just helpful for searching through your own docs/files
If you agree it’s a time saver, then you agree it makes workers more efficient. You now have a team of 5 doing the work of a team of 6. From a business perspective it’s idiotic to have more people than you need to, so someone would be let go from that team.
I personally don’t see any issue with this, as it’s been happening for the existence of humanity.
Tools are constantly improving that make us more efficient.
Most of people’s issue with AI is more an issue with greedy humans, and not the technology itself. Lord knows that new team of 5 is not getting the collective pay as the previous team of 6.
Nor will they get the workload of 6 people. They might for a couple of months, but at some point the KPI's will suddenly say that it's possible to squeeze out the workload of 2 more people. With maybe even 1 worker less!
more work can get done and more work can be show in progress, its like a marginal timesaver, itll knock off 25% of a human maybe if that, not replace a whole one
I think most people on here are reasonable, and I think local LLMs are reasonable.
The race to AGI and companies trying to shove "AI" into everything is kind of insane, but it's hard to deny LLMs are useful and running them locally you dont have privacy concerns.
Interesting, this has not been my experience. Most people on here seem to treat AI as completely black and white, with zero shades of grey.
I see a mix, don't get me wrong, Lemmy is definitely opinionated lol, but I don't think it's quite black and white.
Also, generally, I'm not going to not share my thoughts or opinions because I'm afraid of people that don't understand nuance, sometimes I don't feel like dealing with it, but I'm going to share my opinion most of the time.
OP asked what you self host that isn't media, self hosted LLMs is something I find very useful and I didn't see mentioned. Home assistant, pihole, etc, all great answers... But those were already mentioned.
I still have positive upvotes on that comment, and no one has flamed me yet, but we will see.
I’ll give my recommendation to local LLMs as well. I have a 1060 super that I bought years ago in 2019 and it’s just big enough to do some very basic auto completion within visual studio. I love it. I wouldn’t trust it to write an entire program on its own, but when I have hit a mental block and need a rough estimate of how to use a library or how I can arrange some code, it gives me enough inspiration to get through that hump.
Ya exactly! Or just sanity checking if you understand how something works, I use it a lot for that, or trying to fill in knowledge gaps.
Also qwen3 is out, check that out, it might fit on a 1060.
I self-host web apps I write myself? ¯\(ツ)/¯
I'm just starting to get into this myself. I made one so my family can easily check the status of my media server and send a movie, show, or music request to sonarr, radarr, and soularr(WIP) so they don't have to bug me when they want something and it also helps them to feel they have more agency in the process. It's pretty useful for me as well to be able to easily download things instead on the go instead of keeping a neverending list.
What kind of apps do you write?
I believe that functionality exists already if you are using Plex; via RSS sync.
Foundry VTT (I know it's technically for a game but it's technically a virtual tabletop and not a game itself)
AI Chatbots for tech support
I technically self-host an image generation AI through my main home PC, but that's made less accessable and only on when I specifically demand it via ssh lol
Occasionally I'll throw a temp website up for local events for like event schedules or whatever, an easily accessable and editable html file or whatever
Foundry was the 2nd thing i started self hosting (the first being pihole). Have had it running for 5 years now.
Other than that i only recently started expanding my self hosting:
- tandoor recipes
- navidrome (for music, mentioning it since it isn't the typical media server recommendation)
- personal knowledge management (pkm) static website that i build with hugo
- umami analytics
- Remark42 for comment system on one of my internal static websites
- a few smaller things that i built. One is a discord bot from before i started hating discord, and then a few web apps that i haven't open sourced yet
I see mention of Foundry, I upvote. My friends and I have been using it for a couple years and still find new ways to be impressed by it.
I just started porting a DnD Beyond campaign into it and using it to store homebrew world info for a future game, but so far it's been basically everything I ever wanted from Roll20 or DDB, but self-hosted and they give you access to the code so you can just... Code in features you want
Thinking about pirating the FFXIV TTRPG when someone puts it up and making it in Foundry if it's not already done by someone smarter eventually lol
Depends on what you consider self-hosted. Web applications I use over LAN include Home Assistant, NextRSS, Syncthing, cockpit-machines (VM host), and media stuff (Jellyfin, Kavita, etc). Without web UI, I also run servers for NFS, SMB, and Joplin sync. Nothing but a Wireguard VPN is public-facing; I generally only use it for SSH and file transfer but can access anything else through it.
I've had NextCloud running for a year or two but honestly don't see much point and will probably uninstall it.
I've been planning to someday also try out Immich (photo sync), Radicale (calendar), ntfy.sh, paperless-ngx, ArchiveBox (web archive), Tube Archivist (YouTube archive), and Frigate NVR.
Immich and Radicale definitely recommended. I've still got paperless-ng and plan to move to paperless-ngx as soon as I find the time. I've also got firefly-iii which is a big revolution to how I manage personal finance. Even my 17 old son has got into it ... He couldn't understand where all his hard earnings were going.
searxng an matrix both on a vps an public an everything else i host local an are not on the web
Headscale
Matrix server (conduwuit, soon to be tuwunel)
Matrix bridges (slack, discord, whatsapp)
Adguard
Pihole
Findmydevice
Redlib
Linkwarden
Forgejo
Ntfy
Molly socket
Home assistant
Uptime Kuma
There's probably more that I'm forgetting lol
Adguard
Pihole
More adblockers for the ad-blocking god!
Lol, when I moved the most recent pihole version had just got released so I wanted to check it out. I have pihole service my IoT network and 3 adguard->unbound instances setup for my main network for fallbacks 🤣.
But yeah I hate ads/trackers with a burning passion as you can see hahaha
You can selfhost find my device? Do you have a link to that project?
Yep you can self-host findmydevice anywhere. Personally, I deployed it on fly.io as I don't expose my local network to the internet for security reasons
+1 For hass.
SearXNG, Forgejo, Linkwarden, Vaultwarden, copyparty, all the Servarr apps, qBittorrent and SABnzbd for downloads, Syncthing, Mastodon, and all the various containers like databases and other tools that support the aforementioned.
Baikal for calendar, todo and contact syncing
Forgejo for version control
Silverbullet for markdown notes
FreshRSS for aggregated news
Linkding for bookmarks
I randomly think about something I want, and then usually find it here. Used to be a GitHub repo, but it got so popular and useful they got a nice site with search and all, now.
https://awesome-selfhosted.net/
I don't have as much running anymore outside media/games, but I do still run Stirling PDF as an Acrobat Pro alternative.
- Gitlab (version control)
- Bookstack (wiki)
- Joplin (not a webapp, but sync server)
- Semaphore (does all of my infra updating via Ansible)
- Uptime-Kuma (monitoring/alerting)
Been thinking about adding NextCloud mostly for the Google Docs/MS Office replacement at some point.
But honestly most of my stuff is just for me, my family prefers to to use whatever commercial thing is out there. So I tend to limit things to infrastructure type things that are of personal interest to me alone.
load more comments
(4 replies)
- Forgejo - git hosting
- actual budget - spending tracking mostly
- Vaultwarden
- home assistant - still configuring
- Immich backs up photos from my phone and camera with tagging and search
- Archivebox is like a personal internet archive, I use it to save youtube videos and important memes
- Homeassistant does home automation stuff, currently I only use it to turn the speakers on/off with the tv
- Forgejo is a git host like Github, and can regularly pull external repositories to keep a personal mirror
- Actual budget is a budgeting app, nice for tracking expenses across multiple accounts
You made me actually check out Immich and I love the tagging feature. That makes it feel much more like a photo library and less like just a giant file storage solution that happens to store photos.
Immich is really good actually. Completely replaced Google Photos for me.
load more comments
(7 replies)
I keep everything documented, along with my infrastructure as code stuff. Briefly:
- Nextcloud
- Vaultwarden
- Miniflux
- My blog
- Takahe (a multi-domain) ActivityPub server
- My health tracker CRUD data entry
- https://alexpdp7.github.io/selfhostwatch/
- Grafana (for health stats and monitoring data from Nagios)
- Nagios
- FreeIPA/Ipsilon (SSO)
edit: plus a few things that do not have a web UI.
view more: next ›