You could also try the ROCm fork of KoboldCpp

Koboldcpp bundles an interface ontop of llamacpp. And generally it’s relatively easy to get it running.

As far as I know you want a web application firewall to block attacks. A reverse proxy is just to proxy requests and doesn’t necessarily care if it forwards legitimate traffic or attacks.

Maybe a port forward can do it? That’s under Network -> Firewall. in the “Port forward” tab.

I’d need more info on the intended use-case and what’s the requirement for a tunneling software that’s making ssh tunnels and vpn tunnels unsuitable.

To follow that up: 45W isn’t that bad. Depending on where you live, I’d say it’s worth it if you get something out of it. (Be able to fit the HDDs, upgradability, …)

Ultimately you’d need to do the maths. Check what it costs to afford an additional 20W of power in a year and whether you should spend that money on better hardware. If my maths is right, 20W for a year at a high price of 30ct/kWh is about $52. So there isn’t that much to be gained. And your electricity might be considerably cheaper anyways.

Hmmh, No I don’t think you can make the idle power consumption go down. Sure, you got to set the right options in the BIOS and Linux. But there is a baseline and that’s with which chipset the mainboard was designed and what kind of components they chose.

And there’s the efficiency of the power supply. Usually they’re built to have a certain degree of efficiency (>80% or >90%) but that’s measured at a certain percentage of the maximum power draw. They’re not at all that efficient at 40W draw. You’d need an expensive PSU not to lose additional efficiency at low power. And generally they don’t come with a standard PC.

So you’d probably end up replacing half of the components of a standard PC while making it more power efficient. And I don’t think that’ll be cheap. You better find something that’s already designed to factor that in. Sadly it’s not what they print on every PC. You have to look for that info and sometimes it’s buried in some PC magazine forum or on Reddit. Sometimes they have additional tricks to squeeze out a tiny bit more, but you better be fine with that number.

I think mostly it’s about the mainboard. Most of the time there are some chipsets that are known to be more power efficient than others. But I’m not up to date anymore and can’t give any good recommendations.

If you want it cheap and most power efficient, generally the advise is to use an old laptop. They’re made to idle at like 10-15W. But you won’t get any SATA ports that way. You’d need external HDDs and connecting them via USB isn’t really super reliable. It’s frowned upon to use a setup like that for RAID or advanced things… But it’s how I started back in the day.

With the upgradability it’s always the question. That’s an additional requirement that makes it more difficult. If it’s an old machine you could end up needing to replace most of it anyways, since you need a new mainboard for a new CPU and along with that the next generation of RAM and then you’ve replaced most of your computer anyways. I’d say there is a limited window of opportunity when upgrading makes sense. But if you’re buying an old machine it may not always be a good idea to make it a requirement.

Most important thing with FUTO is, they learn how to do open source and engage with a community. Maybe it helps if they adopt a few projects with existing communities and which are more than source available.

Most mainboards in full-sized PCs aren’t optimized for power efficiency. But there are some (few) efficient mainboards and PSUs available.

The german c’t magazine publishes guides to build efficient home-servers or workstations every other year. But that’s well above your budget: https://www.heise.de/ratgeber/Bauvorschlag-fuer-einen-sparsamen-Heimserver-aus-c-t-3-2024-9587594.html (400€ new, 17W idle)

The Lenovo seems to draw around 45 Watts on idle. You could go well below 20 Watts if you wanted.

I’d say for most power efficiency along an extremely low budget, you want an old laptop as a home server, or a mini pc like an Intel NUC. But you might want to refine your requirements… What do you need that thing for? How many SATA-Ports etc do you need? Are you more willing to compromise on price or power efficiency?

Hehehe. Yeah they put everything in on their site. From a canary to their company ethics, to an origin story, all necessary buzzwords, job offers (which they have none), a marketplace … Lot’s of flowery words. And honestly, it doesn’t even smell like AI generated text. They’ve probably mastered the bullshit bingo and decided to go all in. I kinda like it (in a twisted way.)

Oh wow, thx. No. I’m just clueless. And there is a cultural difference, so souvereign citizens aren’t the first thing that comes to my mind when reading that word… But thanks for explaining the joke to me, anyways 😅

And how do ultra-libertarians tie into the topic of hosting open source services?

Sry, I don’t get at all what you’re trying to say…

How’s it standing out? What’s the benefit over other self-hosting distros like YunoHost, Cosmos, Cloudron etc? Except the added Bitcoin?

iptables or nftables. Or firewalld depending on the Linux distro and version you use.

Sometimes the Arch Wiki has some good info on specific configurations. I mean it’s not that easy to write firewall rules on the command line. But it’s no rocket science either.

Hmm. It’s kind of just a VPN. It tunnels your traffic and terminates it at some server with those IPs. It’s just that NordVPN etc make you share an IP with other users and don’t offer port forwarding. But the rest of Hoppy isn’t necessarily unique, it’s just a specific configuration of a VPN.

I rented a VPS and installed wireguard myself. And created the firewall rules to forward (some) incoming traffic to my home server. That’s the same thing Hoppy does. Just that Hoppy does the setup of the firewall and Wireguard for you.

But I’m not aware of any similar services that do it automatically. Maybe something like pagekite.net comes close.

So I don’t know if that’s the correct solution to what you’re doing but I’d say one alternative would be to rent any small server, install Wireguard both there and on the RasPi, connect them and configure Wireguard on the RasPi so all outgoing traffic goes through the tunnel. And then configure the like 3 firewall rules on the VPS to make it forward incoming traffic on all ports to the RasPi.

You could self-host a S3-compatible storage bucket with something like MinIO or Garage.

S3 backends are available in a lot of software and it’s kinda made for a similar use-case. I don’t know which projects have caching available in a way that aligns with your setup. But I found these two being easy to set up.

Hmm, get 25 monitors and friends and play one of those starship bridge simulators like https://smcameron.github.io/space-nerds-in-space/

• fail2ban / brute forcing prevention
• quick, frequent updates(!)
• containerization / virtualization
• secure passwords, better keys
• firewall
• a hardened operating system (distribution)
• SELinux / Apparmor / … / OpenBSD
• not installing unnecessary stuff
• An admin who is an expert and knows what they do.

Oh wow. Seems you live somewhere where electricity is a bit more affordable. I have an super efficient enterprise mainboard with an old Xeon. I get by with the 6 SATA-Ports for home use. I mean now that we have 12TB drives… I bought lots of RAM an I’m running several VMs, containers, Home Assistant and all sorts of stuff on that machine.

Happy tinkering and learning?!

Fair enough.

Why don’t you consider encrypting your NAS, if I might ask? Inconvenience on boot? Because that’s one inconvenience I currently live with… After a power outage I have to fetch a keyboard and type in the password, since the mainboard doesn’t have remote-management and I’ve never set up an automatic way to transfer/fetch the encryption key…