I haven’t tried those, so not really, but with open web UI, you can download and run anything, just make sure it fits in your vram so it doesn’t run on the CPU. The deep seek one is decent. I find that i like chatgpt 4-o better, but it’s still good.

The coder model has only that one. The ones bigger than that are like 20GB+, and my GPU has 16GB. I’ve only tried two models, but it looked like the size balloons after that, so that may be the biggest models that I can run.

I got it working with my 6800XT. I’m running deep seek r1 14b (somewhere around there) and the deep seek coder V2. I have a link to a blog with those instructions

https://gotosocial.michaeldileo.org/@mdileo/statuses/01JQA4M4Q33PMCADH9M2AWQSS8

oh, I thought that was a mastodon thing or something. Thank you for the clarification :)

I have dynamic dns through cloudflare that provides a proxy ip address for me in addition to some protections.

After that I use a reverse proxy to route specific domain names to services. My router is set up to forward only ports 80 and 443 to that reverse proxy, so there’s a good layer of safety there. There could be a weakness on the router, but at this point traffic is pretty limited.

After that, at least for your service, if you can have some control or throttling of signings and be more selective about who you let in, then that could help.

I say do it. Sure there’s risk someone could put something on there you don’t want, but I wouldn’t say it’s big enough to not do it.

Did you ever find a solution? I’m having the same problem. I ensured that my user has wildcard permissions for the host, so it’s granted ALL on 'friendica'@'%'.

To add on, you can comment in a “binary search” method. Comment out one half of them, if it’s still there, half again, etc and keep going down until you find it.

I’m on mobile and can’t make out any of it, but good luck!

Writefreely is super light weight and minimalist in its design. It also federates with mastodon.

To add on, your budget here really matters. Ideally, you can have an external NAS or drive enclosure that is managed by the laptop. If you want easy backups, a cloud storage provider can help. I do nightly backups to idrive.

Thank you! This took so long to figure out

Because it doesn’t feel real 😉

Edit: i thought you referred to TrueNas. I’m tired

that would probably be better as an app, rather than a hosted service.

I run picsur. It’s not an image resizer like that. It’s like Imgur, but self-hosted and can take size arguments as part of the query. I use it to host images for a markdown based blog and keep the sizes under control.

On a side note, I recently started noticing so many sites that use full sized images regardless of the actual size it shows up on screen.

Can you share some screenshots? It sounds like you’re not even reaching the service.

It was a huge pita to get it running, but I have it.

One thing about the WA bridge is that element won’t let me give display names or look up the contact number, so the people in chatting with don’t have names, just “their number (WA)”

For backups, I have two drives that are striped and do nightly backups to idrive. I was able to find a containerized version of the console app and I have it run on a schedule from 3-7am.

I use NPM to redirect a domain name to the server with https.

I posted an edit to the post on how I i solved it. Your feedback was helpful in the solution!

I think so. One issue i ran in to is that trying to go anywhere would land on the ui page. If I put npm on ports 80/443, then the UI needs to be elsewhere so I can access it. It shouldn’t be too hard, I hope

Hmm, i may have to get my admin ui’s off of ports 80/443 and port forward with NPM on those ports instead. The reason I was using nginx on the router was so the server could keep the UI on the normal ports and Nginx elsewhere.

I think then I could remove the router Nginx entries and add the DNS rewrite

There’s an idea. I may play with it tomorrow.bill be back on the road, so I’m not keen on doing too much when I can’t fix it haha. But right now the router is DNS, so when I did traceroute there was only one stop. But it was the SSL termination that got me. I might be able to download the stream module for Nginx. I think if I wanted to be optimal I may have to totally restructure that part…

Edit: thank you for the feedback, you’ve given me something to think about

You got me on to something. It looks like Nginx can be configured for tls passthrough https://serversforhackers.com/c/tcp-load-balancing-with-nginx-ssl-pass-thru