Rhaedas

Well, that’s fair then. Funny to see the downvote used properly lol.

I still stand by my second point. ICE are different than the cops and the rest, operating far outside any laws, and if the cops and company were better… at least when there was police injustice, sometimes citizens could fight back using the legal system. So far I haven’t heard of that happening with ICE, it might take a different kind of approach.

Wrong place to post. ICE aren’t even police.

What makes it fit here is that if the police were doing their job (protecting and serving the public) we’d have an offensive force on our side fighting these bastards.

Weird how either comment would earn downvotes. Wonder which one did it, and why. From ICE supporters or police supporters?

Ollama.com is another method of self hosting. Figuring out which model type and size for what equipment you have is key, but it’s easy to swap out. That’s just an LLM, where you go from there depends on how deep you want to get into the code. An LLM by itself can work, it’s just limited. Most of the addons you see are extra things to give memory, speech, avatars, and other extras to improve the experience and abilities. Or you can program a lot of that yourself if you know Python. But as others have said, the more you try to get out, the more robust a system you’ll need, which is why you find the best ones online in cloud format. But if you’re okay with slower responses and lower features, self hosting is totally doable, and you can do what you want, especially if you get one of the “Jailbroke” models that has had some of the safety limits modified out of them to some degree.

Also as mentioned, be careful not to get sucked in. Even a local model can be convincing enough sometimes to fool someone wanting to see things. Lots of people recognize that danger, but then belittle people who are looking for help in that direction (while marketing realizes the potential profits and tries very hard to sell it to the same people).