There are 3 lines with the :11434 in them. No brackets or anything like that. -1 has 0.0.0.0 in front -2 has 10.#.#.# in front and has a foreign address that is something other than 0.0.0 -3 is like the 2nd but a slightly different foreign address

The iPhone does have a 10.#.#.# ip number that is slightly different than the PCs.

The subnet mask is 255.255.255.0

Oh yes. I’m on windows 10 as well.

I have taken a pause here while we trouble shoot the subnet mask. We’re getting close!!

Dope! This is exactly what I needed! I would say that this is a very “hand holding” explanation which is perfect because I’m starting with 0% knowledge in this field! And I learned so much already from this post and your comment!

So here’s where I’m at, -A backend is where all the weird c++ language stuff happens to generate a response from an AI. -a front end is a pretty app or webpage that takes that response and make it more digestible to the user. -agreed. I’ve seen in other posts that exposing a port on windows defender firewall is the easiest (and safest?) way to go for specifically what I’m looking for. I don’t think I need to forward a port as that would be for more remote access. -I went to the whatismyipaddress website. The ipv6 was identical to one of the ones I have. The ipv4 was not identical. (But I don’t think that matters moving forward.) -I did the ipconfig in the command prompt terminal to find the info and my ipv4 is 10.blahblahblah.

• I ran netstat -abn (this is what worked to display the necessary info). I’m able to see 0.0.0.0 before the 11434! I had to go into the settings in the ollama backend app to enable “expose Ollama to the network”.

I’m ready for the next steps!

Bet. Looking into that now. Thanks!

I believe I have 11g of vram, so I should be good to run decent models from what I’ve been told by the other AIs.

Sever is my rig which is running windows. Phone is iPhone.

Exposing the port is something I’ve tried to do in the past with no success! When you say, change the bind address, do I do that in the windows defender firewall in the inbound rules section?

Backend/ front end. I see those a lot but I never got an explanation for it. In my case, the backend would be Ollama on my rig, and the front end would be me using it on my phone, whether that’s with and app or web ui. Is that correct?

I will add kobold to my list of AIs to check out in the future. Thanks!

Ollama has an app (or maybe interface is a better term for it) on windows right that I download models too. Then I can use said app to talk to the models. I believe Reins: Chat for Ollama is the app for iPhone that allows me to use my phone to chat with my models that are on the windows rig.

Yes exactly! I would love to keep it on my network for now. I’ve read that “exposing a port” is something I may have to do in my windows firewall options.

Yes I have Ollama on my windows rig. But im down to try out a different one if you suggest so. TBH, im not sure if librechat has a web ui. I think accessing the LLM on my phone via web browser would be easiest. But there are apps out there like Reins and Enchanted that I could take advantage of.

For right now I just want to do whatever is easiest so I can get a better understanding of what I’m doing wrong.

Oh! Also, I’m using windows on my PC. And my phone is an iPhone.

I’m not using Linux yet, but that is in my todo list for the future! After I get more comfortable with some more basics of self hosting.

Bet, I’ll try that when I get home tonight. If I don’t have success can I message you directly ?

Bet. I believe what you mentioned is best for accessing my LLM no matter where I am in the world, correct? If so I will try this one after I try what the other person suggested.

Thank you!

lol I have! They all say the same similar thing but it’s just not working for me.

I thought I was stuck there but I misspoke. I made an edit to the original post. Thanks for the insight tho! In sure that’ll be helpful once I actually get there.

I made an error in my original post. Please see the edit I made.

But I think I’m understanding a bit! I need to literally create a file named “/etc/radicale/config”. Then after that I need to copy/paste the configuration file/command line into said folder. Once I do that then I should be able to move onto authentication and then addresses.

I misspoke earlier. I wasn’t having issues with the addresses part, I didn’t even make it that far. I’m stuck on authentication. I updated the original post and added a pic for clarity.

Gotta be honest, idk what half of the words you just said mean. Core count, vram… still have some learning to do.

My plan is to run ollama on my rig kinda like a server I guess. And then Use my phone to tap into that whenever I need it. From what I researched that seems doable, but will take some set up.

Nice! Good sublemmy to follow! (Is sublemmy the right word)

Thanks for the tips! I just started playing around with ollama so I think the self hosting route is next.

I was kinda doing it wrong. When I download the model it was very slow. But now that I’m using the model my inquires are done at an ok speed (10-30sec depending on what I ask)

Interesting that you need stronger GPU instead of CPU? Can you tell I know next to nothing about tech ….

I just started messing around with ollama. I must be doing something wrong because it’s sooooo slow. I still need to trouble shot it a lil bit before it becomes my main AI.

Sheesh, that sounds like a Black Mirror episode. I know a majority of my info/data now is most likely compromised, but moving forward I can make a difference. Also, I can prep these tools for the young ones in my family who aren’t on the internet yet.

I definitely need some advice for self hosting! I literally have no idea what I’m doing. I have a raspberry pi and another user said that may be enough to get started.

Could you share some videos or links or blogs that explain how to get started?

That does slightly concern me that ddg is linked to Microsoft. If I’m going thru all this trouble to make my life more private then I believe I need to cut out the major companies as well.