I'm creating this post for reference and to show how I plan to extend X.I.A.R's (my Hals new name) capabilities in case anyone else wants to do something similar
Note: I can only work on the pc for very short periods of time due to injury, so this will take me a while to implement.
this setup can be essential and is extremely powerful if you have a business, website, and/or social media accounts, and home automation. In short, the goal here is to be able to be anywhere in the world and connect to my LLM set-up, that I am slowly setting up on my desktop. to chat with, to run automations like create multiple social media posts with images and or videos and post to different social media platforms and websites, to receive data or queries about my documents, to create images, and create videos.
The first step is setting up a LLM, RAG, and LLM Agent builders onto my windows powered desktop, to do this easily I found a tutorial online here:
https://www.youtube.com/watch?v=23s2N3ug8B8 the second step is having a website setup, you'll see why this is needed in the next steps video.
and the third step to set this all up, I will need to have a secure way to be able to access and control my home desktop application anywhere in the world, where I have an internet connection. I found this video to explain and show how to set this up:
https://www.youtube.com/watch?v=bxEmW1gAyRwand final step is to bridge X.I.A.R. installed on the same local desktop, so when I'm at home I can use X.I.A.R to sends commands to "Open WebUI" and receive the outputs from Open WebUI
LLM I will be utilizing:
basic chat and commander of agents = Ollama
automation agent = PHI4
automation agent = mistral
automation agent = Qwen
automation agent = LLaMA
image creation = Stable Diffusion
video creation = Stable Diffusion
