• 0 Posts
  • 19 Comments
Joined 3 years ago
cake
Cake day: July 21st, 2023

help-circle
  • I am running qwen 3.5 locally using llama.cpp on 8gb of VRAM and 16 gigs of RAM. It works well enough with a 4B to 9B parameter model along with quantization and MTP. More optimizations are on the way with turboquant and possibly other tech.

    It’s just there to assist me, not do all the work, so I am happy as long as I can self host it.

    I can’t say how well my specs would work in a professional setting but for personal use a MacBook should be sufficient in my opinion.




  • or whatever else you want to create!

    You understand that you can use CAD files to make custom internal components too, right? It’s not only for making skins or cosmetic surface changes.

    You can 3D print an entire new shell for the controller but replacing the shell requires that you remove all of the components to then put them back in to the new shell. And that I would consider advanced. Not recommended for people that do not know what they are doing.







  • I wish you luck on your endeavors! 😁 Since I got recommend Proxmox it has completely changed my home-labbing experience for the better. It works great!

    Feel free to ask if you have any questions about Proxmox and I will do my best to answer them. I am by no means an expert but I have a few peojects up and running and use NPMPlus to handle all the network routing.


  • If you want to host multiple things on that server I would suggest installing Proxmox VE. It’s Debian with everything necessary to create and manage containers and VMs. Everything is accessed from a Web interface and it’s super easy to access the terminals for the containers or use remote desktop for VMs you create.

    The latest version added the ability to install docker images directly into Proxmox without needing Docker but if you prefer to use Docker then you can install Docker in a container and install your things in there.

    Here’s a nice script to run afterwards to remove subscription nagging, remove enterprise repos that require subscription and add community repos.

    https://community-scripts.org/scripts/post-pve-install

    That site also has lots of amazing scripts to install and configure self-host projects!

    A good project to try is Pelican if you want to have an easy way to create and manage game servers. It’s very simple to get the game servers up and running once Pelican is configured properly.