A home mini PC server plan with web, media, and AI services
The post describes a plan to run many home services on one powerful mini PC. The author plans to use Proxmox to run separate virtual servers and VLANs to split normal home internet from the server lab. The planned services include a portfolio site, a marketplace site, music streaming, a possible game server, and an AI chatbot. The chatbot would use a 4-bit Llama 3.1 8B model on the CPU to stay within 24GB RAM.
Key points
- The plan puts several home server services on one mini PC.
- Proxmox would be used to split services into separate virtual servers.
- VLANs would separate normal home traffic from server experiments.
- The AI chatbot is planned around a 24GB RAM limit.
- Cloudflare would handle outside traffic coming in.
Quick term guide
- portfolio
- A collection that showcases the work or projects someone has created.
- marketplace
- An online place where many sellers and buyers can meet and trade.
- streaming
- Here it means text is generated continuously as you speak, rather than waiting until you finish talking.
- AI chatbot
- A computer program that replies in a chat like a person.
- Mac mini
- A small desktop computer made by Apple.
- home server
- A personal computer setup at home used to run services or store files instead of regular daily use.
- AI model
- A program that can understand prompts and produce text, code, or answers.
- Cloudflare
- A service that protects websites and manages web traffic.