Overview

Getting Started

Everything here runs on one (strong-ass) PC at the house. If you ever need a reference, this guide tells you how to get your devices connected, how to setup the tools, how to use the tools, and things to watch out for.

Install Tailscale — seriously, nothing here works without it

What it is: a free app that assigns your phone or laptop to our own private family network with the house server. Every device in the group is given an additional IP address (unique within the family group) that allows them to communicate with each other no matter where you are. Once your device is in the group (aka Tailnet), the server behaves exactly as if we were at home connecting over LAN.

Why it matters: the server isn't on the public internet, so a stranger can't just type in an address and find it. Tailscale is the door, and only invited devices get through so we can rest assured knowing our data is private and nobody outside the family (unless I allow it) can access the server. It also means nothing breaks if the server changes location — the addresses follow the machine, not the building.

Setting it up:

  1. Ask Andy for an invite. You'll get an email link — it only works once, and it's specific to you.
    • Make an account for Tailscale with your own email, and if/when prompted, join the wubiz1104@gmail.com network.
  2. Install Tailscale — find it on your app store (iOS, Android, Mac, Windows, Linux — all supported) or click on the link. Do this for all devices you want to be allowed to access the server—probably just your phone and laptop.
  3. Sign into the app using your newly created account.
  4. Toggle it on, and make sure you can see the other devices in our family network (especially Wu-House-PC which is the server itself).

That's it. Leave it on and forget about it; it sits in the background, doesn't impact normal usage, and takes up almost nothing in the way of device memory and/or power consumption.

NOTE: you may see a VPN active symbol on your phone, this is normal and won't affect anything else.

Private Family AI/LLM Chat

What it is: a private ChatGPT-style assistant. Everything you type and receive in chats is stored privately on Wu-House-PC's SSD. No subscription, no usage limits, no company reading our data.

Setting it up:

  1. Make sure Tailscale is on.
  2. Click the "Private Family AI" card on this website's landing page, OR simply go to this link in any browser: http://100.108.90.123:3000
  3. Create an account and remember your login credentials—all chat history is unique to your own account.
  4. Log in.
  5. If on your phone, use your browser's "Add to Home Screen" option to get an app-style icon; this way it's easy access and your login persists across sessions (so you don't have to type it in every time).

Web search and Code Interpreter are toggles in the bottom left corner of the chat box ("Integrations" button). Off by default, so turn it on when you need their functionality; works on every model.

Uploading images only works with the vision model (see below). The others will ignore any uploaded image.

File Generation: these models don't have the advanced tools commercial LLMs do to generate complex files (like powerpoints, pdfs, images, etc.), but there is a workaround if you ask it to generate a python program that creates the file for you. Any code files it generates for you can be found in the notes tab (left side-panel) on the user interface.

The models — which one to pick

There's a dropdown menu on the bottom right corner of the chat to select a model. They differ in what they're good at.

ModelUse it for
qwen3.6-27b(this is original model we determined was best on hugging face, David) Everyday default. General questions, writing, explaining things.
qwen3.8-27b Updated version of qwen3.6. Slightly sharper and more accurate answers, but slightly slower. Worth it when quality matters more than speed. Quantized to 5-bits (Q5).
qwen3.8-vision The only one that can see images. Upload a photo, screenshot, or diagram and ask about it. Otherwise similar to 3.8, but slightly lower fidelity (Q4).
qwen3-coder-30b Writing and debugging code. Noticeably faster than the others and efficient for coding specifically, but not the best for all other use cases.
deepseek-distill-32b Hard problems that need step-by-step reasoning — math, logic, puzzles, etc. Largest model size so less room in memory for kv-cache, slowest.

Switching models takes time — pick one and stick with it unless you need different functionality

The server can only hold one model in memory (VRAM) at a time. Switching means unloading one and loading the next one in from the hard drive (the models are 16-20GB each), which takes 20–30 seconds before you get your first word back.

This is normal and not a malfunction, but if you flip between models on every prompt, you'll spend most of your time waiting.

This same wait time happens on the very first question after someone's been streaming a remote desktop/gaming session, or after the server restarts. After that, the last model used will stay loaded on the card indefinitely (until it is evicted by another model or someone starts gaming).

NOTE: the models think out loud so you can choose to view the full thought process before it gives a final response.

Remote Desktop/Gaming

If you ever need to run a process, application, or game that is compute-heavy/graphics-intensive, stream the server desktop to your device remotely and take advantage of its powerful GPU! This is basically free Geforce NOW but without the wait time; I remember us dealing with wait times when trying to game at home over the holidays so I hope this will be useful for us (mostly me and Alex probably). Two ways in:

Moonlight app (better quality)

Install Moonlight — free, find it on your app store or go to that link.

  1. Open it with Tailscale on.
  2. Add the server manually using this IP address: 100.108.90.123
  3. It will show you a 4-digit code. Send/tell it to Andy so he can approve the device server-end.
  4. Done. It should connect on its own from then on.

Set screen resolution and bitrate accordingly if there are latency/speed issues. The bottleneck is usually your internet (the client receives much more data than it sends), but could be the server's problem if the wifi at home is especially shitty one day.

Browser-based (nothing to install, fast)

  1. Click on the "Remote Desktop/Gaming" -> "Browser-Based" cards on the landing page, or go to this link: https://wu-house-pc.tailc390a9.ts.net/stream.html?hostId=3875431862&appId=881448767

That's it, you're logged in automatically — no password, no setup. Good for a quick session or running a large program.

NOTE: significantly worse quality than the moonlight app. For gaming, use Moonlight app.

Things to know

Latency and Speed also depend on distance. While the main factor is how good your wifi is, how close you are to home/the server also determines how well it performs. If we're at home or within a 2 hour drive, it should run even better than Geforce NOW. Otherwise, it'll be comparable or slower.

One person at a time. I have yet to configure the GPU to partition VRAM across multiple games (would theoretically be able to run two average games well or 1 intense game well and 1 other game shittily). If you guys want that feature I can try to add it, but I doubt we'll ever need it.

You can use your own Steam account. You're seeing the real desktop, so just log out of Steam and log into yours normally (or play my games).

Not every game works. Some MMO games — like Counter Strike, Fortnite, etc — won't run on this setup because linux disallows anti-cheat software on the OS kernel level. Don't think this will matter because you guys don't play that gay stuff.

Gaming pauses the AI. If someone tries to prompt the AI while someone else is gaming, the chat will display a message saying it's unavailable. That's deliberate — both need the same graphics card. If you need the AI, text whoever's playing and tell them to stop.

Thermals Dashboard

A live terminal reading of how hot the server is running (both CPU and GPU). Click the card on the landing page with Tailscale on. It's read-only so you can look, but can't break anything even if you tried.

Mostly useful for me, but handy if you're curious how hard the machine is working while you're using it. I set up temperature ranges and a color code to determine if:

  • Components have degraded severely/are broken
  • Fans need replacing
  • Thermal paste on the CPU cooler needs replacing

Let me know if you ever see red.

Things to be aware of

The status light in the top right corner is real, not just cosmetic. Wu-House-PC checks in with this website every 60 seconds, so green means the machine is currently online, and red means it's offline — either powered off, restarting, or crashed. If it's red there is nothing to fix on your end; none of the services will work until it comes back. If the light is ever green but the services don't work, let me know.

If something ever doesn't load, check Tailscale first. Nine times out of ten the answer is that Tailscale got switched off. Fully sign out and back in if toggling doesn't fix it — a plain refresh sometimes isn't enough.

The server restarts by itself sometimes. There's a known bug in the graphics driver that occasionally freezes the machine (Ubuntu 26.04 distro of Linux OS is not yet optimized for AMD hardware); I set up a 2 layer failsafe to detect that and reboot itself within a minute or two—same applies if there is a power outage at home. All services auto-start on system boot up so everything should come back on its own.

We can add other people if we want. Mia is set up (mostly to help me with testing), and I'm happy to add Jenna and Sooyoung (if they care/want to use the AI or remote computing services, maybe not lol). There is a 6-seat limit on the Tailnet however, so up to us to determine if Mom and Dad are more likely to use it or them.

If a game is running slowly: Try lowering the resolution in Moonlight's settings, but if you're halfway across the world then it may just be very slow regardless(haven't tested that yet).

Why is this thing running Linux? (read only if you're curious)

I've never needed to use Linux besides a few systems classes at Northwestern and setting this up; most people never need to use it day to day but if you're curious:

  • An always-on server needs to sit in a room and run for weeks on end without anyone touching it. Windows and MacOS are built around the assumption that a person is present — driver and OS updates are automatically installed (often at random/inconvenient times), it restarts when it feels like it, runs a bunch of extraneous background processes, and pops up things that need clicking.
  • Linux essentially does what it's told and little else. It also has lower idle power overhead (saves on the electricity bill since it's running 24/7), is easier to access remotely (I can SSH into the server command line from anywhere), gives me control over when updates and processes are allowed to happen, and it's open source (so I didn't have to pay $100-200 for windows lol).
Technical Details