Need a ideal solution for my problem.

I represent a small company based in Chennai, India. We are a team of 3 working on web application development using Python.

Our company has decided to invest in GenAI, TTS, local LLMs, etc., and we plan to assemble a PC with the following specs: Core i9 Ultra 285k, 128GB RAM, RTX 4080. This PC will be shared within our local network among the 3 of us.

The challenge is that we work in both Windows and Linux environments. I want to use this new PC in a way that each of us has access to our own virtual machine (VM), similar to having individual VPS accounts (like EC2 or Hostinger) but within a local network with local IPs. We should have our own control panel (e.g., like SolusVM) to manage tasks such as restarting the OS, taking snapshots, etc.

I tried Proxmox, but I encountered difficulties in setting up separate logins for each user to access their allocated VPS.

One more critical issue is that we need to share the GPU (RTX 4080) among the three users based on their usage. Since the RTX 4080 doesn't support vGPU, I’m unsure how to configure GPU sharing efficiently.

What would be a good solution for this setup? I would like the following:

1. GPU sharing among the users.
2. Each user should get a local IP for SSH access to their own VM.
3. An open-source solution for managing the environment.