Windows share from a Proxmox HA Ceph Cluster

@wikemanuel welcome to the forums! Ok, so it looks like using CephFS you can share out a directory to clients.

Take note of these official forum responses from Proxmox:

This first post makes it sound like Proxmox recommends simply creating a VM on top of your Ceph storage as normal and create your SMB/Samba share from the VM. This route would probably eliminate some complexities of exposing it directly from Ceph:

FORUM.PROXMOX.COM "https://forum.proxmox.com/threads/cephfs-usage-as-samba-or-something.81373/"

Cephfs usage as samba or something | Proxmox Support Forum

I am curios if you can point me in the right direction for this or if I am even looking for the right thing.

In short I have a ceph cluster with two...

This looks to be a walkthrough of creating Ceph storage to expose the storage directly:

FORUM.PROXMOX.COM "https://forum.proxmox.com/threads/shared-storage-for-vms-on-cephfs.109494/"

shared storage for VMs on cephfs | Proxmox Support Forum

Hi
First time posting here. I have a proxmox cluster with 3 nodes. All identical HP proliant (older models) server computers with 10G networking for CEPH...

I would probably venture to say that it might be best to take the VM route as you could then just backup your VM with your attached storage using Proxmox Backup server to make sure everything is safe. Otherwise, you could probably rsync the directory from CephFS to a storage location outside of Proxmox.

Let me know if this makes sense?

@brandon-lee thank you for the two links. The first option of creating a VM on top of Ceph and subsequent pool from inside the VM seems easiest. The storage pool I am trying to create spans 3 servers and a total of 168TB of disk storage. I may be out of my knowledge realm when saying this, but, it is my understanding that there is a "drive size limitation" in the VM environment when carving out storage (something like 2TB per volume). The goal is to have a single mountpoint for all 168TB and not several drives. Is there a particular type of VM/share combo I should look at using?

Ok so there are several layers to think about here. First is the layer assigned to Proxmox. It looks like Proxmox has no issues with very large volumes:

According to this post you can assign these very large volumes to a VMs:

FORUM.PROXMOX.COM "https://forum.proxmox.com/threads/maximun-size-of-volume-or-disk-that-can-be-assign-to-proxmox.7300/"

Maximun Size of Volume or Disk that can be assign to Proxmox | Proxmox Support Forum

Hello everyone, I have a SAN system in which I will store lots of data, the question is I am sure that I will use much more than 2 terabyte of data and I...

For 32-bit CPUs on 2.6 kernels, the maximum LV size is 16TB.
For 64-bit CPUs on 2.6 kernels, the maximum LV size is 8EB. (Yes, that is a very large number.)
For 2.4 based kernels, the maximum LV size is 2TB.

Also, on the operating system side, you would need to consider the configuration there as well. It looks like in Windows 2019, NTFS can support an 8 PB volume with 2048 KB cluster size. Note the documentation here:

LEARN.MICROSOFT.COM "https://learn.microsoft.com/en-us/windows-server/storage/file-server/ntfs-overview"

NTFS overview | Microsoft Learn

Learn how NTFS provides a full set of features including security descriptors, encryption, disk quotas, and rich metadata.

Also, here is a pretty cool discussion from 45 drives on really large Ceph storage: