Petasan single node
martink
1 Post
June 8, 2025, 7:05 pmQuote from martink on June 8, 2025, 7:05 pmI’m using Petasan from its beginning, when was just iSCSI. I like it all the time…
I wanted to see how ver4 runs. Not having hardware in hand I used mission critical Proxmox cluster with Ceph Hyper. Proxmox OSes are running on ZFS mirror with enough space for 3 Petasan instances, so I installed all 3 on one node. Not having available any SSD, each Petasan received 3 virtual disks from Proxmox Ceph RBD.
Anything went smoothly starting Petasan cluster with 9 OSDs. A big surprise, it is working and actually very good. Performance is much better than expected. What about disks pass through to Petasan? Or even better, what about creating single Petasan node? It is not difficult to start Ceph on a single node. Question is web gui. Petasan web gui is great.
In last time, many FreeBSD ZFS based open source storages died. Rest of open source storages are more toys then serious storage. Anyone can make its own storage with FreeBSD or Debian + ZFS, but ZFS is not running as on FreeBSD. In the other hand, Ceph is native for Debian what we can see with Petasan.
So… There is no serious open source single node ZFS or ZFS-like storage. ZFS is great and Ceph scale-out is amazing. Petasan Ceph single node could become complete success.
How many of you are struggling with what to use for simply working single node CIFS/NFS/iSCSI storage, not needing a coffee machine integrated with bugs?
I’m using Petasan from its beginning, when was just iSCSI. I like it all the time…
I wanted to see how ver4 runs. Not having hardware in hand I used mission critical Proxmox cluster with Ceph Hyper. Proxmox OSes are running on ZFS mirror with enough space for 3 Petasan instances, so I installed all 3 on one node. Not having available any SSD, each Petasan received 3 virtual disks from Proxmox Ceph RBD.
Anything went smoothly starting Petasan cluster with 9 OSDs. A big surprise, it is working and actually very good. Performance is much better than expected. What about disks pass through to Petasan? Or even better, what about creating single Petasan node? It is not difficult to start Ceph on a single node. Question is web gui. Petasan web gui is great.
In last time, many FreeBSD ZFS based open source storages died. Rest of open source storages are more toys then serious storage. Anyone can make its own storage with FreeBSD or Debian + ZFS, but ZFS is not running as on FreeBSD. In the other hand, Ceph is native for Debian what we can see with Petasan.
So… There is no serious open source single node ZFS or ZFS-like storage. ZFS is great and Ceph scale-out is amazing. Petasan Ceph single node could become complete success.
How many of you are struggling with what to use for simply working single node CIFS/NFS/iSCSI storage, not needing a coffee machine integrated with bugs?
f.cuseo
96 Posts
June 27, 2025, 10:51 amQuote from f.cuseo on June 27, 2025, 10:51 amPeta in PetaSAN means that is a scalable platform that you will use for a big amount of data, possibly with no spof, and with plans to grow without any conversion/data migration.
Yes, you are using petasan in a "test plant" mode, and for you need is enoght, but you have introduced some layer of complexity not needed, with loss of performances.
I use PetaSAN with small (3 hosts, 36 drives, both ssd and hdd) installation, tipically with cephFS, and of course, I can use a simple and friendly GUI, but I have done it because is planned to grow and add 4th, 5th, 6th host, and so on. I also have a larger cluster (near 1 Petabyte) with 10 servers and 120 big drives, mostly for RGW object storage.
If you are simply searching for a NAS, not scalable, you can use TrueNAS or OpenMediaVault, or a commercial nas like QNAP/Synology/Terramaster and so on.
My personal thoughts
Peta in PetaSAN means that is a scalable platform that you will use for a big amount of data, possibly with no spof, and with plans to grow without any conversion/data migration.
Yes, you are using petasan in a "test plant" mode, and for you need is enoght, but you have introduced some layer of complexity not needed, with loss of performances.
I use PetaSAN with small (3 hosts, 36 drives, both ssd and hdd) installation, tipically with cephFS, and of course, I can use a simple and friendly GUI, but I have done it because is planned to grow and add 4th, 5th, 6th host, and so on. I also have a larger cluster (near 1 Petabyte) with 10 servers and 120 big drives, mostly for RGW object storage.
If you are simply searching for a NAS, not scalable, you can use TrueNAS or OpenMediaVault, or a commercial nas like QNAP/Synology/Terramaster and so on.
My personal thoughts
Petasan single node
martink
1 Post
Quote from martink on June 8, 2025, 7:05 pmI’m using Petasan from its beginning, when was just iSCSI. I like it all the time…
I wanted to see how ver4 runs. Not having hardware in hand I used mission critical Proxmox cluster with Ceph Hyper. Proxmox OSes are running on ZFS mirror with enough space for 3 Petasan instances, so I installed all 3 on one node. Not having available any SSD, each Petasan received 3 virtual disks from Proxmox Ceph RBD.
Anything went smoothly starting Petasan cluster with 9 OSDs. A big surprise, it is working and actually very good. Performance is much better than expected. What about disks pass through to Petasan? Or even better, what about creating single Petasan node? It is not difficult to start Ceph on a single node. Question is web gui. Petasan web gui is great.
In last time, many FreeBSD ZFS based open source storages died. Rest of open source storages are more toys then serious storage. Anyone can make its own storage with FreeBSD or Debian + ZFS, but ZFS is not running as on FreeBSD. In the other hand, Ceph is native for Debian what we can see with Petasan.
So… There is no serious open source single node ZFS or ZFS-like storage. ZFS is great and Ceph scale-out is amazing. Petasan Ceph single node could become complete success.
How many of you are struggling with what to use for simply working single node CIFS/NFS/iSCSI storage, not needing a coffee machine integrated with bugs?
I’m using Petasan from its beginning, when was just iSCSI. I like it all the time…
I wanted to see how ver4 runs. Not having hardware in hand I used mission critical Proxmox cluster with Ceph Hyper. Proxmox OSes are running on ZFS mirror with enough space for 3 Petasan instances, so I installed all 3 on one node. Not having available any SSD, each Petasan received 3 virtual disks from Proxmox Ceph RBD.
Anything went smoothly starting Petasan cluster with 9 OSDs. A big surprise, it is working and actually very good. Performance is much better than expected. What about disks pass through to Petasan? Or even better, what about creating single Petasan node? It is not difficult to start Ceph on a single node. Question is web gui. Petasan web gui is great.
In last time, many FreeBSD ZFS based open source storages died. Rest of open source storages are more toys then serious storage. Anyone can make its own storage with FreeBSD or Debian + ZFS, but ZFS is not running as on FreeBSD. In the other hand, Ceph is native for Debian what we can see with Petasan.
So… There is no serious open source single node ZFS or ZFS-like storage. ZFS is great and Ceph scale-out is amazing. Petasan Ceph single node could become complete success.
How many of you are struggling with what to use for simply working single node CIFS/NFS/iSCSI storage, not needing a coffee machine integrated with bugs?
f.cuseo
96 Posts
Quote from f.cuseo on June 27, 2025, 10:51 amPeta in PetaSAN means that is a scalable platform that you will use for a big amount of data, possibly with no spof, and with plans to grow without any conversion/data migration.
Yes, you are using petasan in a "test plant" mode, and for you need is enoght, but you have introduced some layer of complexity not needed, with loss of performances.
I use PetaSAN with small (3 hosts, 36 drives, both ssd and hdd) installation, tipically with cephFS, and of course, I can use a simple and friendly GUI, but I have done it because is planned to grow and add 4th, 5th, 6th host, and so on. I also have a larger cluster (near 1 Petabyte) with 10 servers and 120 big drives, mostly for RGW object storage.
If you are simply searching for a NAS, not scalable, you can use TrueNAS or OpenMediaVault, or a commercial nas like QNAP/Synology/Terramaster and so on.
My personal thoughts
Peta in PetaSAN means that is a scalable platform that you will use for a big amount of data, possibly with no spof, and with plans to grow without any conversion/data migration.
Yes, you are using petasan in a "test plant" mode, and for you need is enoght, but you have introduced some layer of complexity not needed, with loss of performances.
I use PetaSAN with small (3 hosts, 36 drives, both ssd and hdd) installation, tipically with cephFS, and of course, I can use a simple and friendly GUI, but I have done it because is planned to grow and add 4th, 5th, 6th host, and so on. I also have a larger cluster (near 1 Petabyte) with 10 servers and 120 big drives, mostly for RGW object storage.
If you are simply searching for a NAS, not scalable, you can use TrueNAS or OpenMediaVault, or a commercial nas like QNAP/Synology/Terramaster and so on.
My personal thoughts