Change Pool from default to by Rack
neiltorda
108 Posts
July 23, 2025, 4:55 pmI had a 3 node petasan cluster with each node using the default bucket. I have added 3 new nodes, and these new nodes are setup in a 'by rack' bucket as shown in attached image at the bottom of this post. Each of the nodes has many OSDs attached.
When I added the new nodes I created a new pool for rbd usage called "SSD_by_Rack" and used a crush rule so that when I added added SSD OSD's to those nodes, they would be used by that Pool and no other pool. This worked great by the way!
I now have 6 nodes, in 3 different locations (one storage and one management in each location).
I have the 3 new nodes set so that they are in racks, by room.
How do I go about moving the original 3 nodes into the correct racks? There is already data on those nodes using different rules. If I just move them using the bucket view in the UI, what will happen to the data that is already there since it is using different rules.
What is the proper way to move the data that is in the pools using the non location aware pools to pools using the locations so that my pools stay up in the event a room goes offline?
Buckets:
Pools:
Change Pool from default to by Rack
neiltorda
108 Posts
I had a 3 node petasan cluster with each node using the default bucket. I have added 3 new nodes, and these new nodes are setup in a 'by rack' bucket as shown in attached image at the bottom of this post. Each of the nodes has many OSDs attached.
When I added the new nodes I created a new pool for rbd usage called "SSD_by_Rack" and used a crush rule so that when I added added SSD OSD's to those nodes, they would be used by that Pool and no other pool. This worked great by the way!
I now have 6 nodes, in 3 different locations (one storage and one management in each location).
I have the 3 new nodes set so that they are in racks, by room.
How do I go about moving the original 3 nodes into the correct racks? There is already data on those nodes using different rules. If I just move them using the bucket view in the UI, what will happen to the data that is already there since it is using different rules.
What is the proper way to move the data that is in the pools using the non location aware pools to pools using the locations so that my pools stay up in the event a room goes offline?
Buckets:
Pools: