PetaSAN 4.0.0 Released!
Pages: 1 2
admin
2,973 Posts
April 7, 2025, 6:49 pmQuote from admin on April 7, 2025, 6:49 pmYou can increase it in the UI in Ceph Configuration page changing the value bluestore_block_db_size from default 60 GB.
It will affect new OSD being added.
Large db partitions is required if you have large capacity OSDs and you are storing many small objects.
You can increase it in the UI in Ceph Configuration page changing the value bluestore_block_db_size from default 60 GB.
It will affect new OSD being added.
Large db partitions is required if you have large capacity OSDs and you are storing many small objects.
Last edited on April 7, 2025, 6:59 pm by admin · #11
f.cuseo
86 Posts
April 10, 2025, 12:59 pmQuote from f.cuseo on April 10, 2025, 12:59 pm
Quote from f.cuseo on March 31, 2025, 8:26 am
Quote from admin on March 30, 2025, 7:12 pm
What client side tool do you use? we will try to test this ourselves, probably within this coming month.
Hello.
I am using rclone, several versions.
Now i will try with different clients.
Thanks, Fabrizio
rclone version
rclone v1.53.3-DEV
- os/arch: linux/amd64
- go version: go1.18.1
------------
rclone2 version
rclone v1.64.2
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.0-88-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.3
- go/linking: static
- go/tags: none
---------------
./rclone version
rclone v1.69.1
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.0-88-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.24.0
- go/linking: static
- go/tags: none
Hello.
Have you tested something for this problem ?
Thanks, Fabrizio
Quote from f.cuseo on March 31, 2025, 8:26 am
Quote from admin on March 30, 2025, 7:12 pm
What client side tool do you use? we will try to test this ourselves, probably within this coming month.
Hello.
I am using rclone, several versions.
Now i will try with different clients.
Thanks, Fabrizio
rclone version
rclone v1.53.3-DEV
- os/arch: linux/amd64
- go version: go1.18.1
------------
rclone2 version
rclone v1.64.2
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.0-88-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.3
- go/linking: static
- go/tags: none
---------------
./rclone version
rclone v1.69.1
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.0-88-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.24.0
- go/linking: static
- go/tags: none
Hello.
Have you tested something for this problem ?
Thanks, Fabrizio
admin
2,973 Posts
April 10, 2025, 1:15 pmQuote from admin on April 10, 2025, 1:15 pmAs i understand you tested S3Browser and it worked, correct ?
internally we test with S3Browser and Amazon cli. There could be different behaviour using different clients, it is hard for us to support all, i cannot commit we will look at rclone soon. Ofcourse if you engage us in support we can dedicate time to this.
As i understand you tested S3Browser and it worked, correct ?
internally we test with S3Browser and Amazon cli. There could be different behaviour using different clients, it is hard for us to support all, i cannot commit we will look at rclone soon. Ofcourse if you engage us in support we can dedicate time to this.
f.cuseo
86 Posts
April 24, 2025, 2:33 pmQuote from f.cuseo on April 24, 2025, 2:33 pmHello Admin.
There is the possibility that ceph will be upgraded to 18.2.6 ? (last reef release).
Thank you.
Hello Admin.
There is the possibility that ceph will be upgraded to 18.2.6 ? (last reef release).
Thank you.
admin
2,973 Posts
April 24, 2025, 7:12 pmQuote from admin on April 24, 2025, 7:12 pmIt is possible, but not very near future. 18.2.6 was released last week, it solved issues in 18.2.5 released a week earlier.
Note we will look into the rclone mutiplart upload issue, hopefully we can schedule it soon, can you give any info like steps to reproduce or is it easily reproduce-able ? Any custom settings you have ? Can you confirm S3 Browser works ok ?
It is possible, but not very near future. 18.2.6 was released last week, it solved issues in 18.2.5 released a week earlier.
Note we will look into the rclone mutiplart upload issue, hopefully we can schedule it soon, can you give any info like steps to reproduce or is it easily reproduce-able ? Any custom settings you have ? Can you confirm S3 Browser works ok ?
Last edited on April 24, 2025, 7:13 pm by admin · #15
f.cuseo
86 Posts
April 27, 2025, 6:26 pmQuote from f.cuseo on April 27, 2025, 6:26 pm
Quote from admin on April 24, 2025, 7:12 pm
It is possible, but not very near future. 18.2.6 was released last week, it solved issues in 18.2.5 released a week earlier.
Note we will look into the rclone mutiplart upload issue, hopefully we can schedule it soon, can you give any info like steps to reproduce or is it easily reproduce-able ? Any custom settings you have ? Can you confirm S3 Browser works ok ?
Of course, is easy to reproduce.
First, with S3Browser no any problems, works like a charm with big size files.
With nextcloud (that uses aws-sdk-tool), and with rclone, if you have a 3.2.1 cluster, works with small and big files; if you upgrade the cluster to 3.3.0, files bigger than some megabyte (4/5 megabytes) can't be uploaded. Same if you upgrade to 4.0
I am testing with a virtual (PetaSAN over Proxmox) cluster, but I had the problem with a real cluster (3.3.0) that now I am using with 2 nodes that acts as rados-gw gateways and 3.2.1 release.
Quote from admin on April 24, 2025, 7:12 pm
It is possible, but not very near future. 18.2.6 was released last week, it solved issues in 18.2.5 released a week earlier.
Note we will look into the rclone mutiplart upload issue, hopefully we can schedule it soon, can you give any info like steps to reproduce or is it easily reproduce-able ? Any custom settings you have ? Can you confirm S3 Browser works ok ?
Of course, is easy to reproduce.
First, with S3Browser no any problems, works like a charm with big size files.
With nextcloud (that uses aws-sdk-tool), and with rclone, if you have a 3.2.1 cluster, works with small and big files; if you upgrade the cluster to 3.3.0, files bigger than some megabyte (4/5 megabytes) can't be uploaded. Same if you upgrade to 4.0
I am testing with a virtual (PetaSAN over Proxmox) cluster, but I had the problem with a real cluster (3.3.0) that now I am using with 2 nodes that acts as rados-gw gateways and 3.2.1 release.
Pages: 1 2
PetaSAN 4.0.0 Released!
admin
2,973 Posts
Quote from admin on April 7, 2025, 6:49 pmYou can increase it in the UI in Ceph Configuration page changing the value bluestore_block_db_size from default 60 GB.
It will affect new OSD being added.
Large db partitions is required if you have large capacity OSDs and you are storing many small objects.
You can increase it in the UI in Ceph Configuration page changing the value bluestore_block_db_size from default 60 GB.
It will affect new OSD being added.
Large db partitions is required if you have large capacity OSDs and you are storing many small objects.
f.cuseo
86 Posts
Quote from f.cuseo on April 10, 2025, 12:59 pmQuote from f.cuseo on March 31, 2025, 8:26 amQuote from admin on March 30, 2025, 7:12 pmWhat client side tool do you use? we will try to test this ourselves, probably within this coming month.
Hello.
I am using rclone, several versions.
Now i will try with different clients.Thanks, Fabrizio
rclone version
rclone v1.53.3-DEV
- os/arch: linux/amd64
- go version: go1.18.1------------
rclone2 version
rclone v1.64.2
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.0-88-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.3
- go/linking: static
- go/tags: none---------------
./rclone version
rclone v1.69.1
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.0-88-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.24.0
- go/linking: static
- go/tags: noneHello.
Have you tested something for this problem ?
Thanks, Fabrizio
Quote from f.cuseo on March 31, 2025, 8:26 amQuote from admin on March 30, 2025, 7:12 pmWhat client side tool do you use? we will try to test this ourselves, probably within this coming month.
Hello.
I am using rclone, several versions.
Now i will try with different clients.Thanks, Fabrizio
rclone version
rclone v1.53.3-DEV
- os/arch: linux/amd64
- go version: go1.18.1------------
rclone2 version
rclone v1.64.2
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.0-88-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.21.3
- go/linking: static
- go/tags: none---------------
./rclone version
rclone v1.69.1
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.0-88-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.24.0
- go/linking: static
- go/tags: none
Hello.
Have you tested something for this problem ?
Thanks, Fabrizio
admin
2,973 Posts
Quote from admin on April 10, 2025, 1:15 pmAs i understand you tested S3Browser and it worked, correct ?
internally we test with S3Browser and Amazon cli. There could be different behaviour using different clients, it is hard for us to support all, i cannot commit we will look at rclone soon. Ofcourse if you engage us in support we can dedicate time to this.
As i understand you tested S3Browser and it worked, correct ?
internally we test with S3Browser and Amazon cli. There could be different behaviour using different clients, it is hard for us to support all, i cannot commit we will look at rclone soon. Ofcourse if you engage us in support we can dedicate time to this.
f.cuseo
86 Posts
Quote from f.cuseo on April 24, 2025, 2:33 pmHello Admin.
There is the possibility that ceph will be upgraded to 18.2.6 ? (last reef release).
Thank you.
Hello Admin.
There is the possibility that ceph will be upgraded to 18.2.6 ? (last reef release).
Thank you.
admin
2,973 Posts
Quote from admin on April 24, 2025, 7:12 pmIt is possible, but not very near future. 18.2.6 was released last week, it solved issues in 18.2.5 released a week earlier.
Note we will look into the rclone mutiplart upload issue, hopefully we can schedule it soon, can you give any info like steps to reproduce or is it easily reproduce-able ? Any custom settings you have ? Can you confirm S3 Browser works ok ?
It is possible, but not very near future. 18.2.6 was released last week, it solved issues in 18.2.5 released a week earlier.
Note we will look into the rclone mutiplart upload issue, hopefully we can schedule it soon, can you give any info like steps to reproduce or is it easily reproduce-able ? Any custom settings you have ? Can you confirm S3 Browser works ok ?
f.cuseo
86 Posts
Quote from f.cuseo on April 27, 2025, 6:26 pmQuote from admin on April 24, 2025, 7:12 pmIt is possible, but not very near future. 18.2.6 was released last week, it solved issues in 18.2.5 released a week earlier.
Note we will look into the rclone mutiplart upload issue, hopefully we can schedule it soon, can you give any info like steps to reproduce or is it easily reproduce-able ? Any custom settings you have ? Can you confirm S3 Browser works ok ?
Of course, is easy to reproduce.
First, with S3Browser no any problems, works like a charm with big size files.
With nextcloud (that uses aws-sdk-tool), and with rclone, if you have a 3.2.1 cluster, works with small and big files; if you upgrade the cluster to 3.3.0, files bigger than some megabyte (4/5 megabytes) can't be uploaded. Same if you upgrade to 4.0
I am testing with a virtual (PetaSAN over Proxmox) cluster, but I had the problem with a real cluster (3.3.0) that now I am using with 2 nodes that acts as rados-gw gateways and 3.2.1 release.
Quote from admin on April 24, 2025, 7:12 pmIt is possible, but not very near future. 18.2.6 was released last week, it solved issues in 18.2.5 released a week earlier.
Note we will look into the rclone mutiplart upload issue, hopefully we can schedule it soon, can you give any info like steps to reproduce or is it easily reproduce-able ? Any custom settings you have ? Can you confirm S3 Browser works ok ?
Of course, is easy to reproduce.
First, with S3Browser no any problems, works like a charm with big size files.
With nextcloud (that uses aws-sdk-tool), and with rclone, if you have a 3.2.1 cluster, works with small and big files; if you upgrade the cluster to 3.3.0, files bigger than some megabyte (4/5 megabytes) can't be uploaded. Same if you upgrade to 4.0
I am testing with a virtual (PetaSAN over Proxmox) cluster, but I had the problem with a real cluster (3.3.0) that now I am using with 2 nodes that acts as rados-gw gateways and 3.2.1 release.