Release v2.0.0. of Ceph CSI driver. #557

humblec · 2019-08-16T03:48:11Z

dillaman · 2019-10-09T11:59:28Z

Tracking here as well that RBD locking support will not land in the v2.0 due to missing external dependencies.

ajarr · 2019-10-11T12:03:26Z

@humblec @Madhu-1, I don't see the clone of FS subvolume snapshots feature being implemented in Ceph master, and backported to nautilus in time for CSI to be use by Nov 5.

Yes, we already have fs subvolume snapshot create/rm commands. Hence, we can easily support CephFS CSI volume snapshots. Is there a ceph-csi issue for RBD/CephFS snapshot?

The fs subvolume resizecommand is close to being done in Ceph. With this command you can easily implement resize feature for CSI v2.0.0

The following correctness/performance issues need to be fixed for v2.0.0
#539
#360

ajarr · 2019-10-14T07:23:14Z

@humblec @Madhu-1 ^^
Can you clarify? I don't see FS clone getting implemented in mgr/volumes module in time for v2.0.0 dev freeze. So can we remove it?

For now, let's stick to FS resize and snapshot that can be implemented in CSI in time?

Madhu-1 · 2019-10-14T07:34:32Z

moving FS clone out of v2.0.0 release as it is not getting implemented in ceph before cephcsi v2.0.0

Madhu-1 · 2019-10-16T15:28:42Z

Had a discussion with @humblec regarding cephfs cloning requirement, as this is required feature for CSI v2.0.0 release, and as code freeze date is the concern for implementing the cephfs cloning functionality moved the dev freeze date to 20 Nov

cloning covers below 2 things

creating a PVC from the snapshot
creating a PVC from existing PVC

@ajarr is this viable? if more time is required we can move the code freeze date according, please let me know your thoughts

ajarr · 2019-10-29T09:30:45Z

Had a discussion with @humblec regarding cephfs cloning requirement, as this is required feature for CSI v2.0.0 release, and as code freeze date is the concern for implementing the cephfs cloning functionality moved the dev freeze date to 20 Nov

cloning covers below 2 things

creating a PVC from the snapshot

creating a PVC from existing PVC

Looking at the CSI documentation, cloning covers only creating a PVC from an existing PVC,
https://kubernetes.io/docs/concepts/storage/volume-pvc-datasource/
https://kubernetes.io/blog/2019/06/21/introducing-volume-cloning-alpha-for-kubernetes/
"While cloning is similar in behavior to creating a snapshot of a volume, then creating a volume from the snapshot, a clone operation is more streamlined and is more efficient for many backend devices."

creating a PVC from a snapshot seems to be the Restore Volume from Snapshot feature
https://kubernetes.io/docs/concepts/storage/persistent-volumes/#volume-snapshot-and-restore-volume-from-snapshot-support

Wouldn't it be better to split the #411 into two feature requests as follows?

CephFS: Restore Volume from Snapshot
CephFS: Volume cloning

@joscollin please follow up on the above.

Regarding creating a PVC from a snapshot,
@vshankar will start working on the Ceph side to allow creating FS subvolumes from snapshots. You can track the progress here,
https://tracker.ceph.com/issues/24880

No plans yet on creating a PVC from existing PVC. Maybe it will just end up being a volume snapshot followed by creating a volume from snapshot?

@ajarr is this viable? if more time is required we can move the code freeze date according, please let me know your thoughts

Not sure yet. @joscollin will later update on the time required to implement creating FS subvolumes from snapshots feature in Ceph.

Madhu-1 · 2019-10-30T06:32:31Z

Had a discussion with @humblec regarding cephfs cloning requirement, as this is required feature for CSI v2.0.0 release, and as code freeze date is the concern for implementing the cephfs cloning functionality moved the dev freeze date to 20 Nov
cloning covers below 2 things

creating a PVC from the snapshot

creating a PVC from existing PVC

Looking at the CSI documentation, cloning covers only creating a PVC from an existing PVC,
https://kubernetes.io/docs/concepts/storage/volume-pvc-datasource/
https://kubernetes.io/blog/2019/06/21/introducing-volume-cloning-alpha-for-kubernetes/
"While cloning is similar in behavior to creating a snapshot of a volume, then creating a volume from the snapshot, a clone operation is more streamlined and is more efficient for many backend devices."

creating a PVC from a snapshot seems to be the Restore Volume from Snapshot feature
https://kubernetes.io/docs/concepts/storage/persistent-volumes/#volume-snapshot-and-restore-volume-from-snapshot-support

Wouldn't it be better to split the #411 into two feature requests as follows?

CephFS: Restore Volume from Snapshot

CephFS: Volume cloning

@joscollin please follow up on the above.

Regarding creating a PVC from a snapshot,
@vshankar will start working on the Ceph side to allow creating FS subvolumes from snapshots. You can track the progress here,
https://tracker.ceph.com/issues/24880

No plans yet on creating a PVC from existing PVC. Maybe it will just end up being a volume snapshot followed by creating a volume from snapshot?

yes you are correct if we same logic is backed by single cephfs command to create a volume from the volume will be more helpful here

@ajarr is this viable? if more time is required we can move the code freeze date according, please let me know your thoughts

Not sure yet. @joscollin will later update on the time required to implement creating FS subvolumes from snapshots feature in Ceph.

@ajarr Thanks for the update.

ajarr · 2019-10-30T10:57:12Z

Wouldn't it be better to split the #411 into two feature requests as follows?

CephFS: Restore Volume from Snapshot

CephFS: Volume cloning

Done. It should add more clarity.

Madhu-1 · 2019-11-06T05:12:38Z

as cephfs cloning cannot be completed in ceph core before v2.0.0 release, moving it out

CC @ajarr @humblec

sergeimonakhov · 2019-12-03T12:40:11Z

@humblec When is this release expected?

humblec · 2019-12-09T12:46:05Z

@humblec When is this release expected?

@D1abloRUS planning to release at end of this year, however there are some concerns about some of the feature completion which gives us 2 choice atm, that said, either push some of the incomplete features out of 2.0.0 and release 2.1.0 with those or delay the release and include maximum features in this release. We are waiting for couple more weeks to take the call and it should also help us to validate the state in a better way. I believe you are specifically interested in resize functionality , is that the case ? is it something you can use it from canary image of master?

sergeimonakhov · 2019-12-09T16:10:54Z

@humblec We can pick it up from the master, in any case the request #331 is still open

humblec · 2019-12-17T10:56:12Z

@humblec We can pick it up from the master, in any case the request #331 is still open

Its merged last week. You should be able to consume it from master. 👍

humblec · 2019-12-17T11:02:09Z

[Release call update]

Feature completed:

CephFS resize
RBD resize
Encryption support on rbd volumes
RBD nbd support -> Available : Known issue: the client mount will be disturbed ( same as fuse deamon) if node plugin is restarted.

Waiting for completion:

Multi arch support of CSI drivers
Native go client support

Deferred from v2.0.0 to 2.1.0

Topology Aware provisioning
Snapshot/Clone of RBD/cephfs support.

New Release Date
Code Freeze : 7- Jan -2019
RC : 15 -Jan-2019
GA: 20- Jan-2019

nixpanic · 2020-01-15T11:11:31Z

Moving out the native go-ceph implementation for now. Expect it to be ready for release-2.1.0. Performance improvement is currently minimal, as there are still a few calls to the rbd executable while creating volumes.

go-ceph will also mature more, and will be better tested by the time 2.1.0 is ready.

humblec · 2020-01-17T10:06:45Z

[Release call update]

Out of pending 2 features,

Multi arch support of CSI drivers
Native go client support

Native go client support has been deferred from the release 2.0.0. Please see comment #557 (comment)
Multi arch support has been merged/completed!

We are at final stage of building 2.0.0. It should be available at any time now :)

humblec · 2020-01-17T14:39:03Z

Waiting for ##764 to be merged. It should be the last PR for release 2.0.0

oguzkilcan · 2020-01-17T14:53:31Z

Is it possible for you to also consider #785 for 2.0.0 after #764 is merged?

humblec · 2020-01-17T15:03:24Z

Is it possible for you to also consider #785 for 2.0.0 after #764 is merged?

Sure, let me check.

humblec · 2020-01-17T15:08:17Z

Is it possible for you to also consider #785 for 2.0.0 after #764 is merged?

Sure, let me check.

ACK. Tagged for release-2.0.0

humblec · 2020-01-20T10:32:42Z

All the required PRs are merged.. We are at final stage of 2.0.0 release and build!! Thanks all !

Madhu-1 · 2020-01-20T14:00:56Z

closing this as ceph-csi v2.0.0 release is out https://github.com/ceph/ceph-csi/releases/tag/v2.0.0

humblec · 2020-01-20T14:30:24Z

Thanks to Ceph CSI community for our next major release (v2.0.0) !! Many features, bug fixes, documentation updates are part of this release !! It was a massive help from our community to roll out this big release .. Lets march toward our next big release v2.1.0 !!!

@vasyl-purchel @cyb70289 @wilmardo @hswong3i @nixpanic @sophalHong @woohhan @Madhu-1 .... 👍 💯

humblec self-assigned this Aug 16, 2019

humblec added release-2.0.0 v2.0.0 release Repo activity Process/activites on ceph-csi repo labels Aug 16, 2019

humblec mentioned this issue Dec 3, 2019

Resize RBD volumes on resizer request #331

Merged

humblec mentioned this issue Dec 9, 2019

Adds persistent volume claims encryption with LUKS #697

Merged

Madhu-1 mentioned this issue Dec 17, 2019

Add Version flag to cephcsi #704

Merged

Madhu-1 mentioned this issue Jan 3, 2020

Add support for dynamically resizing volumes provisioned with rook rook/rook#1169

Closed

Madhu-1 mentioned this issue Jan 13, 2020

CephFS CSI volume expand capacity / quota rook/rook#4669

Closed

Madhu-1 closed this as completed Jan 20, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Release v2.0.0. of Ceph CSI driver. #557

Release v2.0.0. of Ceph CSI driver. #557

humblec commented Aug 16, 2019 •

edited

Loading

dillaman commented Oct 9, 2019

ajarr commented Oct 11, 2019

ajarr commented Oct 14, 2019 •

edited

Loading

Madhu-1 commented Oct 14, 2019

Madhu-1 commented Oct 16, 2019

ajarr commented Oct 29, 2019

Madhu-1 commented Oct 30, 2019

ajarr commented Oct 30, 2019

Madhu-1 commented Nov 6, 2019

sergeimonakhov commented Dec 3, 2019

humblec commented Dec 9, 2019

sergeimonakhov commented Dec 9, 2019

humblec commented Dec 17, 2019

humblec commented Dec 17, 2019 •

edited

Loading

nixpanic commented Jan 15, 2020

humblec commented Jan 17, 2020 •

edited

Loading

humblec commented Jan 17, 2020

oguzkilcan commented Jan 17, 2020

humblec commented Jan 17, 2020

humblec commented Jan 17, 2020

humblec commented Jan 20, 2020

Madhu-1 commented Jan 20, 2020

humblec commented Jan 20, 2020 •

edited

Loading

Release v2.0.0. of Ceph CSI driver. #557

Release v2.0.0. of Ceph CSI driver. #557

Comments

humblec commented Aug 16, 2019 • edited Loading

dillaman commented Oct 9, 2019

ajarr commented Oct 11, 2019

ajarr commented Oct 14, 2019 • edited Loading

Madhu-1 commented Oct 14, 2019

Madhu-1 commented Oct 16, 2019

ajarr commented Oct 29, 2019

Madhu-1 commented Oct 30, 2019

ajarr commented Oct 30, 2019

Madhu-1 commented Nov 6, 2019

sergeimonakhov commented Dec 3, 2019

humblec commented Dec 9, 2019

sergeimonakhov commented Dec 9, 2019

humblec commented Dec 17, 2019

humblec commented Dec 17, 2019 • edited Loading

nixpanic commented Jan 15, 2020

humblec commented Jan 17, 2020 • edited Loading

humblec commented Jan 17, 2020

oguzkilcan commented Jan 17, 2020

humblec commented Jan 17, 2020

humblec commented Jan 17, 2020

humblec commented Jan 20, 2020

Madhu-1 commented Jan 20, 2020

humblec commented Jan 20, 2020 • edited Loading

humblec commented Aug 16, 2019 •

edited

Loading

ajarr commented Oct 14, 2019 •

edited

Loading

humblec commented Dec 17, 2019 •

edited

Loading

humblec commented Jan 17, 2020 •

edited

Loading

humblec commented Jan 20, 2020 •

edited

Loading