Project

General

Profile

Actions
Copy link

Tasks #63293

closed

Implement fscrypt in libcephfs and cephfs-fuse

Added by Christopher Hoffman over 2 years ago. Updated 4 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Christopher Hoffman
Category:
-
Target version:
-
% Done:

100%

Reviewed:
Affected Versions:
Component(FS):
Labels (FS):
Pull request ID:
61137
Tags (freeform):
Merge Commit:
3a0861039186750b0a2348e29385c46b887a0cee
Fixed In:
v20.3.0-4037-g3a08610391
Released In:
Upkeep Timestamp:
2025-11-06T14:20:39+00:00

Description

Add support for fscrypt to libcephfs and cephfs userspace client.

Initial work is done here: https://github.com/ceph/ceph/pull/52172
Ongoing work is here: https://github.com/chrisphoffman/ceph/tree/wip-fscrypt

Subtasks 81 (0 open — 81 closed)

Tasks #63295: Access semanticsResolved

Actions
Tasks #63303: Add multi-user support for key claimResolved

Actions
Tasks #63361: Require libfuse3.0Resolved

Actions
Tasks #64128: Set/Get Encryption Policy CodesResolvedChristopher Hoffman

Actions
Tasks #64129: Inode Enc StatusResolvedIgor Golikov

Actions
Tasks #64130: Implement error status for Enc Key StatusResolvedChristopher Hoffman

Actions
Tasks #64131: Do not allow falloc operationsResolvedIgor Golikov

Actions
Tasks #64133: Make pjd work on fscryptResolvedChristopher Hoffman

Actions
Tasks #65613: truncate failing when using pathResolvedChristopher Hoffman

Actions
Tasks #65615: lchown corrupts symlink entryResolvedChristopher Hoffman

Actions
Tasks #65745: RMW fail when on end of block or fileResolvedChristopher Hoffman

Actions
Tasks #64134: Implement entire client api with FscryptClosedChristopher Hoffman

Actions
Tasks #64135: Feature complete libcephfs fscrypt apisResolvedChristopher Hoffman

Actions
Tasks #64136: Cleanup secret key on lockResolvedChristopher Hoffman

Actions
Tasks #64137: Implement way to see locked statusResolvedChristopher Hoffman

Actions
Tasks #64159: When removing key, handle busy caseResolvedChristopher Hoffman

Actions
Tasks #64160: RMW race detectionResolvedChristopher Hoffman

Actions
Tasks #64166: RMW issue with xfstest ffsbResolvedChristopher Hoffman

Actions
Tasks #64306: Implement "trim read"ResolvedChristopher Hoffman

Actions
Tasks #64307: Buffered write failureClosedChristopher Hoffman

Actions
Tasks #64413: File size is not correct after rmwResolvedChristopher Hoffman

Actions
Tasks #64723: ffsb configure issues (gcc fails)ClosedChristopher Hoffman

Actions
Tasks #64819: data corruption during rmw after lseekResolvedChristopher Hoffman

Actions
Tasks #67659: fscrypt-snippets test_huge_hole failing on C_RetryReadResolvedChristopher Hoffman

Actions
Tasks #68431: Strided multi-fuse client write stallsResolvedChristopher Hoffman

Actions
Tasks #64163: Client::link() cannot use nullopt for enc caseResolvedChristopher Hoffman

Actions
Tasks #64164: verify st_blocks is correctResolvedChristopher Hoffman

Actions
Tasks #64691: Symlink target not set correctly in unencrypted dirResolvedChristopher Hoffman

Actions
Tasks #65811: Make dbench work on fscryptResolvedChristopher Hoffman

Actions
Tasks #65812: pwrite failure on overwriteResolvedChristopher Hoffman

Actions
Tasks #66038: Create workunits for reproducers found in fstest testsResolvedChristopher Hoffman

Actions
Tasks #66182: Validate decrypt_bl works as intendedResolvedChristopher Hoffman

Actions
Tasks #66577: interoperability with multi-clientResolvedChristopher Hoffman

Actions
Tasks #67347: file contents inconsistency between kclient write and fuse readResolvedChristopher Hoffman

Actions
Tasks #67559: file size not correct on overwriteResolvedChristopher Hoffman

Actions
Tasks #68233: fuse uses stale size value when mds has newer versionResolvedChristopher Hoffman

Actions
Tasks #67241: DocumentationResolved

Actions
Tasks #67919: Ensure written vs logical size is used appropriatelyResolvedChristopher Hoffman

Actions
Tasks #68235: truncating smaller does not invalidate inode data cacheResolvedChristopher Hoffman

Actions
Tasks #69302: Use correct sizes on write_successResolvedChristopher Hoffman

Actions
Tasks #68116: phase out fscrypt_uapi.hResolvedChristopher Hoffman

Actions
Tasks #68776: Add fscrypt binaries with new ioctls to existing testsResolvedIgor Golikov

Actions
Tasks #68798: fscrypt unlock hangsResolvedChristopher Hoffman

Actions
Bug #68831: fix LibCephFS.DoubleChmod testResolvedChristopher Hoffman

Actions
Bug #68963: ceph_test_libcephfs_fscrypt tests failResolvedChristopher Hoffman

Actions
Bug #69641: OpenReadWriteResolvedChristopher Hoffman

Actions
Tasks #69041: fscrypt encrypt hangsClosedIgor Golikov

Actions
Tasks #69160: implement last blockResolvedChristopher Hoffman

Actions
Tasks #69161: Create policy populator for unit testsResolvedChristopher Hoffman

Actions
Tasks #69442: locked symlink displays empty dest when not cachedResolvedChristopher Hoffman

Actions
Tasks #69693: Accept tag on subvolume createResolvedChristopher Hoffman

Actions
Tasks #69796: general libcephfs unit tests failResolvedChristopher Hoffman

Actions
Tasks #69797: OpenReadWriteResolvedChristopher Hoffman

Actions
Tasks #69840: Support subvolume cloneResolvedChristopher Hoffman

Actions
Tasks #69975: Sepia Lab Test RunsResolvedChristopher Hoffman

Actions
Tasks #69976: choffman-2025-02-13_20:28:10-fs-wip-choffman-fscrypt-021225-distro-default-smithiResolvedChristopher Hoffman

Actions
Tasks #70006: iozone.sh failsResolvedChristopher Hoffman

Actions
Tasks #70192: choffman-2025-02-25_14:26:50-fs:fscrypt-wip-choffman-fscrypt-distro-default-smithiResolvedChristopher Hoffman

Actions
Tasks #70193: dbench failsResolvedChristopher Hoffman

Actions
Tasks #70194: pjd failsResolvedChristopher Hoffman

Actions
Tasks #70266: choffman-2025-02-28_20:17:24-fs-wip-choffman-fscrypt-distro-default-smithiResolvedChristopher Hoffman

Actions
Tasks #70267: AlternateNameRenameExistMisMatch failsResolvedChristopher Hoffman

Actions
Tasks #70305: choffman-2025-03-04_14:42:41-fs-wip-choffman-fscrypt-distro-default-smithiClosedChristopher Hoffman

Actions
Tasks #70322: choffman-2025-03-04_20:33:59-fs-wip-choffman-fscrypt-distro-default-smithiResolvedChristopher Hoffman

Actions
Tasks #70566: choffman-2025-03-17_15:07:16-fs-wip-choffman-fscrypt-distro-default-smithiResolvedChristopher Hoffman

Actions
Tasks #70568: test_oc_disabled failsResolvedChristopher Hoffman

Actions
Tasks #70572: snaptest-git-ceph failsResolvedVenky Shankar

Actions
Tasks #70324: Do not build fscrypt feature on non-linux buildsResolvedChristopher Hoffman

Actions
Tasks #70979: cached fscrypt_file information lost during snap createResolvedChristopher Hoffman

Actions
Tasks #70995: invalid inode data on long filenamesResolvedChristopher Hoffman

Actions
Tasks #71602: kernel defconfig build fails in encrypted dirResolvedChristopher Hoffman

Actions
Tasks #71926: stat populates dentries when inode dneResolvedChristopher Hoffman

Actions
Tasks #72113: linux build fails when using read_syncClosedChristopher Hoffman

Actions
Tasks #72133: linux build fails when client_oc is offClosedChristopher Hoffman

Actions
Tasks #72143: cthon tests fail with client_oc offResolvedChristopher Hoffman

Actions
Tasks #72192: ld produces incorrect output when client_oc is offResolvedChristopher Hoffman

Actions
Tasks #72237: SegFault during C_Read_Sync_NonBlockingResolvedChristopher Hoffman

Actions
Bug #72463: remove write_file from vstart_runner.pyResolvedChristopher Hoffman

Actions
Tasks #73346: Fscrypt LlreadvLlwritevLargeBuffers failsResolvedChristopher Hoffman

Actions
Tasks #73416: AsyncReadAndWriteMultiClient failsResolvedChristopher Hoffman

Actions
Tasks #73461: Test setup fails on mount with-fscrypt-dummyResolvedChristopher Hoffman

Actions

Related issues 16 (14 open — 2 closed)

Related to CephFS - Feature #66373: Case-insensitive directory treesResolvedPatrick Donnelly

Actions
Related to CephFS - Tasks #64132: Support additional enc modesNewChristopher Hoffman

Actions
Related to CephFS - Tasks #64161: Rework encode/decodingNewChristopher Hoffman

Actions
Related to CephFS - Tasks #64165: Fix warnings in read_sync()In ProgressChristopher Hoffman

Actions
Related to CephFS - Bug #65217: cephfs: add fscrypt protection support from non-fscrypt clientFix Under ReviewChristopher Hoffman

Actions
Related to CephFS - Tasks #66503: Provide non-fscrypt aware clientNewChristopher Hoffman

Actions
Related to CephFS - Tasks #70306: test_fscrypt_dummy_encryption_with_quick_group failsIn ProgressChristopher Hoffman

Actions
Related to CephFS - Tasks #71482: client: shorten long symlink target names when lockedNewChristopher Hoffman

Actions
Related to CephFS - Tasks #68757: Figure out path forward for incorrect restricted ioctlsNewChristopher Hoffman

Actions
Related to CephFS - Tasks #69205: ensure master key isn't present in core dumpIn ProgressIgor Golikov

Actions
Related to CephFS - Tasks #73176: refactor read_modify_writeNewChristopher Hoffman

Actions
Related to CephFS - Tasks #73345: Do not expose ceph_fscrypt_key_identifier in apiResolvedChristopher Hoffman

Actions
Related to CephFS - Tasks #73347: direct_io.py failsNewChristopher Hoffman

Actions
Related to CephFS - Tasks #73497: fsx.sh fails with-fscrypt-dummyFix Under ReviewChristopher Hoffman

Actions
Related to CephFS - Tasks #73574: test_sync_io failureNewChristopher Hoffman

Actions
Related to CephFS - Tasks #73590: ConcurrentWriteAndFsync failsNewChristopher Hoffman

Actions
Actions
Copy link
 #1

Updated by Christopher Hoffman almost 2 years ago

  • Subtask #65811 added
Actions
Copy link
 #2

Updated by Christopher Hoffman almost 2 years ago

  • Subtask #66038 added
Actions
Copy link
 #3

Updated by Christopher Hoffman almost 2 years ago

  • Subtask #66182 added
Actions
Copy link
 #4

Updated by Christopher Hoffman over 1 year ago

  • Subtask deleted (#64162)
Actions
Copy link
 #5

Updated by Christopher Hoffman over 1 year ago

Actions
Copy link
 #6

Updated by Christopher Hoffman over 1 year ago

  • Subtask #66503 added
Actions
Copy link
 #7

Updated by Christopher Hoffman over 1 year ago

  • Subtask #66577 added
Actions
Copy link
 #8

Updated by Christopher Hoffman over 1 year ago

  • Subtask #67241 added
Actions
Copy link
 #9

Updated by Christopher Hoffman over 1 year ago

  • Description updated (diff)
  • Status changed from New to In Progress
  • Assignee set to Christopher Hoffman
Actions
Copy link
 #10

Updated by Christopher Hoffman over 1 year ago

  • Subtask deleted (#66577)
Actions
Copy link
 #11

Updated by Christopher Hoffman over 1 year ago

  • Subtask #67919 added
Actions
Copy link
 #12

Updated by Christopher Hoffman over 1 year ago

  • Subtask #68116 added
Actions
Copy link
 #13

Updated by Christopher Hoffman over 1 year ago

  • Subtask #66577 added
Actions
Copy link
 #14

Updated by Christopher Hoffman over 1 year ago

  • Subtask #68431 added
Actions
Copy link
 #15

Updated by Christopher Hoffman over 1 year ago

  • Subtask deleted (#68431)
Actions
Copy link
 #16

Updated by Christopher Hoffman over 1 year ago

  • Subtask #68757 added
Actions
Copy link
 #17

Updated by Christopher Hoffman over 1 year ago

  • Subtask #68776 added
Actions
Copy link
 #18

Updated by Christopher Hoffman over 1 year ago

  • Subtask #68798 added
Actions
Copy link
 #19

Updated by Igor Golikov over 1 year ago

  • Subtask #68831 added
Actions
Copy link
 #20

Updated by Igor Golikov over 1 year ago

  • Subtask #68963 added
Actions
Copy link
 #21

Updated by Christopher Hoffman over 1 year ago

  • Subtask #69041 added
Actions
Copy link
 #22

Updated by Christopher Hoffman about 1 year ago

  • Subtask #69160 added
Actions
Copy link
 #23

Updated by Christopher Hoffman about 1 year ago

  • Subtask #69161 added
Actions
Copy link
 #24

Updated by Christopher Hoffman about 1 year ago

  • Subtask #69205 added
Actions
Copy link
 #25

Updated by Christopher Hoffman about 1 year ago

  • Pull request ID set to 61137
Actions
Copy link
 #26

Updated by Christopher Hoffman about 1 year ago

  • Subtask #69442 added
Actions
Copy link
 #27

Updated by Christopher Hoffman about 1 year ago

  • Subtask #69693 added
Actions
Copy link
 #28

Updated by Christopher Hoffman about 1 year ago

  • Subtask #69796 added
Actions
Copy link
 #29

Updated by Christopher Hoffman about 1 year ago

  • Subtask #69840 added
Actions
Copy link
 #30

Updated by Christopher Hoffman about 1 year ago

  • Subtask #65217 added
Actions
Copy link
 #31

Updated by Christopher Hoffman about 1 year ago

  • Subtask #69975 added
Actions
Copy link
 #32

Updated by Christopher Hoffman 12 months ago

  • Subtask #70324 added
Actions
Copy link
 #33

Updated by Christopher Hoffman 10 months ago

  • Subtask #70979 added
Actions
Copy link
 #34

Updated by Christopher Hoffman 10 months ago

  • Subtask #70995 added
Actions
Copy link
 #35

Updated by Christopher Hoffman 9 months ago

  • Subtask #71482 added
Actions
Copy link
 #36

Updated by Christopher Hoffman 9 months ago

  • Subtask #71602 added
Actions
Copy link
 #37

Updated by Christopher Hoffman 8 months ago

  • Subtask #71926 added
Actions
Copy link
 #38

Updated by Christopher Hoffman 8 months ago

  • Subtask #72113 added
Actions
Copy link
 #39

Updated by Christopher Hoffman 7 months ago

  • Subtask #72133 added
Actions
Copy link
 #40

Updated by Christopher Hoffman 7 months ago

  • Subtask #72143 added
Actions
Copy link
 #41

Updated by Christopher Hoffman 7 months ago

  • Subtask #72192 added
Actions
Copy link
 #42

Updated by Christopher Hoffman 7 months ago

  • Subtask #72237 added
Actions
Copy link
 #43

Updated by Christopher Hoffman 7 months ago

  • Subtask #72463 added
Actions
Copy link
 #44

Updated by Christopher Hoffman 5 months ago

  • Subtask #73176 added
Actions
Copy link
 #45

Updated by Christopher Hoffman 5 months ago

  • Subtask #73345 added
Actions
Copy link
 #46

Updated by Christopher Hoffman 5 months ago

  • Subtask #73346 added
Actions
Copy link
 #47

Updated by Christopher Hoffman 5 months ago

  • Subtask #73347 added
Actions
Copy link
 #48

Updated by Christopher Hoffman 5 months ago

  • Subtask #73416 added
Actions
Copy link
 #49

Updated by Christopher Hoffman 5 months ago

  • Subtask #73461 added
Actions
Copy link
 #50

Updated by Christopher Hoffman 5 months ago

  • Subtask #73497 added
Actions
Copy link
 #51

Updated by Christopher Hoffman 4 months ago

  • Subtask #73574 added
Actions
Copy link
 #52

Updated by Christopher Hoffman 4 months ago

  • Subtask #73590 added
Actions
Copy link
 #53

Updated by Upkeep Bot 4 months ago

  • Merge Commit set to 3a0861039186750b0a2348e29385c46b887a0cee
  • Fixed In set to v20.3.0-4037-g3a08610391
  • Upkeep Timestamp set to 2025-11-06T14:20:39+00:00
Actions
Copy link
 #54

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#64132)
Actions
Copy link
 #55

Updated by Christopher Hoffman 4 months ago

  • Related to Tasks #64132: Support additional enc modes added
Actions
Copy link
 #56

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#64161)
Actions
Copy link
 #57

Updated by Christopher Hoffman 4 months ago

Actions
Copy link
 #58

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#64165)
Actions
Copy link
 #59

Updated by Christopher Hoffman 4 months ago

  • Related to Tasks #64165: Fix warnings in read_sync() added
Actions
Copy link
 #60

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#65217)
Actions
Copy link
 #61

Updated by Christopher Hoffman 4 months ago

  • Related to Bug #65217: cephfs: add fscrypt protection support from non-fscrypt client added
Actions
Copy link
 #62

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#66503)
Actions
Copy link
 #63

Updated by Christopher Hoffman 4 months ago

  • Related to Tasks #66503: Provide non-fscrypt aware client added
Actions
Copy link
 #64

Updated by Christopher Hoffman 4 months ago

  • Related to Tasks #70306: test_fscrypt_dummy_encryption_with_quick_group fails added
Actions
Copy link
 #65

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#71482)
Actions
Copy link
 #66

Updated by Christopher Hoffman 4 months ago

  • Related to Tasks #71482: client: shorten long symlink target names when locked added
Actions
Copy link
 #67

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#68757)
Actions
Copy link
 #68

Updated by Christopher Hoffman 4 months ago

  • Related to Tasks #68757: Figure out path forward for incorrect restricted ioctls added
Actions
Copy link
 #69

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#69205)
Actions
Copy link
 #70

Updated by Christopher Hoffman 4 months ago

  • Related to Tasks #69205: ensure master key isn't present in core dump added
Actions
Copy link
 #71

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#73176)
Actions
Copy link
 #72

Updated by Christopher Hoffman 4 months ago

Actions
Copy link
 #73

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#73345)
Actions
Copy link
 #74

Updated by Christopher Hoffman 4 months ago

  • Related to Tasks #73345: Do not expose ceph_fscrypt_key_identifier in api added
Actions
Copy link
 #75

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#73347)
Actions
Copy link
 #76

Updated by Christopher Hoffman 4 months ago

Actions
Copy link
 #77

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#73497)
Actions
Copy link
 #78

Updated by Christopher Hoffman 4 months ago

  • Related to Tasks #73497: fsx.sh fails with-fscrypt-dummy added
Actions
Copy link
 #79

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#73574)
Actions
Copy link
 #80

Updated by Christopher Hoffman 4 months ago

Actions
Copy link
 #81

Updated by Christopher Hoffman 4 months ago

  • Subtask deleted (#73590)
Actions
Copy link
 #82

Updated by Christopher Hoffman 4 months ago

  • Related to Tasks #73590: ConcurrentWriteAndFsync fails added
Actions
Copy link
 #83

Updated by Christopher Hoffman 4 months ago

  • Status changed from In Progress to Resolved
Actions
Copy link

Also available in: Atom PDF