Skip to content

Comments

test get_object_attributes#571

Merged
mattbenjamin merged 4 commits intoceph:masterfrom
linuxbox2:wip-get-objattrs
Jan 13, 2025
Merged

test get_object_attributes#571
mattbenjamin merged 4 commits intoceph:masterfrom
linuxbox2:wip-get-objattrs

Conversation

@mattbenjamin
Copy link
Contributor

No description provided.

@mattbenjamin mattbenjamin force-pushed the wip-get-objattrs branch 4 times, most recently from 0a0a379 to 7e923f5 Compare July 10, 2024 13:20
Copy link
Contributor

@cbodley cbodley left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can i suggest some additional test coverage?

  • non-multipart upload,
  • current version,
  • non-current version,
  • delete marker?
  • pagination of parts (ex MaxParts=1 PartNumberMarker=2),
  • fields not requested by ObjectAttributes are not returned

are there any error paths that are worth testing for?

@cbodley
Copy link
Contributor

cbodley commented Jul 10, 2024

can i suggest some additional test coverage?

and sse-c when we add it: test_encryption_sse_c_method_head is a good example for HeadObject

@cbodley
Copy link
Contributor

cbodley commented Oct 18, 2024

i pushed a branch with extra tests to linuxbox2/s3-tests@wip-get-objattrs...cbodley:s3-tests:wip-get-objattrs

  • multipart upload without checksums
  • multipart upload with a single part
  • pagination of multipart parts
  • non-multipart upload with/without checksum
  • versioned object, current and non-current
  • sse-c encrypted object

i left review comments on ceph/ceph#55259 about the issues that uncovered, mainly around the pagination test test_get_paginated_multipart_object_attributes

mattbenjamin and others added 4 commits January 7, 2025 15:23
Signed-off-by: Matt Benjamin <[email protected]>
there seem to be workloads which assume checksum algorithm can be
omitted from upload-part

Signed-off-by: Matt Benjamin <[email protected]>
* multipart upload without checksums
* multipart upload with a single part
* pagination of multipart parts
* non-multipart upload with/without checksum
* versioned object, current and non-current
* sse-c encrypted object

Signed-off-by: Casey Bodley <[email protected]>
Signed-off-by: Matt Benjamin <[email protected]>
@mattbenjamin mattbenjamin merged commit ff16b9c into ceph:master Jan 13, 2025
@cbodley
Copy link
Contributor

cbodley commented Jan 22, 2025

cherry-picked to ceph-master

cbodley pushed a commit that referenced this pull request Jun 19, 2025
includes tests for CRC64NVME, tests for selecting
COMPOSITE and FULL_OBJECT checksums

a decomposed matrix of tests for all checksum types

also removes the mixed checksum upload case that no longer
works in recent boto3

cleanups, add sha1

checksum validation failure (mismatch) returns BadDigest

multipart checksum matrix helper now validates checksum and checksum type
for all operations which can return them (complete-multipart, head-object,
and get-object-attributes)

Signed-off-by: Matt Benjamin <[email protected]>
(cherry picked from commit 2c9c5d9)

Conflicts:
	s3tests_boto3/functional/test_s3.py
  GetObjectAttributes tests from #571 not backported
@cbodley cbodley mentioned this pull request Jun 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants