As I understand it the reason that the last version of cachecontrol was yanked was that the wheel included the test scripts - see psf#282, psf#285, psf#299

cacheyou-23.2-py3-none-any.whl also contains test scripts.

I'd submitted an MR that fixed this in the setuptools world - psf#287.

I don't know what the pdm equivalent is; but surely if anyone does then you do...