After running yarn python:test we can see that two new untracked files are created: does_not_exist.json and to_be_mocked.json.

We should either ignore them or make sure they are removed.

CC @gjreda