rpc: failure calling dumptxoutset with invalid filename

```bash
src/bitcoin-cli dumptxoutset utxo.dat/

error code: -1
error message:
CAutoFile::operator<<: file handle is nullptr: unspecified iostream_category error
```