We are missing the fact that VkQueueSubmit may be waiting on an event, and that event may be unsignaled. We should defer the set of the fence until we actually execute all of the commands.