Skip to content
This repository was archived by the owner on Nov 17, 2023. It is now read-only.
This repository was archived by the owner on Nov 17, 2023. It is now read-only.

Balance Allocation for Multiple Cards On Device KVStore #252

@junranhe

Description

@junranhe

我用vggnet 11layer 训练,在总的batchsize是36,3个780gpu,conv workspace 设置为 256, cuda-7.0, 但不用cudnn(觉得可以规避一些内存分配的不确定性), 发现占用gpu:2795m,2661m,2383m,他们100多m的递减差别是怎么产生的?希望能差别小一点,这样显存的利用率高些,毕竟显卡相同,显存利用取决于占用最大的gpu了,batchsize太小我的数据有时不收敛:(

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions