With GPU isolation : multiple processes use the single GPU will be serialized, cause OOM easily link https://www.slideshare.net/mobile/Hadoop_Summit/deep-learning-on-yarn-running-distributed-tensorflow-etc-on-hadoop-cluster-v3 slide number 17
$\begingroup$
$\endgroup$
1
-
2$\begingroup$ Can you give more context to your question? Is this a quote from some documentation? Can you link where you read it? $\endgroup$– Nathan ReedDec 17, 2018 at 23:25
Add a comment
|
1 Answer
$\begingroup$
$\endgroup$
It's saying that if you're using a single GPU, the multiple processes attempting to use the GPU will be queued up and run one at a time rather than some or all being run in parallel. If you have multiple GPUs some of the processes can be run at the same time.
