This is a greedy strategy adopted by TensorFlow in order to avoid memory fragmentation, but this brings about a bottleneck of GPU memory. just one process completely has the many memory. You won't be able to see gamers throughout the full map given that they don't seem to be rendered. you could most likely see enemies that are in a room/region ide