If you are doing everything according to their tutorials / examples, it should be, but odds are you still have to define something for it to know which GPU(s) to use edit; actually looks like it finds all available and uses them by default?
also yikes reading their documentation completely ignore what I said earlier, they even tell you to remove `.cuda()` and `.to()` calls under