Kinda separate question but how do large websites handle using multiple servers? Doesn't a domain need to resolve to a single ip?
Round-Robin DNS exists. Alternatively you could front the backend servers with a single load-balancing server that forwards incoming requests to a pool of backend servers.