Okay yeah that does make sense. How should I go about `z` axis then?
After transforming to view space coordinates, raycast the mouse's xy along the camera's forward direction (z) and find what it hits.