Likely due to the fact that the skybox should not be rendered in orthographic view, otherwise it will simply render the box at the center. We can either send a push constant of the perspective view to the skybox pipeline, or add a second projection matrix for ortho and perspective. Push constants seem to be the better option here.