System Information
Operating system: Windows 10
Graphics card: 3070

Blender Version
Broken: 3.2.0 and 3.2.1
Worked: 3.1

Short description of error
Auto perspective setting doesn't work in this case: if you are in camera view or any side view and then you are switching to another side view you have this smooth transition animation between views. If during this animation you press middle mouse button (rotation) to go from side view it doesn't change to perspective. Moreover it "shifts" viewport like it was aligned to a bad quad.

Exact steps for others to reproduce the error

1. Turn on auto perspective.
2. Go to top view.
3. Change top view to any other side view.
4. During smooth transition between view press middle mouse button and rotate the viewport.
5. Now viewport is shifted and stays in orthographic instead perspective.