vga_switcheroo: Remove unnecessary checks