usb/isp1760: Move to native-endian ptds