IB/qib: Avoid filtering LID on SMA portinfo