I've found that the solution in that case is to clear your targets and re-assist.