Is it the duty of the invigilator to rearrange the answer sheets in?
That is his/her duty. But the main duty is to maintain silnce and not allow unfair means in exam hall. And check whether the student has filled all the information in the answer sheet.