I have noticed that if a assignment is deleted from the course, it does not delete it from grading column. Instead it displays Deletion in Progress for ever.

To recreate the issue: Create an assignment, grade it and delete it. Review the grade column for that assignment.