Late annotations and scoring

I had a student who submitted a bunch of comments late, but Perusall labeled them as "on time." In this case, I had a 24 hour window after the deadline which allowed for replies. Turns out that if a student creates a comment after the deadline AND THAT COMMENT IS A REPLY, the system calls it "on time." However, this is more or less irrelevant because I also have a 24 hour window for late submissions with diminishing scores. In the end, the student didn't much credit for her work, but she did accidentally find the loophole that would let her submit "late" material and get some (meager) credit for it. If I closed the late scoring window, then the loophole would close. I'm not going to do that midstream, but will keep it in mind for future semesters.