Doesn't matter, can invoke anytime you "feel" you may incriminate yourself. Same reason why you cannot be forced to testify if you are defendant. Only exception is Congressional hearing I think.