Track the mark-as-read timeout to be able to cancel it properly