Untrack comments does not seem to be working anymore

Lately I've been selecting Untrack Comments on several articles in which I do not want to receive notifications about anymore, but when I leave SA, and then log back in some time later, I still get alerts on new comments in those articles. It used to be that when I selected Untrack Comments, I did not receive those alerts. That is not the case anymore. Is there a bug with the software, or does Untrack Comments no longer keep you from getting alerts?