Yeah, they do get removed however not instantly. The one you are talking about will be removed very shortly.
