Once selected a smart list or "All Contacts" are checked the ability to un-check some contacts as of right now it is locked after checking all.