I was trying to change the outbound number that I send SMS from to a specific prospect.

Support let me know I would need to delete the conversation to change the outbound number...