As I recall, the system will pair with the latest cell phone to be paired. If it isn't available it will pair with the next and then the next and then the first since there can only be four paired. If you pair a fifth, the first is deleted.
Doesn't matter much to me. I only talk on one phone at a time.