How do you change a student's course?

I was trying to move a student from one course to another, so I deleted him from the first course, and tried to add him to the second course, but got the message that the username was already in use. Any suggestions?