To delete a question on your survey, on the survey design page simply click the Delete link above the question that you want to delete:
You will be prompted to confirm you want to delete the question. Once you click yes, the question will be deleted and your survey questions will be renumbered.