Answers should get rid of the voting?

Multiple times I have had the correct answer and another one has been picked because of voting. And these were opinion questions like there was one when it was a rap song and I knew it for sure and someone gave some stupid ignorant answer where they knew nothing saying it was young jeezy. it got 2 votes and so it got best answer. Who else thinks this is a bunch of ****, and people should only get their best answer picked by the person asking the question?