Is voting No to AV to have a go at Nick Clegg, as silly as voting for him in the first place?

When the talk about AV was in its early stages, I must admit that I was one of the people that thought of voting NO just to spite Clegg and the Libdems. I have since taken more time to think about it as I can't stand Cameron either. I therefore looked at reasons for and against AV and came to the conclusion that it could actually be more unfair than the system we have. I can't for the life of me see why someones 2nd vote should be as important as their 1st vote, I also can't see why, why a group of voters who originally get the highest majority in the 1st round, could end up losing through other peoples 2nd votes and not even have their 2nd votes taken into consideration. The fact that I also believe that the NO vote will spell the end for Clegg and possibly the end of the coalition is a welcome by product of my choice, but is not the overwhelming reason I voted against it as there is also a chance that if the YES vote got through, then it might possibly spell the end for Cameron. So one way or another, Cameron or Clegg are going to hit the buffers and I'm not really bothered which one of these two faced, lying, deceitful pieces of s/hit gets it in the neck.