I don't know...

So I'm making good progress. I've got the top and bottom-front and back done and sewn together. I've got most of the top half of the sleeves done. The yarn came and it is the same color so, woot! So I try this thing on just now, and I'm not totally stoked like I was. This picture is worse than it actually is, but its not fantastic at any rate. (The left side's tension is loose but will be fine when I weave in all the ends). I really don't want to start over, I'm hoping that it is just fitting weird and will get better with washing/wearing. Am I kidding myself? I know the colors are out there too, but I do like that part.