I think the big problem was the crew. Sure a lot of the stories had promise but for me the casting just failed to deliver. Captain Archer just wasn't a dynamic presence. His subordinates were rigid to point of being typecast, especially his engineering officer. There was little chemistry, as least to me, between them.
Honestly, the most entertaining part of the show to me was the opener. I enjoyed that little song they played with the Enterprise montage.