I think what annoys me the most is the lack of decent image handling on the site.  It would be so much better IMO, for example, if attached images would actually show up as thumbnails rather than having to blindly click on attachment filenames not knowing what the full scale image entails.  Just little things like that would make perusing the site so much more user friendly.