I was just about to post the same thing!
For me, I find the front end (what clients see) fairly snappy. Though I have noticed the issues mentioned with pausing on an image in the slideshow.
The back end, what we see, seems to be a bit laggy. Galleries have a little pause before they begin to show. Rather than an issue with loading millions of photos, I could have created a gallery with no images in it and it will still have the kind of pause that makes you wonder what's wrong. For me, the pause before any images are shown is about 3 seconds each time after clicking on the gallery.
When I'm in the gallery, most things seem relatively fine. Not the fastest. But not laggy.