I have always been a fan of Taruskin's writing. He balances enormous erudition with a sense of what it means to make music and to be moved by it, so while he has all the tools to analyze and be theoretical when he needs them, it's only ever in the service of meaningful understanding. 'Text and Act' and 'Defining Russia Musically' are two of my favourite books, and ones which I recommend constantly to others.
I hadn't expected this History to be such a darned good read: I started with the 19th century because that's where my specialization takes me, and I was hooked from the first page, to the extent that I now have to ration myself. He writes so clearly and so engagingly, that it's more like reading a thriller than a history book. It's a wonderfully well-balanced book: his style is friendly, explanatory, humorous. But if you want it, there's deep musical analysis with examples. It's like Alex Ross's 'The Rest of Noise' but for a mixed audience of scholars, music lovers, children, whoever - it works on several levels at once, and you can choose (as I sometimes do) to leave out the more analytical/theoretical stuff and just enjoy the story.
As a ballet specialist myself, I am grateful to Taruskin for writing one of the only mainstream chapters on ballet music in the early 20th century volume. I happened to see that chapter browsing in a bookshop and instantly bought the book. At £45 for the whole set, this has to be one of the best bargains in the world of books, so I just went to Amazon and bought the rest. Now I've got the other volumes, I can't put them down.