Well, you don't*have* to - however this is not where I would start.
I think "The Player of Games" is an excellent introduction both to the Culture and to the concept of not all of the Galaxy being up to the same tech / civilisation in all its meanings level as the Culture. If you like that book, then go onto "Consider Phlebas" and after that - take your pick.
"Surface Detail" does to my mind require some foreknowledge of what the hell the Culture is. I think you would get more out of it by reading the other books suggested first. But you know, that's like, only my opinion man...
I'd agree you'd get more out of it by reading the other novels first I would certainly say that Consider Phlebas should be where you start both because its the first and because it is the most referenced in later works. The "true order" is
Consider Phlebas Player of Games (IMHO the best) Use of Weapons Excession Look to Windward Inversions (could leave out) Matter Surface Detail
With the short story collection "State of the Art" after Use of Weapons