The problem with being a fan of Colin Hay's work since the disintegration of Men At Work is that he's only available on indie labels now, so his stuff gets repackaged a lot. Some albums feature a full band while others are just Hay with his guitar. Buying all the albums means duplicating parts of the catalog, and some albums aren't available at all anymore. Ultimately, though, the difficulties of being a Hay completist are a small price to pay: The guy is an excellent and prolific songwriter, and any album you get your hands on is gonna be good.
In terms of the sound, Hay has grown up since MAW; this is more folky and adult, with none of the goofiness. He still has an edge, though, and that distinctive vocal sound. I chose this album mainly because it features one of his very best songs, "Waiting For My Real Life to Begin." This is one of those tracks that's available in other forms, but this is the best one, as is this version of "Into the Cornfields." "I Haven't Seen You In A Long Time" is a great little catchy starter, and "Can't Take This Town" is a good example of the sense of humor that Hay brought to so many MAW songs.
He's released better albums, including "Wayfaring Sons" and "Looking For Jack," but good luck finding those. Of the stuff that's available, this and "Company of Strangers" are your best bets. And catch him on tour if you get a chance. Alone or with a backup band, he's amazing.