Fame
You're not looking for fame—you're looking to be surrounded by it and hopefully make money off of it. The occasional agent here and there acquires a certain level of renown, like sports mega-agent Scott Boras, who represents basically every sports player you've ever heard of. Even when it happens, it's a by-product of being really good at your job. After all, you probably haven't been building to this; your focus is on your clients and their fame.
And their fame equals your money, so you're totally at peace with that.