but who is the object?

“one shouldn't be too hard on oneself when the object of one's affection returns the favor with rather less enthusiasm than one might have hoped.”

* the object of my affection