This enjoying spirit is very deep in us. In the first instance the enjoying spirit is there to enjoy the material energy, and in the second instance, the enjoying spirit is there to enjoy the spiritual energy. But that is also to be given up. One has to come to the point of being totally the servant.
We see the classical example of Daruka who became overwhelmed by his ecstatic symptons, didn't like these symptons because it interfered with his service - so the service had become more important than the enjoying spirit. This is what we want to see in Krsna Consciousness.
(Kadamba Kanana Swami 2003)