There are many reasons for losing attention when we are listening to the Dharma, but it is mostly due to lack of preparation. If we are unable to fully focus when listening to the Dharma, then it would take eons to attain the effects of listening.