If this is just random dropping of follow, try something like Jamba's strobing feature or similar. Follow isn't perfect, but if you have something saying "hey c'mere" every second it tends to behave better.

The memory is probably a good idea regardless.