I lost about 30 after checking to see which of my neighbors were playing and which were not, so I un-neighbored them. What is weird is that some unfriended me awhile ago and were still connected as NEIGHBORS, yet not as ghosts. I never saw anything like it.
I just added about 50 new people to replace them. I think someday we will all be neighbors as the pool of players gets smaller and smaller.