How to erase pencil lines without lifting ink?

Whenever I try to erase the pencil sketch after inking a piece, the ink ends up being lifted along with the pencil. Sometimes the top layer of paper comes off. I use a kneaded eraser in a circular motion when erasing. What should I be doing different? Different paper? Different eraser? Different ink? Combination of the three?