Considering that those little crumbs left by an eraser have no specific, single word name.
I say drop the ‘c’ and call them rumbs or with one more alteration rubms. Almost onomatopoetic.
Note: Rubbings does not work due to having an entirely different meaning.