put the piece in a wood vice and use a block plane to make it smaller and it will smooth at the same time
if you have a small part put the plane in the vice and use it like a jointer by sliding the work over the plain.
MAKE SHURE THAT THE PLANE IS TAKEING THE SMALLEST CUT POSSIBLE for the best surface. this will also make it easier to use