The tiny bits like to spin fast, too fast for a normal drill press , in my opinion. I use a Micromark drill press dedicated to my scrolling. This is what I have, http://www.micromark.com/microlux-3-speed-mini-drill-press,7797.html
It has gone up a bit in price.