How many holes are you needing to drill?
You can wrap the drill shank with masking tape to enlarge it enough to be sufficiently tight enough in the collet. But again Dremels spin way too fast for bits that have a hair like diameter.
All pin vises are not created equal, some are better than others.