First of all ... be sure that they are chalks and not wax.
Here's what I do for armoured vehicles.
This is the final step that I do on any of my models.
Take a chalk stick and sand it on a piece of med course sandpaper.
Gather up all the dust into a small container.
Using a ratty old, fairly course paint brush. Dip the brush into the pastels and scrub the pastels into the area you want weathered. Keep repeating this process on the model until it is at the level you want.
Then get an artists fan brush with very soft bristles. once again dip into the pastels and apply a light dusting to the entire model, heavier near the bottom and where dust would build up.
Place the model on your shelf and keep yours and everyone elses hands off.
Happy Modelling and God Bless
Robert