Pastel chalks are, well, just like ordinary blackboard chalks to the touch. They are dry and hard, but will mark your fingers easily.
Oil pastels feel greasy to the touch, like kid's colouring crayons.
If you go to an art store, it will be obvious when you handle the pastels whether they are chalk or oil. Art stores here in the UK normally carry both types, displayed separately.
Cheers