I'd try Lightweight Hydrocal. Comes in very fine powder but after mixing it with water it has the consistency of milkshake. mix in dye to for desired colour. it'll expand a tiny bit but once it dries it has a matte finish.
woodlandscenics.woodlandscenics.com/.../1
Now, I've never done what you're attempting, but after using it myself it appeared to be appropriate for the surface you're asking for.