I have used cork board as a base, but I covered it with pieces of pressed board, and small pieces of plastic. The problem with the cork is that if you don't seal it somehow, cement and silicone will "evaporate" in the little spaces. Cork works ok as a working base, but I would agree that it probably is not the best material to build with.
MF