Why not just slobber it into the gouge as is, from the container? It'll shrink less, I bet.
My wife came home with some light weight spackle the other day. DEFINITELY not gypsum, it is some sort of whipped poly stuff. Very light weight and claims not to shrink. You might try that, too.