For situations like that I use one of two methods. I have a set of needle files. I consider these a necessity. I would use the round cross section file, that is tapered and comes to a fine point.
Also, most fillers can be carved by a good, sharp hobby knife blade once they are fully dried/cured. In cases like yours, I have carved away excess with the hobby knife and then finished up with the needle file.
I have also used my Dremel tool with a very small ball end. My battery Dremel has a speed adjustment that goes down to a very slow speed. However, I would avoid that in a case like you show, as in a confined space if I touch one of the surfaces near a corner the tool tends to bounce around, making nasty scratches and marks.