Once you have posted in a thread, it will show up in "My Forums" because "My Forums" is all the threads you've participated in sorted in descending chronicological order based on the latest post in the thread.
You can't remove it from the My Forums listing.