I would have to agree with Murray. Fourier transform filters work best when there is a repeating pattern (I'm an old EE, so the details of why have mostly faded).
Most of the time, when dealing with paper texture the process would be to alternately smooth then add back in texture of your liking. Eventually, you have to sharpen the facial features that result in a pleasing portrait - normally the eyes, nose and mouth.
You can accomplish that is several ways. Some like to work with very small areas and add levels or curves layers to bring out contrast. Others like to work those same small areas with unsharp mask or smart sharpen. You will find that one of the moderators,
Flora, does an excellent job with facial features. Just search her posts and you will find many good examples.
Good luck,
Tom