That type of noise sometimes comes from the glass as it is sliding through the felt guides at either side of the door. If that is the source of the noise then squirt some silicone lubricant spray (available from somewhere like Halfords) down each of the guides. Then
lower and raise the windows a few times to work it in. That will sort out your issue.
OOh don't go near it with silicone just yet, It can cause all sorts of problems.
Try wetting a detergent and water spray and trying it...does this
help?
Have a go at claybar on your window followed by a good clean with mer glass polish or similar.
Drop the window and wipe the felt
guide with dtergent in water followed by isopropyl alcohol or neat vodka then dry it with a paper towel.
Slide paper in between the felt
guide and window and try it again? Still noise? Then it is the internal mechanism that needs a lube and not the window rubber.
Getting silicone on your window rubbers can start a whole series of creaking and squeaking when you are driving if you are not careful....I know this from personal experience