I don't know your application. Post more details for better advice.
I will, however, mention that using a network of resistors in parallel or in series to produce your desired net resistance will also reduce the power than any single resistor will have to dissipate.
"A few watts" above what rating? If you are talking about 5 watt or 10 watt resistors then mounding them clear of the board and wrapping an aluminum fin around them with heat sink compound would likely work. Higher wattage than that and simply mounting them so air flow is assured and letting them run a few degrees hot would not have problems.
If you are talking about 1 or 2 watt, then you have to upgrade the resistors to the needs of the circuit as you will burn them out.
If the resistor has a flat bottom so that it can be mounted to a heat sink you can use thermal paste. If not, stick with a fan.
they do sell power resistors with higher wattage's.
It's crazy to operate a resistor above it power rating. Get a resistor that is properly rated.
Moving air will help and so will copper or alum foil heat dissipators.
If the power dissipation is about a few watts higher than what the resistor can handle, so can i place them in some heatsink and apply thermal paste? Will that help with the dissipation, or maybe using a small fan?