Skinned foods can play havoc with a band... But this doesn't mean you need to stop eating them. Sometimes a few little changes will enable you to carry on enjoying them as before.
Try cutting up your food and eat in cubed bite sizes - don't eat hand to mouth as before (e.g.apples/pears/plums etc) as this will likely be too much in one mouthful to handle. Make sure you're applying your 20+ rule and chewing well & eating slowly.
If you still really struggle, try peeling your fruit before chopping.