Incong - I thought the same as you - I just let it laps and canceled the repeating payment in Paypal but they still managed to take the money and it was only when I raised a complaint with Paypal did they get in touch and refund the money. Contacting them any other way just didn't work.
So be aware and check your payment method after it's lapsed