If it's a Standing Order then I think it's the bank's fault for paying out too much and you should try and sort it out with them directly.
If it's a Direct Debit, then it's the Society's fault for requesting too many payments, and they will need to refund you.
Either way, it's a complete pain, but in the past I have had much quicker resolutions to Standing Order mistakes.