I don't think it refers to anything in particular, it's just been deemed a swear word that's far too foul for British ears.

I think bloody and bugger are probably the least offensive swear words around!