Hi Kelly,
Yes, non NZ residents can purchase properties in NZ. I believe there is a restriction on the size of the section (land with the house) you can buy, which I'm pretty sure is 1 acre.

Apart from that, its not a problem.