FMM leaks memory

If you run examples/find-photonic-mode-sk.py, you'll find that the FMM leaks about 6MB per iteration, of which it (currently) takes quite a few.

cc @mattwala