test/bunchkaufman: Fix complex test tolerances and avoid intermediate overflow

libeigen/eigen!3044

5 files changed