Remove the layer potential test case without FMM