Destructor or Delete in BMax

And at which point breaks that the "rely on delete beeing called"?

Not without ref -> not collected -> naturally delete never called.

You will most likely always need another method to clean the "back references" first (normall remove it from a list or similar structure where it is saved for handling)