Too many pivots?

I plan on having every object I add be parented to pivots. Would that slow my engine by a big amount?

I plan on having this because many artists like to work differently, such as not putting the model base at the bottom.