There are some characters that, with time, became an iconic mark of the franchise, and if you pull them out well, it's simply not the same game.
You can do a SoulCalibur without any of them, yes, just two swords and a bunch of new people looking for them, but it will no longer be a "SoulCalibur"...