You can also use attribute manager to delete unused fills and layers. Options > Element Attributes > Attribute Manager, but I would only do this as a last resort.
Another option is to uncheck the box for "Save navigator preview data with project files". Do this by going Work environment > User preference schemes > More options.
You can use "compress file" when saving