But those artifacts have usually faded with time and exposure to the light, so even those don't show you what the colors actually looked like, unless they have been sealed away from light exposure all this time.
Often you can find a bit of the paint in an overspray area that was covered by some other piece that is well preserved, even if the original paint is totally lost. Start taking off bolts and look at the flecks of paint stuck to the underside of the bolt.
Also, we still have the techniques and materials used to make old paints. New batches can be whipped up (assuming they aren't too toxic) for comparison. Lead based paints obviously are more problematic, but modern technology is really good at replicating paint colors.
You've seen though where a fabric covered couch, color faded over time, will reveal its original color when you roll back the cording covering the zipper or whatever. But I get your point.
