There is a revelatory article by Peter Louis Galison called
Minkowski's Space-Time:
From Visual Thinking to the Absolute World
on pages 85-121 of
Historical Studies in the Physical Sciences, vol X, 1979.
It contains, among many other things, Minkowski's thoughts on the
relationship between mathematics and physics.
Best wishes,
Sam Kutler