Alright, dropped my fork tonight expecting the worst....
To be honest, its a complete non issue for me, thank fk. No marks on the steerer, cleaned up the old grease off the bearings and they spin smoothly. Cleaned everything up, regreased and reassembled and we are good to go for another 6...