Non-Equilibrium Simulations Of Material Heterogeneities In Extreme Regimes