Spatial Action Maps Augmented With Visit Frequency Maps For Exploration Tasks