Data-driven Solutions for Power Systems During Energy Transition