Modelling black hole binaries in the intermediate-mass-ratio regime