Extending cornerstone quantum optics models: Quantum criticality beyond two-level atoms and single cavities