Nothing else matters other than the goals going in. We've gone ten games in the league without keeping a clean sheet, whatever xG says.
The main issue we have is that our best player in defence (Torres) is there more for his footballing ability than his defending ability. The latter of which if we're being honest, isn't good enough. We'll be better when either Kamara is back, or Onana gets to Kamara's levels of defensive screening.