With My Back Against the Wall has been mostly inspired by the following:

- Vicious (Halestorm)
- Quand tu serres mon corps (Pacifique)
- Don't Leave Me Now (Supertramp)
- Know Why the Nightingale Sings (Nightwish)