The pullup is one of the most effective exercises for strengthening the back muscles. Pullups work the following muscles of the back: Latissimus dorsi: largest upper back muscle that runs from the mid-back to under the armpit and shoulder blade.