Shallow Losses