As cold as it sometimes may be, and as unexpected as the weather can get, it is worth every layer of clothing you need to put on when in Iceland!
