The author famed for his self-revelation explains why his new series forsakes inner turmoil to focus on the outside world