Judging Books by their Covers