A court has ruled that Norway violated mass killer Anders Breivik's human rights by keeping him in isolation in prison.