There are a couple of ways to look at this.
The ideal is to cut out fossil fuel drilling everywhere as quickly as possible, but with more than a billion cars in the world using it, as well as electricity generation, heating, industry, etc. that is not going to happen immediately however much we want it to.
So, who should produce all of the oil and gas that we are still going to need in the short-term future?
If Norway are going to do better on other sustainability metrics, and hopefully drill for oil in a less polluting and safer way than many other states might, then perhaps it is not a bad thing that they continue production for now.
On the other hand, the simpler answer is that we should just stop all the production everywhere right now, but it is not immediately realistic.