If he really went at speed I reckon he could have drove it in six minutes.
And wake up everyone in the process driving at breakneck speed

If he started his car up in Goldhanger at silly hours he run the risk of being observed driving away from his cottage and out of the village. Where would he park at WHF? If he drove up Pages Lane he run the risk of waking up those in the farm cottages. If he parked at the bottom of Pages Lane or on the B1023 then he run the risk of passers by seeing his car. And yes others are out and about at silly hours: police patrol cars, emergency personnel, medics, etc. It was the height of the holiday season with holiday makers departing and arriving from airports and ferry crossings. All it would take is one person to observe his car and game over.
If he cycled he had to move the bike along Head Street and Fish Street. Same risks as above.
If he walked and wore dark clothing and was able to camaflouge his person it would present little risk. If someone spotted such a person they would be unable to identify.
So he either walked or didn't leave WHF until the call from NB. I reckon its the latter.