Special keys are needed to take them off. This and the length of time it takes, rules out them being taken off just before the massacre. Once inside WHF, he would want to be as silent as possible and get upstairs quickly.
Taking them off during supper is possible. Providing Nevill did not see him. Not sure when Nevill did the last trailer. Bit risky relying on getting an opportunity a few hours beforehand.