build: remove double-setting of build_public_headers