Yes - just create a Group that does not have meeting booking privileges (uncheck the 'can book meetings' box). Alternatively, if you want members of this Group to be displayed on the main website, check the 'can book meetings' box on its Edit page, but do not check any of the 'can book with' options.
Learn more about what you can do with Custom Fields by visiting this article.