How to remove core rotate image feature?

You can hide it with CSS:

.imgedit-rleft, .imgedit-rright {
  display: none;
}

A knowledgeable user could restore it, but it’ll deter almost everyone. For more on using CSS to style admin screens see Creating Admin Themes.

Ahh didn’t think of that. Thank you bcworkz!