Can I delete a custom rhythm pattern?

Yes. Go to the “Edit/Export Custom Sets” menu (square with up arrow icon action item, top right navigation bar of Custom screen) and select “Edit Custom Set.” From there, you can delete an entire set, or individual patterns from a set, and also change the title of a set.