That’s pretty simple. But you have to do it in UA_SYSTEM_TABLES database. There is no graphical way to remove campaign Custom Attributes.
delete from UA_CAMPATTRIBUTE where ATTRIBUTEID = ?; delete from UA_ATTRIBUTEDEF where ATTRIBUTEID = ?;
Put your attribute ID on above placeholders and execute the query. You will not be able to see those fields on Campaign UI.