ordinarius ita dicitur quia habet ordinariam jurisdictionem, in jure proprio, et non propter deputationem

An ordinary is so called because he has ordinary jurisdiction in his own right, and not by deputation or delegation.