Going to https://github.com/organizations/<YOUR_ORGANIZATION_NAME>/settings/oauth_application_policy
, titled Third-party application access policy you can "Grant" or "Deny" access to third party applications.
But what actions do you need to take to completely remove an item from that page?
Assume in this case I am the account that "granted" the access or "requested" that access be granted. But a solution that allows an organization owner to do this regardless would be preferable.