I have found a plugin that creates customer specific pricing, but seems to be an external API call that seem to not be the solution I am looking for.
https://woocommerce.com/products/wisdm-customer-specific-pricing/
I was confused to how the cart works and how products are stored. But based on this post it showed me how to replace cart prices with customer ID and sku's being passed to the API.
I used this this ticket to start off my answer
So the big thing I needed to figure out is how to call the cart, loop through each product and grab it's product SKU then overwrite the price.