HH110: Invalid JSON-RPC response received: {"jsonrpc":"2.0","id":14} (While using matic testnet with Alchemy API)

Question

I'm running an Alchemy node (Matic Mumbai Testnet), having already set up Hardhat in VScode with the required dependencies. However, I get this error when I try to deploy to the testnet.

Here is the error I get:

HardhatError: HH110: Invalid JSON-RPC response received: {"jsonrpc":"2.0","id":14}

hardhat.config.js

module.exports = {
  solidity: "0.8.9",
  networks: {
    matic: {
      url: 'https://polygon-mumbai.g.alchemy.com/v2/{My_Alchemy_API_key}',
      accounts: [
        '{My_Private_Key}'
      ]
    }
  }
};

However, when I use a change the RPC url to:

https://matic-mumbai.chainstacklabs.com/

it deploys correctly.

Is there a workaround or solution for the Alchemy error? Sorry, I'm new to this and trying to monitor a bunch of stats using Alchemy.