Cannot access private IP address after doing failover in azure site recovery, the public IP address works though

Question

Suppose I have a Linux virtual machine running in East US

virtual network [10.216.96.0/20]
subnet [10.216.96.0/24]
private IP address [10.216.96.53]
public IP address [1.1.1.1]
network security group {
    source : any
    destination: 10.216.96.53
    port: 22
}

Everything works fine in this virtual machine. After I setup Disaster Recovery on this machine and run failover, a new Linux virtual machine being created in West US

virtual network [10.216.92.0/20]
subnet [10.216.92.0/24]
private IP address [10.216.92.16]
public IP address [1.1.1.2]
network security group {
    source : any
    destination: 10.216.92.16
    port: 22
}

When I try to verify this target machine, I can do telnet 1.1.1.2 22 or ssh user@1.1.1.2 successfully without any issue, but failed on telnet 10.216.92.16 22 or ssh user@10.216.92.16 I also run IP flow fly and NSG diagnostics in Network Watch to verify the traffic, both of them work properly. Does anyone know why I cannot access private IP address? Is there any other tools that I can trace this situation?

Thanks