we are using local PyPiserver which is installed on google cloud run and only that has access to internet.
So to download the packages I am using following command.
I had no issue install protobuf but I am facing issue installing rsa
pip install --index https://pypiserver-xxx-nn.a.run.app/simple rsa
it works for some packages, however it failed for some others. not sure why this behaviour.
Library installation attempted on the driver node of cluster 1109-195409-vp4zf2tp and failed. Please refer to the following error message to fix the library or contact Databricks support. Error Code: DRIVER_LIBRARY_INSTALLATION_FAILURE. Error Message: org.apache.spark.SparkException: Process List(bash, /local_disk0/.ephemeral_nfs/cluster_libraries/python/python_start_clusterwide.sh, /local_disk0/.ephemeral_nfs/cluster_libraries/python/bin/pip, install, rsa, --index-url, https://pypiserver-xxx-nn.a.run.app/simple, --disable-pip-version-check) exited with code 1. WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fa3bfa4ac40>, 'Connection to pypiserver-xxx-nn.a.run.app timed out. (connect timeout=15)')': /simple/rsa/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fa3bfa4ae20>, 'Connection to pypiserver-xxx-nn.a.run.app timed out. (connect timeout=15)')': /simple/rsa/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fa3bfa4afa0>, 'Connection to pypiserver-xxx-nn.a.run.app timed out. (connect timeout=15)')': /simple/rsa/
WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fa3bf9ee160>, 'Connection to pypiserver-xxx-nn.a.run.app timed out. (connect timeout=15)')': /simple/rsa/
WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fa3bf9ee2e0>, 'Connection to pypiserver-xxx-nn.a.run.app timed out. (connect timeout=15)')': /simple/rsa/
ERROR: Could not find a version that satisfies the requirement rsa (from versions: none)
ERROR: No matching distribution found for rsa
