I am using dbx to work on mixed-mode development loop. This is the link in case you want to read about it.
This are the steps:
First cell:
import autoreload
%load_ext autoreload
%autoreload 2
Second cell:
from pathlib import Path
import sys
project_root = Path(".").absolute().parent
print(f"appending the main project code from {project_root}")
sys.path.append(project_root)
I was running the code perfectly with:
11.3 LTS (includes Apache Spark 3.3.0, Scala 2.12)
I updated the cluster to:
12.2 LTS (includes Apache Spark 3.3.2, Scala 2.12)
When doing so I got error:
ModuleNotFoundError: No module named 'autoreload'
I know about the issue with the extra space but it is not the case here.
Does anyone know who to solve it?