Stack Overflow
Stack Overflow

Questions tagged [papermill]

Papermill is a tool for parameterizing and executing Jupyter Notebooks.

Help / Support / How do I?

For help and support or technical, please submit your questions to Stack Overflow: https://stackoverflow.com/questions/tagged/papermill.

Also check out the papermill FAQ before asking a question.

When looking for info, especially build info, one needs to check in the GitHub site.

Report Issues

Please report bugs, feature requests and installation / compatibility issues on the papermill issues tracker on GitHub. If you need help with using papermill, please do not use the issue tracker for that. Instead, direct your questions to Stack Overflow.

Documentation

Take a look at the Papermill documentation on ReadTheDocs.

72 questions
0
votes
1 answer

Dependencies and local package not available when building notebooks in GitHub actions workflow

I am getting back to Python but new to poetry and papermill. We have repository hosted on GitHub which is a Python package with pyproject.toml which is private, once public and if this issue persists, will provide URL. We also have some notebooks in…
Layik
  • 43
  • 6
0
votes
0 answers

Error Loading Papermill-Generated ipython .ipynb files in Jupyter Notebook

I generate html reports using papermill and jupyter notebook, and have done so successfully for quite some time. Suddenly, and even though the html reports are generated just fine, the ipynb files that are generated along with it (in fact, I believe…
pmse234
  • 15
  • 4
0
votes
0 answers

Execute_notebook never returns

I'm using papermill in a web app, and running execute_notebook inside of celery tasks. I'm logging the output, and the entire notebook finishes, I get the export I'm waiting for in GCS, and it all seems perfect. but my execute_notebook statement…
Big Guy
  • 712
  • 1
  • 8
  • 21
0
votes
1 answer

Can I parse the content of a Jupyter Notebook cells in a script?

Is it possible to extract the content of a Jupyter notebook input cell programatically? Be that raw cell / code / Markdown, does not matter really. I was thinking of tools like nbconvert or papermill but could not find exactly what I am looking…
maciek
  • 1,807
  • 2
  • 18
  • 30
0
votes
0 answers

How to automate html reports generation using Luigi and Papermill

I am trying to combine Luigi and papermill functionality to automate my reports. (courtesy this beautiful article : this The reports are being generated but I run into two problems: Issue 1: The output from papermill .ipynb file has some plotly…
Ashwin
  • 141
  • 1
  • 1
  • 8
0
votes
1 answer

Problem with push dict parameters to PapermillOperator from xcom airflow

I am trying to push parameter with dict inside from airflow xcom_pull to PapermillOperator like that: send_to_jupyter_operator = PapermillOperator( task_id='send_to_jupyter', input_nb="./dags/notebooks/input_test.ipynb", …
VorobevNikita
  • 1
  • 1
0
votes
1 answer

Airflow get stuck and never finish on running PapermillOperator

I'm trying to run a DAG that have a task that is running a jupyter notebook. Every task is doing well until it get's to Papermill operator. the progress bar stay on 0 and the task never finish. when looking inside the pod there is…
David Belhamou
  • 19
  • 3
0
votes
1 answer

Papermill prints everything on the console

I am working on adding new features to project. Within the project I am logging stdout to a file because some components are printing information useful for debugging. I recently added a new feature to the project which uses papermill to run jupyter…
Asfandyar Abbasi
  • 53
  • 2
  • 7
0
votes
1 answer

Runtime Error on Cloud Run when using Dash App and Papermill executions on background tasks

I am facing an issue in CloudRun: Below I am only showing the scheduling part (background tasks), but I also have some code for a Dash application. I would like to have a Dash application and scheduler that can execute Jupyter Notebooks on the same…
Milan Goetz
  • 1
  • 1
0
votes
1 answer

Can I use papermill for aws sagemaker notebooks to create excel reports?

So I know I can use papermill to run jupyter notebooks in an automated way, but if I use an AWS Sagemaker notebook and I create excel reports with jupyter notebook (exporting to excel). How do I find my excel files? Because I can only give a…
Aniel Kali
  • 1
0
votes
0 answers

Can't find output file/folder of papermill operator. Apache Airflow 2.0. Suppose to be in tmp folder. Output_nb="/tmp/out-{{ execution_date }}.ipynb"

Can't find output file/folder of papermill operator. Apache Airflow 2.0. Suppose to be in tmp folder. Output_nb="/tmp/out-{{ execution_date }}.ipynb" I am not able to find the file or folder anywhere. with DAG( …
Digital_eye1
  • 1
0
votes
1 answer

papermill error unexpexted keyword argument min when storing output to gcs

Hi I am running papermill inside google composer (Manager airflow). I am using PythonVirtualenvOperator to run papermill inside composer. The source notebook is inside google cloud storage and the path where I need to store the executed notebook is…
Jegath Suresh
  • 3
  • 4
0
votes
1 answer

How to mark Jupyter Notebook trusted when generating the notebook with Papermill

I have a daily process using Papermill to generate a few Jupyter Notebook files that overwrite the files from previous day. Every time the newly generated files are marked as "untrusted". I can click the button to make them trusted, but annoying to…
Leon
  • 37
  • 3
0
votes
1 answer

Remotely run a notebook on jupyterhub singleuser server

I have deployed jupyterhub to GKE using the Zero to Jupyterhub Helm chart. I've set up my python environment and notebooks in my spawned singleuser instance, and now I would like to remotely (e.g., via API on another server) run a notebook in my…
RAY
  • 474
  • 4
  • 21
0
votes
2 answers

google cloud notebook instance run script not in startup

I have a notebook instance with a notebook file. I use the instance's startup script to run this notebook file using papermill. I want the notebook file to be run only when I remotely start the instance, and not from google cloud console. I'd like…
Rony Tesler
  • 1,207
  • 15
  • 25
1 2 3
4
5