Stack Overflow
Stack Overflow

Questions tagged [papermill]

Papermill is a tool for parameterizing and executing Jupyter Notebooks.

Help / Support / How do I?

For help and support or technical, please submit your questions to Stack Overflow: https://stackoverflow.com/questions/tagged/papermill.

Also check out the papermill FAQ before asking a question.

When looking for info, especially build info, one needs to check in the GitHub site.

Report Issues

Please report bugs, feature requests and installation / compatibility issues on the papermill issues tracker on GitHub. If you need help with using papermill, please do not use the issue tracker for that. Instead, direct your questions to Stack Overflow.

Documentation

Take a look at the Papermill documentation on ReadTheDocs.

72 questions
0
votes
0 answers

working directory of a notebook run by startup script is not its real path, but '/'

I have a notebook instance with a startup script that uses papermill to execute a notebook. The problem is that the working directory is '/' and not the path of the file. How do I get the path of the file so I can set it as the working…
Rony Tesler
  • 1,207
  • 15
  • 25
0
votes
0 answers

Convert python script to Jupyter and save the output in html

I have a python script, which takes --days params and outputs graphs for the range, i want to convert this python script to Jupyter notebook and execute the code and save the output in html format. parser =…
Sanjay M. P.
  • 919
  • 1
  • 16
  • 33
0
votes
1 answer

Why I can import packages in my jupyter notebooks only when using `pipenv run papermill`?

In a project where I have to run some Jupyter notebooks, I created a virtual environment using pipenv and installed some packages (note that I used the --site-packages flag). Although now I am now able to run the notebooks with pipenv run papermill…
Stefano Campanella
  • 33
  • 2
0
votes
0 answers

MultiProcessing with papermill inside docker container

The problem I am facing is the following: This is the setup: A docker container with a base image of Python:3.7.8-stretch A Local environment on Ubuntu 20.04 My goal is to launch multiple jupyter notebooks in parallel inside a docker container…
Felipe Bormann
  • 119
  • 6
0
votes
2 answers

How to delete a Jupyter Notebook input cell programmatically, using its tag?

In our largest ML modeling pipeline notebook we need to delete a single input (code) cell (containing sensitive information which we cannot pass via other means when automating its execution). The cell has been created (injected) by…
mirekphd
  • 4,799
  • 3
  • 38
  • 59
0
votes
1 answer

Running papermill I get a FileNotFound Error

I'm running papermill 2.1.0 in a newly created virtual environment in Mac OS When I execute a simple notebook I get: FileNotFoundError, referring to and old file that no longer exists. papermill 59848931.ipynb 59848931-out.ipynb I get the…
gogasca
  • 9,283
  • 6
  • 80
  • 125
0
votes
1 answer

Airflow Error - got an unexpected keyword argument 'min'

I'm trying to run a very simple test DAG to get the hang of the basic functionalities of GCP Cloud Composer, but everytime I trigger the DAG, a nasty error pops out and I can't seem to find any information about how to solve it. The error…
Kuba Wernerowski
  • 337
  • 1
  • 6
  • 17
0
votes
1 answer

How do I print progress of a single cell to the console using papermill?

I want my program to print the progress to the console as it is running using papermill. I'm using the following code: print(str(int(float(percentage)*100)) In a for loop and it doesn't print the string to the console so I have no idea as to how…
Ravaal
  • 3,233
  • 6
  • 39
  • 66
0
votes
1 answer

Problems executing get_ipython code in Notebook with Papermill

I have a notebook that re-formats results from an exploratory analysis notebook for exporting to slides. This notebook creates new cells based on how many "part types" and "parameters" are passed in. I used the following code to generate a new cell…
dsmit
  • 1
0
votes
1 answer

How to run a command in another pod in another namespace from an Airflow worker in a Kubernetes cluster

I want to run a papermill command in a pod and get the errors (if any). This has to be done from an Airflow worker using the bash operator i Airflow. I have tried running the command as needed, I have tried running multiple bash commands from my own…
Aviral Srivastava
  • 4,058
  • 8
  • 29
  • 81
0
votes
1 answer

How do I set parameters for each notebook on JuPyterHub running on K8s

I want to set some parameters as defined here(https://github.com/nteract/papermill#python-version-support). The catch is, I want to be able to do this via UI. I have a JHub installed on my cluster and while opening it, I want certain parameters to…
Aviral Srivastava
  • 4,058
  • 8
  • 29
  • 81
0
votes
0 answers

Why won't my notebook display figure after reading in from another notebook?

I'm aware thet plots and notebooks can have some interesting behaviour when used together. This must be a fairly standard thing to encounter for anyone following the papermill usage guide. Here is the documentation I'm following to the…
jsstuball
  • 4,104
  • 7
  • 33
  • 63
1 2 3 4
5