Kedro is an open source Python library that helps you build production-ready data and analytics pipelines
Questions tagged [kedro]
202 questions
0
votes
1 answer
How to run functions from a Class in the nodes.py file?
I want to organize the node functions by Classes in the nodes.py file. For example, functions related to cleaning data are in the "CleanData" Class, with a @staticmethod decorator, while other functions will stay in the "Other" Class, without any…
sofiacosta29
- 27
- 7
0
votes
3 answers
How to run a pipeline except for a few nodes?
I want to run a pipeline for different files, but some of them don't need all of the defined nodes. How can I pass them?
sofiacosta29
- 27
- 7
-1
votes
1 answer
Pickling a file
I using kedro in conjunction with databricks-connect to run my machine learning model. I am trained and tested the model using databricks notebook and saved the pickle file of the model to azure blob storage. To test the pipeline locally I…
Nishad V Seeraj
- 9
- 1
-1
votes
2 answers
How do I add multiple csv files to the catalog in kedro
I have 4 csv files in Azure blob storage, with same metadata, that i want to process. How can i add them to the datacatalog with a single name in Kedro.
I checked this…
DataEnthusiast
- 39
- 8
-1
votes
1 answer
How can we get the pipeline to read columns with special characters?
I am using the "usecols" parameter to get some columns of a .xlsx file (I am using the xls_local.py file from the Kedro tutorial) but the program says that "usecols do not match columns, columns expected but not found:" and it only shows the columns…
sofiacosta29
- 27
- 7
-2
votes
1 answer
How to pass a literal value to a kedro node?
I've got a function
def do_something(input_data, column: int):
# Do something with one column of the data
Now I need to create a kedro node, but I can't do node(do_something, ["input_data", 1], "output"). How can I put the constant value (1)…
Anton Kirilenko
- 159
- 6