How to add Panderas layer to AWS lamda

[jonathangebru]

AWS doesn’t support Panderas out of the box. So I need to add a Panderas layer to AWS lamda to make this work, does somebody have any experience with this? If so, a small tutorial would really help.

[cosmicBboy]

I know other users have created their own lambda setups using pandera.

Have you tried creating a lambda layer following this guide? https://docs.aws.amazon.com/lambda/latest/dg/configuration-layers.html

edit: happy to work with you in creating a small tutorial on the pandera docs!

[jonathangebru]

Would you be able to send me that package

[cosmicBboy]

hmm, not sure I understand the question... you can pip install pandera from anywhere, I'd follow the official AWS guides to add custom dependencies (in this case pandera) either as a container image or zip archive

Or follow this guide if you want to build a reusable layer: https://docs.aws.amazon.com/lambda/latest/dg/configuration-layers.html

[jonathangebru]

Let me rephrase it. I tried implementing and it doesn't work with either the Source Distribution or Built Distribution file (downloading and then compressing it as a zip file). So I'm wondering which file (in zip form) should be added to the Lamda Layer.

**To upload your layer code, do one of the following:

To upload a .zip file from your computer, choose Upload a .zip file. Then, choose Upload to select your local .zip file.** <- Step five in the instructions.

[cosmicBboy]

I tried implementing and it doesn't work

what does "doesn't work" mean? are you getting an error message?

[cosmicBboy]

see here for how to create the zip file: https://alexharv074.github.io/2018/08/18/creating-a-zip-file-for-an-aws-lambda-python-function.html#create-the-zip-file

[jonathangebru]

"errorMessage": "Unable to import module 'lambda_validation': No module named 'pandera'", --> Error message I receive.

My question is: What files go into the zip file that is added to the Lamda layer? is that the Source Distribution or Built Distribution file or both.

[cosmicBboy]

Can you try this guide? https://alexharv074.github.io/2018/08/18/creating-a-zip-file-for-an-aws-lambda-python-function.html#create-the-zip-file