无服务器python包装numpy依赖错误

如何解决无服务器python包装numpy依赖错误

从已部署的Python3.7 Lambda函数进行函数调用时遇到了问题，该错误消息与错误消息有关，该函数与numpy相关。问题指出，无法导入软件包，尽管尝试了我已经读过的许多解决方案，但我没有取得任何成功，我想知道接下来要测试什么或如何进一步调试。

我尝试了以下操作：

安装Docker，添加插件serverless-python-requirements，在yml中配置
在应用目录中安装要捆绑和部署的软件包，pip install -t src/vendor -r requirements.txt --no-cache-dir
已卸载setuptools和numpy，并按此顺序重新安装

错误消息（运行sls invoke -f auth后显示）：


{
    "errorMessage": "Unable to import module 'data': Unable to import required dependencies:\nnumpy: \n\nIMPORTANT: PLEASE READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE!\n\nImporting the numpy c-extensions failed.\n- Try uninstalling and reinstalling numpy.\n- If you have already done that,then:\n  1. Check that you expected to use Python3.7 from \"/var/lang/bin/python3.7\",\n     and that you have no directories in your PATH or PYTHONPATH that can\n     interfere with the Python and numpy version \"1.18.1\" you're trying to use.\n  2. If (1) looks fine,you can open a new issue at\n     https://github.com/numpy/numpy/issues.  Please include details on:\n     - how you installed Python\n     - how you installed numpy\n     - your operating system\n     - whether or not you have multiple versions of Python installed\n     - if you built from source,your compiler versions and ideally a build log\n\n- If you're working with a numpy git repository,try `git clean -xdf`\n  (removes all files not under version control) and rebuild numpy.\n\nNote: this error has many possible causes,so please don't comment on\nan existing issue about this - open a new one instead.\n\nOriginal error was: No module named 'numpy.core._multiarray_umath'\n","errorType": "Runtime.ImportModuleError"
}

提供了我的设置：

OS: Mac OS X
Local Python: /Users/me/miniconda3/bin/python
Local Python version: Python 3.7.4

无服务器环境信息（运行时= Python3.7）：

 Operating System:          darwin
 Node Version:              12.14.0
 Framework Version:         1.67.3
 Plugin Version:            3.6.6
 SDK Version:               2.3.0
 Components Version:        2.29.1

Docker：

Docker version 19.03.13,build 4484c46d9d

serverless.yml：

service: understand-your-sleep-api

plugins:
  - serverless-python-requirements
  - serverless-offline-python

custom:
  pythonRequirements:
    dockerizePip: true # non-linux
    slim: true
    useStaticCache: false
    useDownloadCache: false
    invalidateCaches: true

provider:
  name: aws
  runtime: python3.7
  stage: ${opt:stage,'dev'}
  region: us-east-1
  iamRoleStatements:
    - Effect: Allow
      Action:
        - ssm:GetParameter
      Resource: "arn:aws:ssm:us-east-1:*id*:parameter/*"
  environment:
    STAGE: ${self:provider.stage}

functions:
  auth:
    handler: data.auth
    events:
      - http:
          path: /auth
          method: get
          cors: true

package:
  exclude:
    - env.yml
    - node_modules/**

requirements.txt：

pandas==1.0.0
fitbit==0.3.1
oauthlib==3.1.0
requests==2.22.0
requests-oauthlib==1.3.0

data.py：

import sys
sys.path.insert(0,'src/vendor') # Location of packages that follow
import json
from datetime import timedelta,datetime,date
import math
import pandas as pd
from requests_oauthlib import OAuth2Session
from urllib.parse import urlparse,parse_qs
import fitbit
import requests
import webbrowser
import base64
import os 
import logging

def auth(event,context):
    ...

解决方法

由于您使用的是serverless-python-requirements插件，它将为您打包这些库。用词来说，您不需要手动pip install -t src/vendor -r requirements.txt --no-cache-dir做所有这些事情。

要解决您的问题，请删除src/vendor和data.py中的以下两行：

import sys
sys.path.insert(0,'src/vendor') # Location of packages that follow

然后坐下来，让serverless-python-requirements为您完成工作。

使用lambda层打包所有需求，请确保Requirements.txt文件中包含numpy。尝试一次。
仅当在“插件”部分中列出了serverless-python-requirements插件时，此方法才有效。
以此替换您的自定义键，并为函数提供使用该层的参考

custom:
  pythonRequirements:
    layer: true
functions:
  auth:
    handler: data.auth
    events:
      - http:
          path: /auth
          method: get
          cors: true
    layers:
      - { Ref: PythonRequirementsLambdaLayer}

无服务器python包装numpy依赖错误

如何解决无服务器python包装numpy依赖错误

解决方法

相关推荐