如何解决Google云存储:将字符串上传到GCS时,CRC32C和MD5不匹配
尝试上传JSON字符串并覆盖GCS存储桶中的现有对象时,出现以下错误。
google.api_core.exceptions.BadRequest: 400 POST https://storage.googleapis.com/upload/storage/v1/b/cc-freshdesk/o?uploadType=multipart: {
"error": {
"code": 400,"message": "Provided CRC32C \"i8Z/Pw==\" doesn't match calculated CRC32C \"mVn0oQ==\".","errors": [
{
"message": "Provided CRC32C \"i8Z/Pw==\" doesn't match calculated CRC32C \"mVn0oQ==\".","domain": "global","reason": "invalid"
},{
"message": "Provided MD5 hash \"6NMASNWhbd4WlIj/tWK4Sw==\" doesn't match calculated MD5 hash \"9H5THzsUBARmhzw5NjjgNw==\".","reason": "invalid"
}
]
}
}
: ('Request failed with status code',400,'Expected one of',<HTTPStatus.OK: 200>)
找到以下代码段:
storage_client = storage.Client()
bucket = storage_client.bucket(bucket_name)
config_blob = bucket.blob(destination_blob_name)
config_blob.upload_from_string(json.dumps(config_data,indent=4),content_type='text/plain')
任何人都可以帮助我了解为什么可能发生此问题。
解决方法
要复制您遇到的错误:
import json
from google.cloud import storage
client = storage.Client()
bucket = client.get_bucket('some-bucket')
# blob1 object
blob1 = bucket.get_blob('file.json')
# downloads content
blob1_string = blob1.download_as_string()
# converts to dict and update content
blob1_obj = json.loads(blob1_string)
blob1_obj['some-key'] = 'some value'
# upload using same blob instance
blob1.upload_from_string(json.dumps(blob1_obj))
# throws error like this `Provided MD5 hash "Ax9olGoqOSb7Nay2LNkCSQ==\" #doesn't match calculated MD5 hash \"XCMPR0o7NdgmI5zN1fMm6Q==\".",
您可能正在使用相同的Blob来下载和上传内容。为防止此错误,您需要创建两个blob实例:
import json
from google.cloud import storage
client = storage.Client()
bucket = client.get_bucket("some-bucket")
# blob1 object -- for downloading contents
blob1 = bucket.get_blob('file.json')
blob1_string = blob1.download_as_string()
# Convert to dictionary
blob1_obj = json.loads(blob1_string)
# Add stuff
blob1_obj['some-key'] = 'some value'
# blob2 object -- for uploading contents
blob2 = bucket.get_blob('file.json')
blob2.upload_from_string(json.dumps(blob1_obj))
# no error
,
以防万一有人在 9 个月后需要这个。 使用两个不同的 blob 不是您通常想要的。很多时候,您必须在两个方向上进行多次读取和写入。所以我会严格不鼓励使用这种方法。 您只需要通过调用“reload()”显式刷新 CRC32 校验和:
Application.DisplayAlerts = False
Application.AskToUpdate = False
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 dio@foxmail.com 举报,一经查实,本站将立刻删除。