【发布时间】：2019-04-19 14:49:16
【问题描述】：
我保存了一个 Tensorflow 模型，并正在使用 Tensorflow Serving（tensorflow/serving:1.12.0 和 tensorflow/serving:1.12.0-gpu）为其提供服务。
我想使用 Predict REST API，但调用失败并出现“未正确格式化 base64 数据”错误。
请求：
POST /v1/models/payfraud:predict
{
"inputs": [
{
"payFraudInput": [[44.26, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0]]
}
]
}
回复：
400
{
"error": "JSON Value: {\n \"payFraudInput\": [\n [\n 44.26,\n 0,\n 0,\n 0,\n 0,\n 1,\n 0,\n 0,\n 0,\n 0,\n 0,\n 0,\n 0,\n 0\n ]\n ]\n} not formatted correctly for base64 data"
}
模型输入需要 DT_FLOAT，所以我认为我不需要 base64 编码。
POST /v1/models/payfraud/versions/1/metadata
{
"model_spec": {
"name": "payfraud",
"signature_name": "",
"version": "1"
},
"metadata": {
"signature_def": {
"signature_def": {
"predict_fraud": {
"inputs": {
"payFraudInput": {
"dtype": "DT_FLOAT",
"tensor_shape": {
"dim": [
{
"size": "-1",
"name": ""
},
{
"size": "15",
"name": ""
}
],
"unknown_rank": false
},
"name": "payFraudInput:0"
}
},
"outputs": {
"payFraudOutput": {
"dtype": "DT_FLOAT",
"tensor_shape": {
"dim": [
{
"size": "-1",
"name": ""
},
{
"size": "2",
"name": ""
}
],
"unknown_rank": false
},
"name": "payFraudOutput:0"
}
},
"method_name": "tensorflow/serving/predict"
},
"serving_default": {
"inputs": {
"inputs": {
"dtype": "DT_STRING",
"tensor_shape": {
"dim": [],
"unknown_rank": true
},
"name": "tf_example:0"
}
},
"outputs": {
"classes": {
"dtype": "DT_STRING",
"tensor_shape": {
"dim": [
{
"size": "-1",
"name": ""
},
{
"size": "2",
"name": ""
}
],
"unknown_rank": false
},
"name": "index_to_string_Lookup:0"
},
"scores": {
"dtype": "DT_FLOAT",
"tensor_shape": {
"dim": [
{
"size": "-1",
"name": ""
},
{
"size": "2",
"name": ""
}
],
"unknown_rank": false
},
"name": "TopKV2:0"
}
},
"method_name": "tensorflow/serving/classify"
}
}
}
}
}
这是模型的保存方式：
prediction_signature = (
tf.saved_model.signature_def_utils.build_signature_def(
inputs={"payFraudInput": tensor_info_x},
outputs={"payFraudOutput": tensor_info_y},
method_name=tf.saved_model.signature_constants.PREDICT_METHOD_NAME))
classification_signature = (
tf.saved_model.signature_def_utils.build_signature_def(
inputs={
tf.saved_model.signature_constants.CLASSIFY_INPUTS:
classification_inputs
},
outputs={
tf.saved_model.signature_constants.CLASSIFY_OUTPUT_CLASSES:
classification_outputs_classes,
tf.saved_model.signature_constants.CLASSIFY_OUTPUT_SCORES:
classification_outputs_scores
},
method_name=tf.saved_model.signature_constants.CLASSIFY_METHOD_NAME))
export_path = os.path.join(tf.compat.as_bytes(export_dir), tf.compat.as_bytes("1"))
print('Exporting trained model to ', export_path)
builder = tf.saved_model.builder.SavedModelBuilder(export_path)
builder.add_meta_graph_and_variables( sess, [tf.saved_model.tag_constants.SERVING],
signature_def_map={
'predict_fraud':
prediction_signature,
tf.saved_model.signature_constants.DEFAULT_SERVING_SIGNATURE_DEF_KEY:
classification_signature,
},
main_op=tf.tables_initializer(),
strip_default_attrs=True)
builder.save()
print('Done exporting!')
尝试 b64 也不起作用：
请求
{
"inputs": [
{
"payFraudInput":{"b64":"NDQuMjYsIDAsIDAsIDAsIDAsIDEsIDAsIDAsIDAsIDAsIDAsIDAsIDAsIDA="}
}
]
}
回应
{
"error": "JSON Value: {\n \"payFraudInput\": {\n \"b64\": \"NDQuMjYsIDAsIDAsIDAsIDAsIDEsIDAsIDAsIDAsIDAsIDAsIDAsIDAsIDA=\"\n }\n} not formatted correctly for base64 data"
}
我做错了什么？
【问题讨论】：
标签： python rest tensorflow tensorflow-serving