Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

上传文件保存失败:无法将资源注册到数据集中.... #273

Open
Bb91234567890 opened this issue Dec 30, 2024 · 0 comments
Open
Labels
bug Something isn't working

Comments

@Bb91234567890
Copy link

bug描述

  • 管理平台保存文件出错

image

复现步骤

1.启动primihub项目,主要用到node0节点
2.启动primihub-platform项目,启动primihub-meta成功
3.登入系统,添加节点,添加网关地址
image
4.资源管理-我的资源-添加资源-上传文件成功-保存失败
image
错误:
添加失败:无法将资源注册到数据集中:file_path: /usr/zx/primihub/data/upload/1/2024123013/258cc537-a106-4b4d-9524-8e6afd75045e.csv is not exist

bug日志

node0节点:

I20241230 13:38:31.455092  3195 ds.cc:235] start to create dataset.meta info: /usr/zx/primihub/data/upload/1/2024123013/258cc537-a106-4b4d-9524-8e6afd75045e.csv fid: 11c937ad8595-e02d005d-72f9-4bb2-9548-0431d98a2b03 driver_type: csv
E20241230 13:38:31.455243  3195 csv_driver.cc:323] file_path: /usr/zx/primihub/data/upload/1/2024123013/258cc537-a106-4b4d-9524-8e6afd75045e.csv is not exist
E20241230 13:38:31.455291  3195 ds.cc:257] Failed to load dataset from: /usr/zx/primihub/data/upload/1/2024123013/258cc537-a106-4b4d-9524-8e6afd75045e.csv driver_type: csv fid: 11c937ad8595-e02d005d-72f9-4bb2-9548-0431d98a2b03 exception: file_path: /usr/zx/primihub/data/upload/1/2024123013/258cc537-a106-4b4d-9524-8e6afd75045e.csv is not exist


platform日志:

13:42:31.921 [INFO ] [http-nio-8090-exec-2] [com.primihub.biz.util.FileUtil:185] [id, name, age]
13:42:31.921 [INFO ] [http-nio-8090-exec-2] [com.primihub.biz.util.FileUtil:188] [1, zx, 18]
13:42:34.951 [INFO ] [http-nio-8090-exec-3] [com.primihub.sdk.task.factory.AbstractDataSetGRPCExecute:32] run dataServiceGrpc param:TaskParam{requestId='7a47904c2eb945e3bf408270b0c3cb0b', taskId='null', jobId='null', isSuccess=true, isEnd=false, error='null', partyCount=null, isOpenGetStatus=true, taskContentParam=DataSetTaskParam{id='11c937ad8595-a95adc4b-464b-4f7e-833e-fe6f0da48183', accessInfo='/usr/zx/primihub/data/upload/1/2024123013/fabf1047-232e-4bf9-90e5-f2394bf1378a.csv', driver='csv', visibility='null', fieldTypes=[com.primihub.sdk.task.param.TaskDataSetParam$FieldType@697cedcd, com.primihub.sdk.task.param.TaskDataSetParam$FieldType@68165de5, com.primihub.sdk.task.param.TaskDataSetParam$FieldType@1b0c72b5]}} - time:1735537354951
13:42:34.951 [INFO ] [http-nio-8090-exec-3] [com.primihub.sdk.task.factory.AbstractDataSetGRPCExecute:42] NewDatasetRequest:meta_info {
  id: "11c937ad8595-a95adc4b-464b-4f7e-833e-fe6f0da48183"
  driver: "csv"
  access_info: "/usr/zx/primihub/data/upload/1/2024123013/fabf1047-232e-4bf9-90e5-f2394bf1378a.csv"
  data_type {
    name: "id"
    type: INT32
  }
  data_type {
    name: "name"
    type: STRING
  }
  data_type {
    name: "age"
    type: INT32
  }
}

13:42:34.957 [INFO ] [http-nio-8090-exec-3] [com.primihub.sdk.task.factory.AbstractDataSetGRPCExecute:45] dataServiceGrpc Response:ret_code: FAIL
ret_msg: "file_path: /usr/zx/primihub/data/upload/1/2024123013/fabf1047-232e-4bf9-90e5-f2394bf1378a.csv is not exist"

13:42:34.957 [INFO ] [http-nio-8090-exec-3] [com.primihub.sdk.task.factory.AbstractDataSetGRPCExecute:60] end dataServiceGrpc fparam:TaskParam{requestId='7a47904c2eb945e3bf408270b0c3cb0b', taskId='null', jobId='null', isSuccess=false, isEnd=true, error='file_path: /usr/zx/primihub/data/upload/1/2024123013/fabf1047-232e-4bf9-90e5-f2394bf1378a.csv is not exist', partyCount=null, isOpenGetStatus=true, taskContentParam=DataSetTaskParam{id='11c937ad8595-a95adc4b-464b-4f7e-833e-fe6f0da48183', accessInfo='/usr/zx/primihub/data/upload/1/2024123013/fabf1047-232e-4bf9-90e5-f2394bf1378a.csv', driver='csv', visibility='null', fieldTypes=[com.primihub.sdk.task.param.TaskDataSetParam$FieldType@697cedcd, com.primihub.sdk.task.param.TaskDataSetParam$FieldType@68165de5, com.primihub.sdk.task.param.TaskDataSetParam$FieldType@1b0c72b5]}} - time:1735537354957


环境(请填写完整):

  • OS: Linux centos7
  • Arch: x86_64
  • 部署方式: 本机编译
  • PrimiHub版本: 1.7.0
  • Python版本: Python 2.7.5
@Bb91234567890 Bb91234567890 added the bug Something isn't working label Dec 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant