Skip to content

关于DP在BinFill任务上的精度复现问题 #2

Description

@ZhihaoChe

对于DP在BinFill上的精度,我在论文中看到的精度为32.00 ± 2.67,但在我下载完权重后按照Readme中的步骤进行推理后,发现在BinFill任务中的50个episode中只有一个episode是成功的,请问下是我哪里设置的问题嘛?

服务端运行命令如下:
cd /share/zhihaoche/robomme_benchmark/DP

CUDA_VISIBLE_DEVICES=0 PYTHONPATH=$(pwd) python serve_dp.py
--ckpt_path checkpoint/ckpt_200000.pth
--norm_stats_path checkpoint
--port 8011

客户端运行命令如下:
CUDA_VISIBLE_DEVICES=1 python examples/robomme/eval.py
--args.host 0.0.0.0
--args.port 8011
--args.policy_name dp_robomme
--args.model_ckpt_id 200000 \

结果如下:

"BinFill": {
"0": true,
"1": false,
"2": false,
"3": false,
"4": false,
"5": false,
"6": false,
"7": false,
"8": false,
"9": false,
"10": false,
"11": false,
"12": false,
"13": false,
"14": false,
"15": false,
"16": false,
"17": false,
"18": false,
"19": false,
"20": false,
"21": false,
"22": false,
"23": false,
"24": false,
"25": false,
"26": false,
"27": false,
"28": false,
"29": false,
"30": false,
"31": false,
"32": false,
"33": false,
"34": false,
"35": false,
"36": false,
"37": false,
"38": false,
"39": false,
"40": false,
"41": false,
"42": false,
"43": false,
"44": false,
"45": false,
"46": false,
"47": false,
"48": false,
"49": false
},

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions