weixin_39797758
weixin_39797758
2020-12-06 14:09

请教下最近的一次更新之后，训练 sbs_r101_ibn，发现会打印如下警告

是否因为修改了 non-local 模块？并且发现训练时间time稍长，占用显存稍高；


[09/10 23:16:58 fastreid.utils.checkpoint]: Loading checkpoint from /home/user/.cache/torch/checkpoints/msmt_sbs_R101-ibn.pth
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.0.g.weight' has shape (1, 512, 1, 1) in the checkpoint but (256, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.0.g.bias' has shape (1,) in the checkpoint but (256,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.0.W.0.weight' has shape (512, 1, 1, 1) in the checkpoint but (512, 256, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.0.theta.weight' has shape (1, 512, 1, 1) in the checkpoint but (256, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.0.theta.bias' has shape (1,) in the checkpoint but (256,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.0.phi.weight' has shape (1, 512, 1, 1) in the checkpoint but (256, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.0.phi.bias' has shape (1,) in the checkpoint but (256,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.1.g.weight' has shape (1, 512, 1, 1) in the checkpoint but (256, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.1.g.bias' has shape (1,) in the checkpoint but (256,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.1.W.0.weight' has shape (512, 1, 1, 1) in the checkpoint but (512, 256, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.1.theta.weight' has shape (1, 512, 1, 1) in the checkpoint but (256, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.1.theta.bias' has shape (1,) in the checkpoint but (256,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.1.phi.weight' has shape (1, 512, 1, 1) in the checkpoint but (256, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_2.1.phi.bias' has shape (1,) in the checkpoint but (256,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.0.g.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.0.g.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.0.W.0.weight' has shape (1024, 1, 1, 1) in the checkpoint but (1024, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.0.theta.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.0.theta.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.0.phi.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.0.phi.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.1.g.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.1.g.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.1.W.0.weight' has shape (1024, 1, 1, 1) in the checkpoint but (1024, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.1.theta.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.1.theta.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.1.phi.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.1.phi.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.2.g.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.2.g.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.2.W.0.weight' has shape (1024, 1, 1, 1) in the checkpoint but (1024, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.2.theta.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.2.theta.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.2.phi.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.2.phi.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.3.g.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.3.g.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.3.W.0.weight' has shape (1024, 1, 1, 1) in the checkpoint but (1024, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.3.theta.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.3.theta.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.3.phi.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.3.phi.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.4.g.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.4.g.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.4.W.0.weight' has shape (1024, 1, 1, 1) in the checkpoint but (1024, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.4.theta.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.4.theta.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.4.phi.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.4.phi.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.5.g.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.5.g.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.5.W.0.weight' has shape (1024, 1, 1, 1) in the checkpoint but (1024, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.5.theta.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.5.theta.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.5.phi.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.5.phi.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.6.g.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.6.g.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.6.W.0.weight' has shape (1024, 1, 1, 1) in the checkpoint but (1024, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.6.theta.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.6.theta.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.6.phi.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.6.phi.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.7.g.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.7.g.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.7.W.0.weight' has shape (1024, 1, 1, 1) in the checkpoint but (1024, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.7.theta.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.7.theta.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.7.phi.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.7.phi.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.8.g.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.8.g.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.8.W.0.weight' has shape (1024, 1, 1, 1) in the checkpoint but (1024, 512, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.8.theta.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.8.theta.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.8.phi.weight' has shape (1, 1024, 1, 1) in the checkpoint but (512, 1024, 1, 1) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.backbone.NL_3.8.phi.bias' has shape (1,) in the checkpoint but (512,) in the model! Skipped.
WARNING [09/10 23:16:58 fastreid.utils.checkpoint]: 'module.heads.classifier.weight' has shape (1041, 2048) in the checkpoint but (15506, 2048) in the model! Skipped.

该提问来源于开源项目：JDAI-CV/fast-reid

  • 点赞
  • 写回答
  • 关注问题
  • 收藏
  • 复制链接分享
  • 邀请回答

4条回答

  • weixin_39830313 weixin_39830313 4月前

    因为 fix 了一个小 bug，具体如下 https://github.com/mangye16/ReID-Survey/issues/7 所以导致 non-local 部分参数有变动，所有出现 pre-train model 无法 load 进去的问题。

    点赞 评论 复制链接分享
  • weixin_39797758 weixin_39797758 4月前

    因为 fix 了一个小 bug，具体如下 mangye16/ReID-Survey#7 所以导致 non-local 部分参数有变动，所有出现 pre-train model 无法 load 进去的问题。

    感谢！另外请教下 sbs 设置 NUM_INSTANCE: 16 是和数据集有关么？我改成4之后在验证集上经常会越跑越差

    点赞 评论 复制链接分享
  • weixin_39830313 weixin_39830313 4月前

    这个和 circle loss 有关

    点赞 评论 复制链接分享
  • weixin_39722759 weixin_39722759 4月前

    请问msmt数据集是在哪儿下的呢？

    点赞 评论 复制链接分享
提交

为你推荐