Skip to content

Evaluation of BDD100K MOTS #21

Open
@nhlben

Description

@nhlben

When I run the script for MOTS as in TEST.md with

# convert to BDD100K format (bitmask)
python3 tools_bin/to_bdd100k.py --res outputs/${EXP_NAME}/inference/instances_predictions_init_0.40_obj_0.30.pkl --task seg_track --bdd-dir . --nproc 32
# evaluate
bash tools_bin/eval_bdd_submit.sh

The evaluation obtains 0 for all metrics, so probably the file it is referring to is empty. And I check the script of tools_bin/to_bdd100k.py, seems like it does not save any file in the preds2bdd100k function. Is it as expected and I am missing something, or there is another problem?

Activity

MasterBin-IIAU

MasterBin-IIAU commented on Apr 4, 2023

@MasterBin-IIAU
Owner

@nhlben Hi, take UNINEXT with ResNet-50 backbone as an example, first you need to run python3 tools_bin/grid_search_bdd.py --config_name eval-vid/video_joint_r50_eval_mot.yaml --exp_dir_name video_joint_r50 as shown in infer.sh to obtain instances_predictions_init_0.40_obj_0.30.pkl. Then you need to run commands in the TEST.md and please replace ${EXP_NAME} . with detailed name such as video_joint_r50.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

      Development

      No branches or pull requests

        Participants

        @MasterBin-IIAU@nhlben

        Issue actions

          Evaluation of BDD100K MOTS · Issue #21 · MasterBin-IIAU/UNINEXT