unable to visualize keypoints

[schleptech]

If you do not know the root cause of the problem, please post according to this template:

Instructions To Reproduce the Issue:

Followed steps to run train on custom keypoint detector

1. Full runnable code or full changes you made:

# import some common detectron2 utilities
from detectron2 import model_zoo
from detectron2.engine import DefaultPredictor
from detectron2.config import get_cfg
from detectron2.utils.visualizer import Visualizer
from detectron2.data import MetadataCatalog, DatasetCatalog
from detectron2.structures import BoxMode

#We are using the pre-trained Detectron2 model, as shown below.
cfg = get_cfg()
cfg.MODEL.DEVICE = "cpu"

# load the pre trained model from Detectron2 model zoo
cfg.MODEL.WEIGHTS = os.path.join(cfg.OUTPUT_DIR, "/content/output/model_final.pth")  # path to the model we just trained

cfg.MODEL.ROI_HEADS.SCORE_THRESH_TEST = 0.1 # set a custom testing threshold


def cv2_imshow(im):
    im = cv2.cvtColor(im, cv2.COLOR_BGR2RGB)
    plt.figure(figsize=(25,7.5)), plt.imshow(im), plt.axis('off');


predictor = DefaultPredictor(cfg)
#im = cv2.imread("waving.jpg")
#im = cv2.imread("test.jpeg")
im = cv2.imread("/content/arm_train/frame_0007.jpeg")
outputs = predictor(im)
print(outputs)
o = outputs["instances"]
print("###########################################################")



idxofClass = [i for i, x in enumerate(list(outputs['instances'].pred_classes)) if x == 15]

#Create new class, boxes, scores & masks
classes = o.pred_classes[idxofClass]
scores = o.scores[idxofClass]
boxes = o.pred_boxes[idxofClass]
#masks = o.pred_masks[idxofClass]

#Define new instance and set the new values to new instance. Note: detectron2 module provides this method set.
obj = detectron2.structures.Instances(image_size=(480, 640))

obj.set('pred_classes', classes)
obj.set('scores', scores)
obj.set('pred_boxes', boxes)
#obj.set('pred_masks', masks)

out = v.draw_instance_predictions(obj.to("cpu"))

then run

v = Visualizer(im[:, :, ::-1],
                   metadata=hands_metadata, 
                   scale=0.8, 
                   #instance_mode=ColorMode.IMAGE_BW   # remove the colors of unsegmented pixels
    )
v = v.draw_instance_predictions(outputs["instances"].to("cpu"))
plt.figure(figsize = (14, 10))
plt.imshow(cv2.cvtColor(v.get_image()[:, :, ::-1], cv2.COLOR_BGR2RGB))
plt.show()

response:

IndexError                                Traceback (most recent call last)
[<ipython-input-18-36eb5cc131f0>](https://localhost:8080/#) in <module>()
      4                    #instance_mode=ColorMode.IMAGE_BW   # remove the colors of unsegmented pixels
      5     )
----> 6 v = v.draw_instance_predictions(outputs["instances"].to("cpu"))
      7 plt.figure(figsize = (14, 10))
      8 plt.imshow(cv2.cvtColor(v.get_image()[:, :, ::-1], cv2.COLOR_BGR2RGB))

2 frames
[/usr/local/lib/python3.7/dist-packages/detectron2/utils/visualizer.py](https://localhost:8080/#) in draw_instance_predictions(self, predictions)
    396         scores = predictions.scores if predictions.has("scores") else None
    397         classes = predictions.pred_classes.tolist() if predictions.has("pred_classes") else None
--> 398         labels = _create_text_labels(classes, scores, self.metadata.get("thing_classes", None))
    399         keypoints = predictions.pred_keypoints if predictions.has("pred_keypoints") else None
    400 

[/usr/local/lib/python3.7/dist-packages/detectron2/utils/visualizer.py](https://localhost:8080/#) in _create_text_labels(classes, scores, class_names, is_crowd)
    242     if classes is not None:
    243         if class_names is not None and len(class_names) > 0:
--> 244             labels = [class_names[i] for i in classes]
    245         else:
    246             labels = [str(i) for i in classes]

[/usr/local/lib/python3.7/dist-packages/detectron2/utils/visualizer.py](https://localhost:8080/#) in <listcomp>(.0)
    242     if classes is not None:
    243         if class_names is not None and len(class_names) > 0:
--> 244             labels = [class_names[i] for i in classes]
    245         else:
    246             labels = [str(i) for i in classes]

IndexError: list index out of range

Expected behavior:

We expect to output keypoints onto image from testing batch.... it appears to be finding something but I cannot see from visualizer.

Environment:

PyTorch debug build     False
GPU available           Yes
GPU 0                   Tesla P100-PCIE-16GB (arch=6.0)
Driver version          460.32.03
CUDA_HOME               /usr/local/cuda
Pillow                  7.1.2
torchvision             0.11.1+cu111 @/usr/local/lib/python3.7/dist-packages/torchvision
torchvision arch flags  3.5, 5.0, 6.0, 7.0, 7.5, 8.0, 8.6
fvcore                  0.1.5.post20220212
iopath                  0.1.9
cv2                     4.1.2
----------------------  ----------------------------------------------------------------
PyTorch built with:
  - GCC 7.3
  - C++ Version: 201402
  - Intel(R) Math Kernel Library Version 2020.0.0 Product Build 20191122 for Intel(R) 64 architecture applications
  - Intel(R) MKL-DNN v2.2.3 (Git Hash 7336ca9f055cf1bfa13efb658fe15dc9b41f0740)
  - OpenMP 201511 (a.k.a. OpenMP 4.5)
  - LAPACK is enabled (usually provided by MKL)
  - NNPACK is enabled
  - CPU capability usage: AVX2
  - CUDA Runtime 11.1
  - NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_86,code=sm_86
  - CuDNN 8.0.5
  - Magma 2.5.2
  - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=11.1, CUDNN_VERSION=8.0.5, CXX_COMPILER=/opt/rh/devtoolset-7/root/usr/bin/c++, CXX_FLAGS= -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=1.10.0, USE_CUDA=ON, USE_CUDNN=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, 

[akzenith]

Did you find any solution? I'm stuck here too!

[AdnanMunir294]

I am also stuck please if anyone have solution tell me thanks

[lelelelelelelelelelelelele]

stuck also