library_name: pytorch
license: other
tags:
- android
pipeline_tag: object-detection
Conditional-DETR-ResNet50: Optimized for Qualcomm Devices
DETR is a machine learning model that can detect objects (trained on COCO dataset).
This is based on the implementation of Conditional-DETR-ResNet50 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
There are two ways to deploy this model on your device:
Option 1: Download Pre-Exported Models
Below are pre-exported model assets ready for deployment.
| Runtime | Precision | Chipset | SDK Versions | Download |
|---|---|---|---|---|
| ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | Download |
| ONNX | w8a16_mixed_fp16 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | Download |
| QNN_DLC | float | Universal | QAIRT 2.45 | Download |
| QNN_DLC | w8a16_mixed_fp16 | Universal | QAIRT 2.45 | Download |
| TFLITE | float | Universal | QAIRT 2.45 | Download |
For more device-specific assets and performance metrics, visit Conditional-DETR-ResNet50 on Qualcomm® AI Hub.
Option 2: Export with Custom Configurations
Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
This option is ideal if you need to customize the model beyond the default configuration provided here.
See our repository for Conditional-DETR-ResNet50 on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.object_detection
Model Stats:
- Input resolution: 480x480
- Model checkpoint: ResNet50
- Model size (float): 166 MB
- Number of parameters: 43.6M
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| Conditional-DETR-ResNet50 | ONNX | float | Snapdragon® X2 Elite | 9.233 ms | 5 - 5 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | float | Snapdragon® X Elite | 20.365 ms | 82 - 82 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 15.039 ms | 1 - 452 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 38.845 ms | 5 - 373 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 31.59 ms | 5 - 13 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 20.35 ms | 0 - 94 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | float | Qualcomm® QCS8450 | 38.845 ms | 5 - 373 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 29.26 ms | 5 - 12 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 20.365 ms | 82 - 82 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 11.165 ms | 3 - 320 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | float | Snapdragon® 8 Elite Mobile | 11.165 ms | 3 - 320 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 8.304 ms | 3 - 325 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | w8a16_mixed_fp16 | Snapdragon® 8 Gen 3 Mobile | 52.358 ms | 19 - 406 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | w8a16_mixed_fp16 | Qualcomm® Dragonwing™ Q-8750 | 45.732 ms | 21 - 293 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | w8a16_mixed_fp16 | Snapdragon® 8 Elite Mobile | 45.732 ms | 21 - 293 MB | NPU |
| Conditional-DETR-ResNet50 | ONNX | w8a16_mixed_fp16 | Snapdragon® 8 Elite Gen 5 Mobile | 39.679 ms | 22 - 310 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Snapdragon® X2 Elite | 10.042 ms | 5 - 5 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Snapdragon® X Elite | 23.305 ms | 5 - 5 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 17.097 ms | 0 - 400 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 44.583 ms | 4 - 347 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 33.482 ms | 5 - 12 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 98.194 ms | 1 - 307 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 22.881 ms | 5 - 7 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Qualcomm® SA8775P | 32.235 ms | 1 - 307 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Qualcomm® SA8650P | 32.235 ms | 1 - 307 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Qualcomm® SA8255P | 32.235 ms | 1 - 307 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Qualcomm® QCS8450 | 44.583 ms | 4 - 347 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 34.971 ms | 5 - 11 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 23.305 ms | 5 - 5 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 11.577 ms | 0 - 317 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Qualcomm® SA7255P | 98.194 ms | 1 - 307 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Qualcomm® SA8295P | 34.049 ms | 0 - 261 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 11.577 ms | 0 - 317 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 8.891 ms | 5 - 337 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Snapdragon® X2 Elite | 16.324 ms | 2 - 2 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Snapdragon® X Elite | 30.454 ms | 2 - 2 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Snapdragon® 8 Gen 3 Mobile | 22.467 ms | 2 - 476 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Qualcomm® Dragonwing™ IQ-8275 | 35.5 ms | 2 - 7 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Qualcomm® Dragonwing™ IQ-8275 | 90.191 ms | 0 - 369 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 30.315 ms | 2 - 282 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Qualcomm® SA8775P | 35.883 ms | 1 - 370 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Qualcomm® SA8650P | 35.883 ms | 1 - 370 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Qualcomm® SA8255P | 35.883 ms | 1 - 370 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Qualcomm® Dragonwing™ IQ-9075 | 36.14 ms | 1 - 5 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Qualcomm® Dragonwing™ IQ-X7181 | 30.454 ms | 2 - 2 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Qualcomm® Dragonwing™ Q-8750 | 17.325 ms | 2 - 375 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Qualcomm® SA7255P | 90.191 ms | 0 - 369 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Snapdragon® 8 Elite Mobile | 17.325 ms | 2 - 375 MB | NPU |
| Conditional-DETR-ResNet50 | QNN_DLC | w8a16_mixed_fp16 | Snapdragon® 8 Elite Gen 5 Mobile | 15.07 ms | 2 - 393 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 16.019 ms | 0 - 439 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 45.61 ms | 0 - 373 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 31.168 ms | 0 - 94 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 94.019 ms | 0 - 334 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 22.459 ms | 0 - 3 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Qualcomm® SA8775P | 30.263 ms | 0 - 366 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Qualcomm® SA8650P | 30.263 ms | 0 - 366 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Qualcomm® SA8255P | 30.263 ms | 0 - 366 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Qualcomm® QCS8450 | 45.61 ms | 0 - 373 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 30.551 ms | 0 - 93 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 12.308 ms | 0 - 346 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Qualcomm® SA7255P | 94.019 ms | 0 - 334 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Qualcomm® SA8295P | 35.165 ms | 0 - 289 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Snapdragon® 8 Elite Mobile | 12.308 ms | 0 - 346 MB | NPU |
| Conditional-DETR-ResNet50 | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 9.516 ms | 0 - 355 MB | NPU |
License
- The license for the original implementation of Conditional-DETR-ResNet50 can be found here.
References
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
