EdgeTAM: Optimized for Qualcomm Devices
EdgeTAM is a lightweight and efficient version of SAM 2, optimized for on-device tracking and segmenting any object in videos and low memory usage by using a novel 2D Spatial Perceiver and RepViT backbone.
This is based on the implementation of EdgeTAM found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
There are two ways to deploy this model on your device:
Option 1: Download Pre-Exported Models
Below are pre-exported model assets ready for deployment.
| Runtime | Precision | Chipset | SDK Versions | Download |
|---|---|---|---|---|
| ONNX | float | Universal | QAIRT 2.50, ONNX Runtime 1.27.1 | Download |
| ONNX | w8a8 | Universal | QAIRT 2.50, ONNX Runtime 1.27.1 | Download |
| QNN_DLC | float | Universal | QAIRT 2.50 | Download |
| QNN_DLC | w8a8 | Universal | QAIRT 2.50 | Download |
| TFLITE | float | Universal | QAIRT 2.50 | Download |
| TFLITE | w8a8 | Universal | QAIRT 2.50 | Download |
For more device-specific assets and performance metrics, visit EdgeTAM on Qualcomm® AI Hub.
Option 2: Export with Custom Configurations
Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
This option is ideal if you need to customize the model beyond the default configuration provided here.
See our repository for EdgeTAM on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.semantic_segmentation
Model Stats:
- Input resolution (Encoder): 1024x1024
- Model checkpoint: edgetam.pt
- Model size (encoder) (float): 33 MB
- Model size (memory_encoder) (float): 4.6 MB
- Model size (video_decoder) (float): 23.7 MB
- Number of parameters (encoder): 8.3M
- Number of parameters (memory_encoder): 1.2M
- Number of parameters (video_decoder): 6.22M
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 7.88 ms | 44 - 357 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 9.405 ms | 44 - 290 MB | NPU |
| encoder | ONNX | float | Snapdragon® X2 Elite | 8.615 ms | 70 - 70 MB | NPU |
| encoder | ONNX | float | Snapdragon® X Elite | 19.135 ms | 70 - 70 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 13.023 ms | 56 - 406 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 83.04 ms | 34 - 421 MB | NPU |
| encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 22.884 ms | 12 - 28 MB | NPU |
| encoder | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 19.466 ms | 40 - 57 MB | NPU |
| encoder | ONNX | float | Qualcomm® QCS8450 | 83.04 ms | 34 - 421 MB | NPU |
| encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 22.92 ms | 12 - 27 MB | NPU |
| encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 19.135 ms | 70 - 70 MB | NPU |
| encoder | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 9.405 ms | 44 - 290 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 3.039 ms | 2 - 267 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 3.581 ms | 12 - 262 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 3.116 ms | 18 - 18 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® X Elite | 7.887 ms | 18 - 18 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 4.994 ms | 14 - 302 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2001.044 ms | 9 - 314 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 2739.339 ms | 3 - 6 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 7.232 ms | 12 - 16 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.559 ms | 10 - 16 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® QCS8450 | 2001.044 ms | 9 - 314 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 8.149 ms | 13 - 16 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 7.887 ms | 18 - 18 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 79.008 ms | 5 - 246 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 8.722 ms | 15 - 259 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 3.581 ms | 12 - 262 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 8.722 ms | 15 - 259 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 8.076 ms | 11 - 286 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 10.92 ms | 12 - 269 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® X2 Elite | 9.809 ms | 12 - 12 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® X Elite | 22.696 ms | 12 - 12 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 16.042 ms | 0 - 318 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 90.779 ms | 12 - 393 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 26.206 ms | 12 - 47 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 21.935 ms | 12 - 15 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA8650P | 27.47 ms | 0 - 258 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA8255P | 27.47 ms | 0 - 258 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® QCS8450 | 90.779 ms | 12 - 393 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 27.896 ms | 12 - 46 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 22.696 ms | 12 - 12 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 10.92 ms | 12 - 269 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA8295P | 56.244 ms | 0 - 307 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 3.728 ms | 3 - 256 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 4.478 ms | 3 - 240 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 4.217 ms | 3 - 3 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 11.239 ms | 3 - 3 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 7.053 ms | 3 - 289 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1983.198 ms | 3 - 312 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 2794.813 ms | 2 - 12 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 9.957 ms | 3 - 14 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.536 ms | 3 - 5 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 11.298 ms | 3 - 246 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8650P | 11.298 ms | 3 - 246 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8255P | 11.298 ms | 3 - 246 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 1983.198 ms | 3 - 312 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 11.023 ms | 3 - 13 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 11.239 ms | 3 - 3 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 93.469 ms | 5 - 228 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.478 ms | 3 - 240 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2166.335 ms | 1 - 268 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 8.119 ms | 20 - 296 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 10.939 ms | 19 - 283 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 15.862 ms | 18 - 345 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 90.659 ms | 20 - 409 MB | NPU |
| encoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 26.254 ms | 0 - 47 MB | NPU |
| encoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 22.139 ms | 20 - 22 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA8650P | 27.574 ms | 20 - 285 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA8255P | 27.574 ms | 20 - 285 MB | NPU |
| encoder | TFLITE | float | Qualcomm® QCS8450 | 90.659 ms | 20 - 409 MB | NPU |
| encoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 27.126 ms | 18 - 64 MB | NPU |
| encoder | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 10.939 ms | 19 - 283 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA8295P | 56.227 ms | 20 - 339 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 2.623 ms | 0 - 249 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 3.041 ms | 4 - 240 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 4.513 ms | 5 - 295 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2020.396 ms | 1 - 311 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 2811.167 ms | 0 - 24 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 6.608 ms | 5 - 23 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 6.715 ms | 5 - 8 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 2020.396 ms | 1 - 311 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 7.31 ms | 4 - 21 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 91.399 ms | 4 - 224 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 8.271 ms | 4 - 246 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 3.041 ms | 4 - 240 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 2174.555 ms | 0 - 266 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 8.271 ms | 4 - 246 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 11.379 ms | 1 - 253 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 10.692 ms | 0 - 251 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® X2 Elite | 11.722 ms | 9 - 9 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® X Elite | 23.74 ms | 8 - 8 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 13.678 ms | 8 - 296 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 25.89 ms | 8 - 284 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 24.183 ms | 8 - 12 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 23.882 ms | 7 - 11 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® QCS8450 | 25.89 ms | 8 - 284 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 26.583 ms | 8 - 11 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 23.74 ms | 8 - 8 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 10.692 ms | 0 - 251 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 2.568 ms | 0 - 264 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 2.724 ms | 0 - 267 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 2.754 ms | 2 - 2 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® X Elite | 5.896 ms | 1 - 1 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 3.686 ms | 2 - 178 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 6.706 ms | 2 - 293 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 23.841 ms | 2 - 5 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 5.221 ms | 2 - 6 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 5.534 ms | 2 - 5 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® QCS8450 | 6.706 ms | 2 - 293 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 5.914 ms | 2 - 5 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 5.896 ms | 1 - 1 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 30.708 ms | 2 - 290 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 9.976 ms | 2 - 263 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 2.724 ms | 0 - 267 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 9.976 ms | 2 - 263 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 8.17 ms | 4 - 250 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 10.206 ms | 3 - 267 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® X2 Elite | 9.12 ms | 8 - 8 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® X Elite | 23.956 ms | 8 - 8 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 17.083 ms | 3 - 305 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 26.002 ms | 4 - 280 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 24.137 ms | 8 - 19 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 24.043 ms | 8 - 10 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA8650P | 20.933 ms | 0 - 322 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA8255P | 20.933 ms | 0 - 322 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® QCS8450 | 26.002 ms | 4 - 280 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 20.622 ms | 8 - 18 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 23.956 ms | 8 - 8 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 10.206 ms | 3 - 267 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA8295P | 25.079 ms | 0 - 240 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 2.794 ms | 1 - 144 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 2.944 ms | 1 - 138 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 3.293 ms | 2 - 2 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 6.498 ms | 2 - 2 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 3.921 ms | 0 - 164 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 7.163 ms | 0 - 172 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 24.449 ms | 1 - 5 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 5.445 ms | 1 - 6 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 5.856 ms | 2 - 4 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 6.472 ms | 2 - 139 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8650P | 6.472 ms | 2 - 139 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8255P | 6.472 ms | 2 - 139 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 7.163 ms | 0 - 172 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 6.246 ms | 1 - 5 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 6.498 ms | 2 - 2 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 29.315 ms | 2 - 297 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 2.944 ms | 1 - 138 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 7.623 ms | 2 - 143 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 11.323 ms | 0 - 268 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 10.855 ms | 0 - 262 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 17.611 ms | 0 - 298 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 25.635 ms | 0 - 276 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 24.492 ms | 0 - 18 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 23.641 ms | 0 - 3 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA8650P | 28.699 ms | 0 - 312 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA8255P | 28.699 ms | 0 - 312 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® QCS8450 | 25.635 ms | 0 - 276 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 22.591 ms | 0 - 17 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 10.855 ms | 0 - 262 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA8295P | 26.181 ms | 0 - 239 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 3.825 ms | 1 - 254 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 4.41 ms | 1 - 243 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 5.866 ms | 0 - 275 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 10.441 ms | 1 - 273 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 104.254 ms | 10 - 52 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 8.43 ms | 1 - 11 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 8.234 ms | 1 - 3 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 10.441 ms | 1 - 273 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 9.069 ms | 1 - 10 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 69.432 ms | 10 - 217 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 32.124 ms | 10 - 222 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.41 ms | 1 - 243 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 11.322 ms | 1 - 247 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 32.124 ms | 10 - 222 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 3.394 ms | 3 - 240 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 4.1 ms | 1 - 222 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® X2 Elite | 3.557 ms | 16 - 16 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® X Elite | 7.15 ms | 16 - 16 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 5.179 ms | 17 - 270 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 9.975 ms | 17 - 289 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 7.849 ms | 16 - 20 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.098 ms | 16 - 126 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® QCS8450 | 9.975 ms | 17 - 289 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 8.201 ms | 16 - 19 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 7.15 ms | 16 - 16 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 4.1 ms | 1 - 222 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 1.676 ms | 0 - 141 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 1.958 ms | 0 - 122 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® X2 Elite | 1.771 ms | 4 - 4 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® X Elite | 3.71 ms | 4 - 4 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 2.418 ms | 0 - 154 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 4.257 ms | 4 - 151 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 12.111 ms | 5 - 8 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 3.711 ms | 4 - 8 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 3.555 ms | 2 - 8 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® QCS8450 | 4.257 ms | 4 - 151 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 4.161 ms | 4 - 7 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 3.71 ms | 4 - 4 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 18.369 ms | 2 - 233 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 4.732 ms | 4 - 238 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.958 ms | 0 - 122 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 4.732 ms | 4 - 238 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 2.661 ms | 3 - 197 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 3.085 ms | 4 - 193 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® X2 Elite | 3.248 ms | 16 - 16 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® X Elite | 6.242 ms | 16 - 16 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 4.258 ms | 3 - 215 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 8.068 ms | 4 - 216 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 6.654 ms | 16 - 35 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 5.794 ms | 16 - 18 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA8650P | 7.091 ms | 16 - 233 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA8255P | 7.091 ms | 16 - 233 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® QCS8450 | 8.068 ms | 4 - 216 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 6.893 ms | 16 - 34 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 6.242 ms | 16 - 16 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 3.085 ms | 4 - 193 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA8295P | 8.632 ms | 2 - 190 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 1.189 ms | 1 - 114 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 1.371 ms | 1 - 89 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 1.599 ms | 4 - 4 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 3.028 ms | 4 - 4 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.773 ms | 0 - 111 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 3.172 ms | 0 - 115 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 7.996 ms | 1 - 7 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 2.793 ms | 1 - 8 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.675 ms | 4 - 6 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 3.34 ms | 4 - 95 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8650P | 3.34 ms | 4 - 95 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8255P | 3.34 ms | 4 - 95 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 3.172 ms | 0 - 115 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 3.191 ms | 6 - 12 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 3.028 ms | 4 - 4 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 12.203 ms | 4 - 205 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.371 ms | 1 - 89 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 3.667 ms | 4 - 92 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 2.65 ms | 0 - 190 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 3.125 ms | 0 - 191 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 4.112 ms | 0 - 218 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 8.072 ms | 0 - 214 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 6.604 ms | 0 - 32 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 5.852 ms | 0 - 8 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA8650P | 7.104 ms | 0 - 194 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA8255P | 7.104 ms | 0 - 194 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® QCS8450 | 8.072 ms | 0 - 214 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 6.874 ms | 0 - 31 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 3.125 ms | 0 - 191 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA8295P | 8.713 ms | 0 - 192 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 2.335 ms | 0 - 302 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 3.982 ms | 0 - 204 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 6.229 ms | 0 - 233 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 9.933 ms | 0 - 231 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 33.579 ms | 12 - 59 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 8.447 ms | 0 - 15 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 8.49 ms | 0 - 22 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 9.933 ms | 0 - 231 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 9.7 ms | 0 - 15 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 33.926 ms | 12 - 191 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 15.027 ms | 12 - 202 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 3.982 ms | 0 - 204 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8295P | 10.888 ms | 0 - 205 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 15.027 ms | 12 - 202 MB | NPU |
License
- The license for the original implementation of EdgeTAM can be found here.
References
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
