Qualcomm® AI Runtime (QAIRT) SDKs
v2.44.0.260225143659
QAIRT
Overview
SDKs
QNN
SNPE
Genie
Introduction
Tutorials
Setup
How to Use Genie
Source Code Examples
Genie Dialog
Llama 2 7B
QNN HTP
Android
Basic
Yes
No
SSD Q1
SPD
LADE
Windows
QNN Gen AI Transformer
QNN GPU
KV Share Dialog
Llama 3 3B
Query Cancellation
KV$ Rewind
Updating the Stop Sequence
Token Query
Updating the Sampler Parameters
Engine Sharing
Prefix Quant
Genie Embedding
Genie Engine
Genie Log
Genie Profile
Genie Pipeline
Genie Accuracy
Library
Tools
Delegates
TFLite Delegate
Qualcomm® AI Runtime (QAIRT) SDKs
»
⌂
»
Tutorials
»
Dialog Tutorials
»
Llama 2 7B
»
QNN HTP
»
Android
»
Basic Dialog
Basic Dialog
¶
Choose whether you will be using a LoRA adapter for this tutorial:
Yes
No