Qualcomm® AI Runtime (QAIRT) SDKs
v2.44.0.260225143659
QAIRT
Overview
SDKs
QNN
SNPE
Genie
Introduction
Tutorials
Setup
How to Use Genie
Source Code Examples
Genie Dialog
Llama 2 7B
QNN HTP
QNN Gen AI Transformer
Linux
Yes
No
Windows
QNN GPU
KV Share Dialog
Llama 3 3B
Query Cancellation
KV$ Rewind
Updating the Stop Sequence
Token Query
Updating the Sampler Parameters
Engine Sharing
Prefix Quant
Genie Embedding
Genie Engine
Genie Log
Genie Profile
Genie Pipeline
Genie Accuracy
Library
Tools
Delegates
TFLite Delegate
Qualcomm® AI Runtime (QAIRT) SDKs
»
⌂
»
Tutorials
»
Dialog Tutorials
»
Llama 2 7B
»
QNN Gen AI Transformer
»
Linux
Linux
¶
Choose whether you will be using a LoRA adapter for this tutorial:
Yes
No