software-mansion/react-native-executorch-qwen-3

qwen-3

This repository hosts the qwen-3 models exported for the React Native ExecuTorch library as ExecuTorch .pte programs, ready to run on device.

Variants

Path	Backend	Precision
0_6b/mlx/qwen_3_0_6b_mlx_int4.pte	mlx	4w
0_6b/xnnpack/qwen_3_0_6b_xnnpack_bf16.pte	xnnpack	bf16
0_6b/xnnpack/qwen_3_0_6b_xnnpack_8da4w.pte	xnnpack	8da4w
1_7b/mlx/qwen_3_1_7b_mlx_int4.pte	mlx	4w
1_7b/xnnpack/qwen_3_1_7b_xnnpack_bf16.pte	xnnpack	bf16
1_7b/xnnpack/qwen_3_1_7b_xnnpack_8da4w.pte	xnnpack	8da4w
4b/mlx/qwen_3_4b_mlx_int4.pte	mlx	4w
4b/xnnpack/qwen_3_4b_xnnpack_bf16.pte	xnnpack	bf16
4b/xnnpack/qwen_3_4b_xnnpack_8da4w.pte	xnnpack	8da4w

Repository structure

0_6b/mlx/config.json                        1.3 kB
0_6b/mlx/qwen_3_0_6b_mlx_int4.pte           599 MB
0_6b/xnnpack/config.json                    2.3 kB
0_6b/xnnpack/qwen_3_0_6b_xnnpack_8da4w.pte  482 MB
0_6b/xnnpack/qwen_3_0_6b_xnnpack_bf16.pte   1.1 GB
1_7b/mlx/config.json                        1.3 kB
1_7b/mlx/qwen_3_1_7b_mlx_int4.pte           1.4 GB
1_7b/xnnpack/config.json                    2.3 kB
1_7b/xnnpack/qwen_3_1_7b_xnnpack_8da4w.pte  1.2 GB
1_7b/xnnpack/qwen_3_1_7b_xnnpack_bf16.pte   3.2 GB
4b/mlx/config.json                          1.3 kB
4b/mlx/qwen_3_4b_mlx_int4.pte               2.7 GB
4b/xnnpack/config.json                      2.3 kB
4b/xnnpack/qwen_3_4b_xnnpack_8da4w.pte      2.5 GB
4b/xnnpack/qwen_3_4b_xnnpack_bf16.pte       7.5 GB
config.json                                 28 B
tokenizer.json                              10.9 MB
tokenizer_config.json                       7.8 kB

Compatibility

These files are published for the ExecuTorch v1.4.1 runtime. ExecuTorch gives no forward compatibility guarantee, so an older runtime may fail to load them.

To use them in React Native ExecuTorch, pass the model constant shipped in the library's model registry to the corresponding task pipeline. See the documentation.

To load these files in your own ExecuTorch runtime, read the compatibility note first.