计划在EASY EAI Orin Nano开发板部署QWEN大模型，然后通过部署flask服务将其web化，成为一个web聊天对话机器人，最后再对接语音识别模块，最终实现一个语音聊天机器人的目标。
看了看，硬件版本和操作系统都OK，RKNPU驱动版本为0.9.8，OK。
root@EASY-EAI-ORIN-NANO:/home/orin-nano# cat /sys/kernel/debug/rknpu/version
RKNPU driver: v0.9.8
之后按照官方的LLM模型环境搭建、AI模型转换等步骤，最终生成了通义千问大模型和部署应用。
中间在执行大模型的时候失败了：
看了下dmesg，应该是内存资源申请失败导致的，有在2G RAM版本的EASY EAI Orin Nano开发板上部署LLM的大佬吗？
[ 2233.600830] hmac_fsm_change_state_etc state 4, vap_id 3
[ 2234.622006] hmac_single_hal_device_scan_complete:vap[3] time[996] chan_cnt[13] chan_0[1] back[1] event[6] mode[2]
[ 2234.628510] hmac_fsm_change_state_etc state 0, vap_id 3
[ 2234.628987] scan: inform bss 8,other 0,vap 3
[ 2242.491509] mali 27800000.gpu: OOM notifier: dev mali0 30676 kB
[ 2242.491531] mali 27800000.gpu: OOM notifier: tsk Xorg:Xorg tgid (1509) pid (1509) 30676 kB
[ 2242.491605] rkllm-demo invoked oom-killer: gfp_mask=0x140cca(GFP_HIGHUSER_MOVABLE|__GFP_COMP), order=0, oom_score_adj=0
[ 2242.491615] CPU: 6 PID: 2506 Comm: rkllm-demo Tainted: G O 6.1.99
[ 2242.491622] Hardware name: eai orin nano 3576 (DT)
[ 2242.491626] Call trace:
[ 2242.491630] dump_backtrace+0xdc/0x130
[ 2242.491643] show_stack+0x1c/0x30
[ 2242.491649] dump_stack_lvl+0x64/0x7c
[ 2242.491656] dump_stack+0x14/0x2c
[ 2242.491660] dump_header+0x5c/0x208
[ 2242.491668] oom_kill_process+0x2dc/0x2e0
[ 2242.491676] out_of_memory+0x1dc/0x35c
[ 2242.491682] __alloc_pages+0x9bc/0xb20
[ 2242.491689] __folio_alloc+0x18/0x20
[ 2242.491695] shmem_alloc_folio+0x38/0x5c
[ 2242.491700] shmem_get_folio_gfp.constprop.0+0x3c4/0x8b0
[ 2242.491706] shmem_read_mapping_page_gfp+0x5c/0xd0
[ 2242.491712] drm_gem_get_pages+0xc8/0x270
[ 2242.491720] rknpu_gem_object_create+0x354/0x960
[ 2242.491726] rknpu_gem_create_ioctl+0xd0/0x124
[ 2242.491731] __rknpu_gem_create_ioctl+0x44/0x8c
[ 2242.491738] drm_ioctl_kernel+0xb4/0x100
[ 2242.491744] drm_ioctl+0x208/0x440
[ 2242.491750] __arm64_sys_ioctl+0xb4/0xdc
[ 2242.491757] invoke_syscall+0x4c/0x114
[ 2242.491764] el0_svc_common.constprop.0+0x54/0x180
[ 2242.491770] do_el0_svc+0x20/0x2c
[ 2242.491776] el0_svc+0x14/0x80
[ 2242.491781] el0t_64_sync_handler+0xb0/0xb4
[ 2242.491786] el0t_64_sync+0x158/0x15c
[ 2242.491792] Mem-Info:
[ 2242.491796] active_anon:287 inactive_anon:399844 isolated_anon:0
active_file:64 inactive_file:34 isolated_file:0
unevictable:55250 dirty:0 writeback:0
slab_reclaimable:9020 slab_unreclaimable:12779
mapped:5293 shmem:51248 pagetables:3080
sec_pagetables:0 bounce:0
kernel_misc_reclaimable:0
free:1867 free_pcp:0 free_cma:0
[ 2242.491807] Node 0 active_anon:1148kB inactive_anon:1599376kB active_file:256kB inactive_file:136kB unevictable:221000kB isolated(anon):0kB isolated(file):0kB mapped:21172kB dirty:0kB writeback:0kB shmem:204992kB writeback_tmp:0kB kernel_stack:5888kB pagetables:12320kB sec_pagetables:0kB all_unreclaimable? no
[ 2242.491816] DMA free:7468kB boost:14380kB min:20008kB low:21988kB high:23968kB reserved_highatomic:0KB active_anon:1148kB inactive_anon:1599376kB active_file:324kB inactive_file:0kB unevictable:220920kB writepending:0kB present:2078720kB managed:2000692kB mlocked:18264kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[ 2242.491827] lowmem_reserve[]: 0 0 0 0
[ 2242.491837] DMA: 646*4kB (UM) 110*8kB (UME) 155*16kB (UE) 46*32kB (UE) 1*64kB (E) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 7480kB
[ 2242.491865] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[ 2242.491871] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=32768kB
[ 2242.491875] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[ 2242.491880] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=64kB
[ 2242.491884] 53296 total pagecache pages
[ 2242.491888] 0 pages in swap cache
[ 2242.491892] Free swap = 0kB
[ 2242.491896] Total swap = 0kB
[ 2242.491899] 519680 pages RAM
[ 2242.491902] 0 pages HighMem/MovableOnly
[ 2242.491906] 19507 pages reserved
[ 2242.491909] 4096 pages cma reserved
[ 2242.491913] Tasks state (memory values in pages):
[ 2242.491917] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
[ 2242.491936] [ 326] 0 326 16618 959 114688 0 -250 systemd-journal
[ 2242.491944] [ 361] 0 361 6562 1281 65536 0 -1000 systemd-udevd
[ 2242.491952] [ 687] 0 687 580 32 32768 0 0 log-guardian
[ 2242.491958] [ 1001] 103 1001 2126 126 57344 0 0 rpcbind
[ 2242.491965] [ 1060] 0 1060 561 184 32768 0 0 acpid
[ 2242.491971] [ 1069] 101 1069 2306 432 49152 0 -900 dbus-daemon
[ 2242.491977] [ 1073] 0 1073 181 1 20480 0 0 input-event-dae
[ 2242.491983] [ 1076] 0 1076 2720 55 32768 0 0 irqbalance
[ 2242.491989] [ 1083] 0 1083 55531 304 69632 0 0 rsyslogd
[ 2242.491995] [ 1091] 0 1091 12608 495 77824 0 0 systemd-logind
[ 2242.492001] [ 1095] 0 1095 580 24 36864 0 0 power-key.sh
[ 2242.492007] [ 1101] 0 1101 97920 1001 118784 0 0 udisksd
[ 2242.492013] [ 1112] 0 1112 234 1 20480 0 0 inotifywait
[ 2242.492018] [ 1148] 0 1148 65930 1400 139264 0 0 NetworkManager
[ 2242.492024] [ 1152] 0 1152 4290 1515 61440 0 0 wpa_supplicant
[ 2242.492030] [ 1215] 996 1215 78427 960 98304 0 0 polkitd
[ 2242.492036] [ 1402] 0 1402 1610 164 45056 0 0 starter
[ 2242.492043] [ 1446] 0 1446 76869 651 86016 0 0 lightdm
[ 2242.492049] [ 1482] 0 1482 579 25 36864 0 0 xl2tpd
[ 2242.492055] [ 1490] 0 1490 298452 640 192512 0 0 charon
[ 2242.492061] [ 1503] 0 1503 4082 1508 73728 0 -1000 sshd
[ 2242.492066] [ 1509] 0 1509 166883 19529 679936 0 0 Xorg
[ 2242.492073] [ 1588] 0 1588 580 174 36864 0 0 start_rknn.sh
[ 2242.492079] [ 1593] 0 1593 3316 554 61440 0 0 bluetoothd
[ 2242.492085] [ 1612] 0 1612 1457 122 40960 0 0 agetty
[ 2242.492091] [ 1613] 0 1613 580 174 36864 0 0 sh
[ 2242.492097] [ 1649] 0 1649 71219 48 86016 0 0 rknn_server
[ 2242.492102] [ 1662] 0 1662 2053 729 45056 0 0 bash
[ 2242.492108] [ 1670] 0 1670 40558 660 90112 0 0 lightdm
[ 2242.492114] [ 1678] 1000 1678 4874 1116 65536 0 100 systemd
[ 2242.492120] [ 1682] 1000 1682 42554 1022 90112 0 100 (sd-pam)
[ 2242.492126] [ 1696] 1000 1696 11462 1253 90112 0 200 pipewire
[ 2242.492131] [ 1698] 1000 1698 65213 1535 131072 0 200 wireplumber
[ 2242.492137] [ 1699] 1000 1699 7192 720 77824 0 200 pipewire-pulse
[ 2242.492143] [ 1701] 1000 1701 131244 4613 507904 0 0 xfce4-session
[ 2242.492148] [ 1718] 1000 1718 2130 227 49152 0 200 dbus-launch
[ 2242.492154] [ 1723] 1000 1723 2059 240 49152 0 200 dbus-daemon
[ 2242.492160] [ 1920] 1000 1920 2131 227 49152 0 0 dbus-launch
[ 2242.492166] [ 1921] 1000 1921 2175 381 45056 0 0 dbus-daemon
[ 2242.492172] [ 1971] 1000 1971 1816 185 45056 0 0 ssh-agent
[ 2242.492177] [ 1999] 105 1999 21070 4548 73728 0 0 ntpd
[ 2242.492183] [ 2084] 1000 2084 20344 45 49152 0 200 gpg-agent
[ 2242.492189] [ 2086] 1000 2086 438449 5660 716800 0 0 xfwm4
[ 2242.492195] [ 2090] 1000 2090 59724 619 94208 0 0 gvfsd
[ 2242.492200] [ 2119] 1000 2119 72440 1953 258048 0 0 xfsettingsd
[ 2242.492206] [ 2123] 0 2123 58697 566 81920 0 0 upowerd
[ 2242.492212] [ 2128] 1000 2128 158352 3188 352256 0 0 xfce4-panel
[ 2242.492218] [ 2132] 1000 2132 100648 1803 262144 0 0 Thunar
[ 2242.492224] [ 2138] 1000 2138 163780 8160 393216 0 0 xfdesktop
[ 2242.492229] [ 2142] 1000 2142 151691 3116 348160 0 0 nm-applet
[ 2242.492235] [ 2144] 1000 2144 62562 1376 217088 0 0 xfce4-power-man
[ 2242.492241] [ 2145] 1000 2145 62166 1132 217088 0 0 polkit-gnome-au
[ 2242.492246] [ 2146] 1000 2146 158714 1803 290816 0 0 tracker-miner-f
[ 2242.492252] [ 2147] 1000 2147 81565 1891 245760 0 0 light-locker
[ 2242.492257] [ 2149] 1000 2149 127568 6386 331776 0 0 blueman-applet
[ 2242.492263] [ 2155] 1000 2155 88482 600 122880 0 0 gvfs-udisks2-vo
[ 2242.492269] [ 2171] 1000 2171 39200 207 65536 0 0 dconf-service
[ 2242.492274] [ 2177] 1000 2177 78256 319 106496 0 0 gvfsd-trash
[ 2242.492280] [ 2181] 1000 2181 146397 2461 303104 0 0 panel-6-systray
[ 2242.492286] [ 2184] 1000 2184 127215 2611 303104 0 0 panel-8-pulseau
[ 2242.492291] [ 2187] 1000 2187 40218 150 73728 0 0 gvfsd-metadata
[ 2242.492297] [ 2247] 1000 2247 102884 1989 258048 0 0 panel-14-action
[ 2242.492303] [ 2257] 1000 2257 12166 560 77824 0 0 obexd
[ 2242.492309] [ 2259] 1000 2259 86003 4425 274432 0 0 blueman-tray
[ 2242.492315] [ 2349] 0 2349 4799 1583 73728 0 0 sshd
[ 2242.492321] [ 2364] 1000 2364 4952 1202 77824 0 0 sshd
[ 2242.492326] [ 2369] 0 2369 4832 1585 73728 0 0 sshd
[ 2242.492332] [ 2372] 1000 2372 2146 808 53248 0 0 bash
[ 2242.492337] [ 2390] 1000 2390 4897 1268 73728 0 0 sshd
[ 2242.492343] [ 2392] 1000 2392 602 168 36864 0 0 sftp-server
[ 2242.492348] [ 2394] 0 2394 4831 1584 73728 0 0 sshd
[ 2242.492354] [ 2408] 1000 2408 5416 1791 77824 0 0 sshd
[ 2242.492359] [ 2410] 1000 2410 656 430 36864 0 0 sftp-server
[ 2242.492367] [ 2490] 0 2490 1352 87 40960 0 0 sleep
[ 2242.492372] [ 2506] 1000 2506 326422 320830 2654208 0 0 rkllm-demo
[ 2242.492378] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/user.slice/user-1000.slice/session-c2.scope,task=rkllm-demo,pid=2506,uid=1000
[ 2242.492410] Out of memory: Killed process 2506 (rkllm-demo) total-vm:1305688kB, anon-rss:1281116kB, file-rss:1632kB, shmem-rss:572kB, UID:1000 pgtables:2592kB oom_score_adj:0
[ 2242.494843] mali 27800000.gpu: OOM notifier: dev mali0 30676 kB
[ 2242.494857] mali 27800000.gpu: OOM notifier: tsk Xorg:Xorg tgid (1509) pid (1509) 30676 kB
[ 2242.494866] rkllm-demo: page allocation failure: order:0, mode:0x140cca(GFP_HIGHUSER_MOVABLE|__GFP_COMP), nodemask=(null),cpuset=/,mems_allowed=0
[ 2242.494883] CPU: 6 PID: 2506 Comm: rkllm-demo Tainted: G O 6.1.99
[ 2242.494889] Hardware name: eai orin nano 3576 (DT)
[ 2242.494893] Call trace:
[ 2242.494897] dump_backtrace+0xdc/0x130
[ 2242.494910] show_stack+0x1c/0x30
[ 2242.494916] dump_stack_lvl+0x64/0x7c
[ 2242.494922] dump_stack+0x14/0x2c
[ 2242.494927] warn_alloc+0x10c/0x190
[ 2242.494934] __alloc_pages+0xab4/0xb20
[ 2242.494939] __folio_alloc+0x18/0x20
[ 2242.494945] shmem_alloc_folio+0x38/0x5c
[ 2242.494951] shmem_get_folio_gfp.constprop.0+0x3c4/0x8b0
[ 2242.494956] shmem_read_mapping_page_gfp+0x5c/0xd0
[ 2242.494962] drm_gem_get_pages+0xc8/0x270
[ 2242.494969] rknpu_gem_object_create+0x354/0x960
[ 2242.494975] rknpu_gem_create_ioctl+0xd0/0x124
[ 2242.494980] __rknpu_gem_create_ioctl+0x44/0x8c
[ 2242.494987] drm_ioctl_kernel+0xb4/0x100
[ 2242.494993] drm_ioctl+0x208/0x440
[ 2242.494999] __arm64_sys_ioctl+0xb4/0xdc
[ 2242.495006] invoke_syscall+0x4c/0x114
[ 2242.495012] el0_svc_common.constprop.0+0x54/0x180
[ 2242.495018] do_el0_svc+0x20/0x2c
[ 2242.495024] el0_svc+0x14/0x80
[ 2242.495029] el0t_64_sync_handler+0xb0/0xb4
[ 2242.495034] el0t_64_sync+0x158/0x15c
[ 2242.495039] Mem-Info:
[ 2242.495044] active_anon:287 inactive_anon:399844 isolated_anon:0
active_file:89 inactive_file:76 isolated_file:0
unevictable:55414 dirty:0 writeback:0
slab_reclaimable:9020 slab_unreclaimable:12779
mapped:5293 shmem:51453 pagetables:3080
sec_pagetables:0 bounce:0
kernel_misc_reclaimable:0
free:1489 free_pcp:155 free_cma:0
[ 2242.495054] Node 0 active_anon:1148kB inactive_anon:1599376kB active_file:356kB inactive_file:304kB unevictable:221656kB isolated(anon):0kB isolated(file):0kB mapped:21172kB dirty:0kB writeback:0kB shmem:205812kB writeback_tmp:0kB kernel_stack:5888kB pagetables:12320kB sec_pagetables:0kB all_unreclaimable? no
[ 2242.495063] DMA free:5956kB boost:14380kB min:20008kB low:21988kB high:23968kB reserved_highatomic:0KB active_anon:1148kB inactive_anon:1599376kB active_file:332kB inactive_file:332kB unevictable:221664kB writepending:0kB present:2078720kB managed:2000692kB mlocked:18264kB bounce:0kB free_pcp:620kB local_pcp:248kB free_cma:0kB
[ 2242.495073] lowmem_reserve[]: 0 0 0 0
[ 2242.495083] DMA: 314*4kB (U) 101*8kB (UE) 154*16kB (UE) 45*32kB (UE) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 5968kB
[ 2242.495112] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[ 2242.495117] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=32768kB
[ 2242.495121] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[ 2242.495126] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=64kB
[ 2242.495130] 53535 total pagecache pages
[ 2242.495134] 0 pages in swap cache
[ 2242.495138] Free swap = 0kB
[ 2242.495141] Total swap = 0kB
[ 2242.495145] 519680 pages RAM
[ 2242.495148] 0 pages HighMem/MovableOnly
[ 2242.495152] 19507 pages reserved
[ 2242.495155] 4096 pages cma reserved
[ 2242.506067] RKNPU: failed to get pages: -12
orin-nano@EASY-EAI-ORIN-NANO:~$
| 
0
/9 
工商网监
湘ICP备2023018690号
1671
淘帖
