应用源码编译使用说明

这篇文档主要介绍如何编译应用源码并使用。

注意
  1. 只支持本地编译
  2. 只支持opencv4

安装OpenCV4到VIM3

1
$ sudo apt install libopencv-dev python3-opencv

获取仓库源码

源码仓库存储在github，仓库地址为:https://github.com/khadas/aml_npu_app

1
2
$ cd {workspace}
$ git clone --recursive https://github.com/khadas/aml_npu_app

仓库源码说明

结构说明

1
2
3
$ cd {workspace}/aml_npu_app
$ ls
DDK_6.3.3.4  DDK_6.4.0.3  DDK_6.4.3  detect_library  LICENSE  NN_SLT
  • DDK_xxx - 不同版本的库源码
  • detect_library - 应用层源码. detect_library/model_code则指向了最新的版本的DDK
  • NN_SLT - DnCnn模型的单独源码目录(不再维护)
  • LICENSE - LICENSE文件

库说明

进入库源码的目录，也就是DDK的目录。

1
2
3
$ cd {workspace}/aml_npu_app/detect_library/model_code
$ ls
detect_mtcnn  detect_yoloface  detect_yolo_v2  detect_yolo_v3  detect_yolo_v3_tiny  detect_yolo_v4  facenet

除了detect_mtcnn以外每一个目录都代表了一个不同的模型，每一个模型在编译时都会被编译成一个库。

  • detect_yoloface - yoloface模型，用于检测人脸
  • detect_yolo_v2 - yolov2模型，用于物体检测
  • detect_yolo_v3 - yolov3模型，用于物体检测
  • detect_yolo_v3_tiny - yolov3-tiny模型，用于物体检测
  • detect_yolo_v4 - yolov4模型，用于物体检测

这里以detect_yolo_v3为例，说明每个目录的结构

1
2
3
$ cd {workspace}/aml_npu_app/detect_library/model_code/detect_yolo_v3
$ ls
build_vx.sh  include  Makefile  makefile.linux  vnn_yolov3.c  yolo_v3.c  yolov3_process.c

主要内容说明:

  • build_vx.sh - 编译脚本
  • include - 相应的头文件以及所有的定义都会放置在这个目录下
  • Makefile - Makefile文件
  • makefile.linux - Make时的环境配置文件
  • vnn_yolov3.c - SDK转换出来的模型处理文件,主要使用到其中与nb文件对接的接口
  • yolo_v3.c - 指定调用的nb文件,同时定义了模型的调用的所有接口
  • yolov3_process.c - 主要定义了模型的前处理和后处理

应用层说明

进入应用层源码目录

1
2
3
$ cd {workspace}/aml_npu_app/detect_library
$ ls
model_code  sample_demo_fb  sample_demo_x11  source_code  yolo_demo_gst_uvc_fb  yolo_demo_mipi_fb  yolo_demo_x11

除了model_code指向最新的DDK以外,其他的目录,每一个都会编译出一个上层应用的demo

  • source_code - 编译出libnn_detect.so.作为桥梁,衔接不同的库和不同的应用demo
  • sample_demo_fb - 编译出aml_npu_demo_binaries仓库的detect_demo_fb,用于framebuffer下的图片识别
  • sample_demo_x11 - 编译出aml_npu_demo_binaries仓库的detect_demo_x11,用于X11下的图片识别
  • yolo_demo_fb_usb - 编译出aml_npu_demo_binaries仓库的detect_demo_fb_usb,用于framebuffer下的USB摄像头的动态识别
  • yolo_demo_fb_mipi - 编译出aml_npu_demo_binaries仓库的detect_demo_fb_mipi,用于framebuffer下的mipi摄像头动态识别
  • yolo_demo_x11_usb - 编译出aml_npu_demo_binaries仓库的detect_demo_x11_usb,用于X11下的usb摄像头动态识别

这里以sample_demo_x11为例

1
2
3
$ cd {workspace}/aml_npu_app/detect_library/sample_demo_x11
$ ls
1080p.bmp  build_vx.sh  detect.h  emb.db  main.cpp  makefile.linux  nn_detect_common.h  nn_detect.h  nn_detect_utils.h  ReadMe.txt  result

这里对主要的文件做说明

  • build_vx.sh - 编译脚本
  • makefile.linux - 编译脚本在编译时需要指定的makefile.linux文件
  • main.cpp - 环境下的应用demo的主要源码.
  • xxx.h - 应用层需要使用到的定义相关的头文件

编译仓库源码

编译库

编译库，只要进入到相应的库的目录编译即可。这里以yolov3为例

1
2
3
4
5
6
7
8
9
10
11
12
13
$ cd {workspace}/aml_npu_app/detect_library/model_code/detect_yolo_v3
$ ./build_vx.sh 
  COMPILE /home/khadas/aml_npu_app/DDK_6.3.3.4/detect_library/model_code/detect_yolo_v3/yolov3_process.c
  COMPILE /home/khadas/aml_npu_app/DDK_6.3.3.4/detect_library/model_code/detect_yolo_v3/vnn_yolov3.c
vnn_yolov3.c: In function ‘vnn_CreateYolov3’:
vnn_yolov3.c:145:29: warning: unused variable ‘data’ [-Wunused-variable]
  145 |     uint8_t *               data;
      |                             ^~~~
At top level:
vnn_yolov3.c:94:17: warning: ‘load_data’ defined but not used [-Wunused-function]
   94 | static uint8_t* load_data
      |                 ^~~~~~~~~
  COMPILE /home/khadas/aml_npu_app/DDK_6.3.3.4/detect_library/model_code/detect_yolo_v3/yolo_v3.c

在输出目录bin_r下就能看到生成的库

1
2
3
$ cd {workspace}/aml_npu_app/detect_library/model_code/detect_yolo_v3/bin_r
$ ls
libnn_yolo_v3.so  vnn_yolov3.o  yolo_v3.o  yolov3_process.o

编译应用

编译应用时，要先编译libnn_detect.so。这是编译其他应用的依赖库之一.

编译libnn_detect.so

进入source_code目录，编译libnn_detect.so

1
2
3
4
5
6
$ cd {workspace}/aml_npu_app/detect_library/source_code
$ ./build_vx.sh
  COMPILE /home/khadas/aml_npu_app/detect_library/source_code/detect.c
  COMPILE /home/khadas/aml_npu_app/detect_library/source_code/detect_log.c
tee: /linux_build_sample.log: Permission denied
make: Nothing to be done for 'all'.

在bin_r目录下，就会生成libnn_detect.so

1
2
3
$ cd {workspace}/aml_npu_app/detect_library/source_code/bin_r
$ ls
detect_log.o  detect.o  libnn_detect.so

编译应用Demo

这里以sample_demo_x11为例，

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
./build_vx.sh
  COMPILE /home/khadas/aml_npu_app/detect_library/sample_demo_x11/main.cpp
main.cpp: In function ‘int run_detect_model(int, char**)’:
main.cpp:321:10: warning: converting to non-pointer type ‘int’ from NULL [-Wconversion-null]
  321 |   return NULL;
      |          ^~~~
main.cpp:261:39: warning: unused variable ‘img_width’ [-Wunused-variable]
  261 |  int nn_height, nn_width, nn_channel, img_width, img_height;
      |                                       ^~~~~~~~~
main.cpp:261:50: warning: unused variable ‘img_height’ [-Wunused-variable]
  261 |  int nn_height, nn_width, nn_channel, img_width, img_height;
      |                                                  ^~~~~~~~~~
main.cpp: In function ‘int run_detect_facent(int, char**)’:
main.cpp:413:10: warning: converting to non-pointer type ‘int’ from NULL [-Wconversion-null]
  413 |   return NULL;
      |          ^~~~
main.cpp:366:39: warning: unused variable ‘img_width’ [-Wunused-variable]
  366 |  int nn_height, nn_width, nn_channel, img_width, img_height;
      |                                       ^~~~~~~~~
main.cpp:366:50: warning: unused variable ‘img_height’ [-Wunused-variable]
  366 |  int nn_height, nn_width, nn_channel, img_width, img_height;
      |                                                  ^~~~~~~~~~
main.cpp: In function ‘int init_fb()’:
main.cpp:539:11: warning: unused variable ‘i’ [-Wunused-variable]
  539 |  long int i;
      |           ^
main.cpp: At global scope:
main.cpp:537:12: warning: ‘int init_fb()’ defined but not used [-Wunused-function]
  537 | static int init_fb(void)
      |            ^~~~~~~
tee: /linux_build_sample.log: Permission denied
make: Nothing to be done for 'all'.

生成的detect_demo文件就是我们需要的文件，

1
2
$ ls bin_r_cv4/
detect_demo_x11  main.o