L4T Multimedia API Reference

32.1 Release

 All Data Structures Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Groups Pages
multimedia_api/ll_samples/docs/SAMPLES_INDEX.md
Go to the documentation of this file.
1 /*
2  * Copyright (c) 2017, NVIDIA CORPORATION. All rights reserved.
3  *
4  * Redistribution and use in source and binary forms, with or without
5  * modification, are permitted provided that the following conditions
6  * are met:
7  * * Redistributions of source code must retain the above copyright
8  * notice, this list of conditions and the following disclaimer.
9  * * Redistributions in binary form must reproduce the above copyright
10  * notice, this list of conditions and the following disclaimer in the
11  * documentation and/or other materials provided with the distribution.
12  * * Neither the name of NVIDIA CORPORATION nor the names of its
13  * contributors may be used to endorse or promote products derived
14  * from this software without specific prior written permission.
15  *
16  * THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
17  * EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
18  * IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
19  * PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
20  * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
21  * EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
22  * PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
23  * PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
24  * OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
25  * (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
26  * OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
27  */
28 
29 @page l4t_mm_test_group Multimedia API Sample Applications
30 
31 This toolkit includes NVIDIA Multimedia API sample applications that
32 you can use as building blocks to construct applications for
33 your product use case, such as:
34 - DVR/NVR
35 - IVA camera surveillance
36 - Drones
37 - Robotics
38 
39 The sample applications
40 demonstrate how to use the Multimedia API and other libraries, such as:
41 - NVIDIA<sup>&reg;</sup> TensorRT<sup>&trade;</sup>
42 - NVIDIA<sup>&reg;</sup> CUDA<sup>&reg;</sup>
43 - cuDNN
44 - OpenCV
45 - Libargus
46 - NVDC-DRM
47 
48 The following table describes the samples.
49 
50 | Directory Location Relative to ll_samples/samples | Description |
51 |---------------------------------------------------|-------------|
52 | @ref l4t_mm_00_video_decode | Decodes H.264, H.265, VP8, VP9, MPEG4, and MPEG2 video from a local file and then shares the YUV buffer with egl renderer. |
53 | @ref l4t_mm_01_video_encode | Encodes YUV bitstream from local file and then write elementary H.264/H.265 into file. |
54 | @ref l4t_mm_video_decode_cuda | Decodes H.264/H.265 video from a local file and then shares the YUV buffer with CUDA to draw a black box in the left corner. | <!-- l4t_mm_video_decode_cuda.md -->
55 | @ref l4t_mm_video_cuda_enc_group | Use CUDA to draw a black box in the YUV buffer and then feeds it to video encoder to generate an H.264/H.265 video file. | <!-- l4t_mm_video_cuda_enc_guide.md -->
56 | @ref l4t_mm_vid_decode_trt | Uses simple TensorRT calls to save the bounding box info to a file. | <!-- l4t_mm_video_dec_tensorrt.md -->
57 | @ref l4t_mm_jpeg_encode | Uses `libjpeg-8b` APIs to encode JPEG images from software-allocated buffers. | <!-- l4t_mm_jpeg_encode.md -->
58 | @ref l4t_mm_jpeg_decode | Uses `libjpeg-8b` APIs to decode a JPEG image from software-allocated buffers. | <!-- l4t_mm_jpeg_decode.md -->
59 | @ref nvvid_scal_col_group | Uses `V4L2` APIs to do video format conversion and video scaling. | <!-- l4t_mm_vid_scal_col_fmt_conv.md -->
60 | @ref l4t_mm_08_video_decode_drm | Uses the NVIDIA<sup>&reg;</sup> Tegra<sup>&reg;</sup> Direct Rendering Manager (DRM) to render video stream or UI. | <!-- l4t_mm_08_video_decode_drm.md -->
61 | @ref l4t_mm_jpeg_capture_group | Simultaneously uses Libargus API to preview camera stream and libjpeg-8b APIs to encode JPEG images. | <!-- l4t_mm_camera_jpeg_capture.md -->
62 | @ref l4t_mm_camera_recording | Gets the real-time camera stream from the Libargus API and feeds it into the video encoder to generate H.264/H.265 video files. | <!-- l4t_mm_camera_recording.md -->
63 | @ref l4t_mm_v4l2_cam_cuda_group | Captures images from a V4L2 camera and shares the stream with CUDA engines to draw a black box in the upper left corner. | <!-- l4t_mm_v4l2_cam_cuda.md -->
64 | @ref nvvid_13_multi_camera_group | Captures multiple cameras and composites them to one frame.|
65 | @ref l4t_mm_14_multivideo_decode | Decodes multiple H.264, H.265, VP8, VP9, MPEG4, and MPEG2 videos from local files and writes YUV buffer into corresponding files. |
66 | @ref nvvid_backend_group | Performs intelligent video analytics on four concurrent video streams going through a decoding process using the on chip decoders, video scaling using on chip scalar, and GPU compute. | <!-- l4t_mm_backend.md -->
67 | @ref l4t_mm_camcap_tensorrt_multichannel_group | Performs independent processing on four different resolutions of video capture coming directly from camera. | <!-- l4t_mm_camcap_tensorrt_and_multi_enc.md -->
68 | @ref l4t_mm_v4l2cuda_group | Uses V4L2 image capturing with CUDA format conversion. | <!-- l4t_mm_v4l2cuda.md -->
69 
70 There is one tool that the samples can use.
71 
72 | Tool Name | Description | Directory Location |
73 |-------------|-------------|--------------------|
74 | @ref l4t_mm_caffe_to_tensorRT_group | Standalone tool that converts a CAFFE network to a TensorRT-compatible model and saves the model stream into local file for subsequent usage. | tools/ConvertCaffeToTrtModel | <!-- l4t_mm_caffe_to_tensorrt_guide.md -->
75 
76 ## L4T Software Stack
77 
78 The following diagram illustrates the L4T software stack.
79 Of the Multimedia box (center, bottom), the Multimedia API
80 provides the following components:
81 - libargus for imaging applications
82 - NVDC-DRM for non-X11 display system
83 - V4L2 API for encoding, decoding, scaling, and other media functions
84 - NVOSD for drawing text and box on the screen
85 
86 With these components, you can access the other libraries, such as TensorRT
87 and cuDNN.
88 
89 ![](l4t_architecture.jpg)
90 
91 
92 @}
93