Skip to content

feat(am62dx-edgeai): Add AM62DX EdgeAI documentation - #818

Open
PrathamTI wants to merge 1 commit into
TexasInstruments:masterfrom
PrathamTI:am62d-docs
Open

PrathamTI wants to merge 1 commit into
TexasInstruments:masterfrom
PrathamTI:am62d-docs

Conversation

@PrathamTI

@PrathamTI PrathamTI commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

This PR adds documentation for the AM62DX EdgeAI software stack — audio deep-learning inference (speech enhancement and audio classification) running on the C7x DSP via TVM .

@PrathamTI PrathamTI changed the title Am62d docs feat(am62dx-edgeai): Add AM62DX EdgeAI documentation Oct 26, 2026
@cshilwant

Copy link
Copy Markdown
Member

Are 17 granular commits needed? If not, please plan to squash them


|__SDK_DOWNLOAD_URL__|

Look for the file: ``tisdk-edgeai-image-am62dxx-evm.rootfs.wic.xz``

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#816 (comment)

Could you please go through all the comments on the draft PR and make sure they are addressed? Ideally, the same draft PR should have been opened for review, which would make it easier to verify that all comments have been handled.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We had some changes which modified build.yml and deploy.yml file to run github actions on the fork (And the generated github.io link was shared amongst other members). Hence we created a separate PR with clean commits.


.. _edgeai-introduction:

########################

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed

At run time on the AM62D, the TVM runtime loads the artifact and dispatches the
offloaded subgraphs to TIDL-RT on the C7\ |trade| NPU.

.. figure:: ../../../images/audioai/tvm_tidl_flow.svg

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why relative path is required here?
/images/audioai/tvm_tidl_flow.svg should work I believe

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed

@cshilwant cshilwant left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please review all comments from the draft PR and ensure they are addressed in this PR. Several comments from the draft PR are still unresolved here.

@PrathamTI
PrathamTI force-pushed the am62d-docs branch 3 times, most recently from 823790b to 569b338 Compare October 27, 2026 13:40
@PrathamTI

Copy link
Copy Markdown
Contributor Author

Are 17 granular commits needed? If not, please plan to squash them

Squashed into a single commit

@cshilwant cshilwant left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Run your commit by Claude against our CONTRIBUTING guide [0] to spot potential issues. Go through its findings, separate real non-compliance from false alarms, and fix what's actually broken.

[0] - https://github.com/TexasInstruments/processor-sdk-doc/blob/master/CONTRIBUTING.md

Comment thread source/devices/AM62DX/edgeai/evm_hardware_setup.rst Outdated
Comment thread source/devices/AM62DX/edgeai/evm_hardware_setup.rst Outdated

.. code-block:: bash

sudo minicom -D /dev/ttyUSB1 -c on

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please highlight baudrate in command itself

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.


host# ssh root@<EVM_IP_ADDRESS>

If using Ubuntu 22.04, add the following to ``~/.ssh/config``:

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use role file - https://www.sphinx-doc.org/en/master/usage/restructuredtext/roles.html#role-file

Note - this comment is not just for this section. Please update it for all such file & directory references in all such references in the PR

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have addressed this as well. The role-file was missing in multiple files, thanks for identifying this issue.

Comment thread source/devices/AM62DX/edgeai/evm_hardware_setup.rst
Comment thread source/devices/AM62DX/edgeai/index.rst Outdated
Comment thread source/devices/AM62DX/edgeai/linux_audio_inference_app.rst
Comment thread source/devices/AM62DX/edgeai/linux_audio_inference_app.rst Outdated
root@am62dxx-evm:~# git clone https://github.com/TexasInstruments/rpmsg-dma.git -b main
root@am62dxx-evm:~# cd rpmsg-dma

The example is under ``example/edge-ai/`` and contains:

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

* - GTCRN
- Speech enhancement (VoiceBank-DEMAND-16k)
- ``ase-0100``
- Arm core (ONNX runtime, FP32)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this correct that GTCRN runs entirely on Arm that too with ONNX-RT ?
@PrathamTI / @v-singh1

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's drop all references of GTCRN from SDK docs as the AM62D SDK intent is to support network execution on MMA &/OR C7x with TVM-RT only and no fallback to Arm Cortex A53.

There are 7 references which needs to be dropped.

image

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed all the GTCRN references

- BOOTMODE [8:15] (SW3) = 0100 0000
- BOOTMODE [0:7] (SW2) = 1100 0010

.. figure:: /images/am62dx_boot_pin.png

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just for confirmation. I can see SW1 in the image (the board image displayed). Can you check if it is SW1? The other bootmode switch naming is also not clear

a network, the web portal can be accessed from any device on the same network without
any additional setup.

The portal showcases the three core EdgeAI pipelines — home screen, speech

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

home screen as EdgeAI pipeline?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed this statement.

@Akshay-Abdar

Copy link
Copy Markdown
Collaborator

Any release notes section planned to be added somewhere at the bottom?


Connect the components to the AM62D EVM as shown below:

.. figure:: /images/am62dx_board_config.png

@Akshay-Abdar Akshay-Abdar Oct 28, 2026 •

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In this image, there are 3 unmarked arrows (the arrows are pointing towards a component) without any labelling. Kindly mark some label and also the image is not clear

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Akshay-Abdar

Thanks for identifying this issue. @paresh-bhagat is working on adding the image with proper labels

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Comment on lines +172 to +174
For **Windows** use Tera Term:

https://learn.sparkfun.com/tutorials/terminal-basics/tera-term-windows

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need this part since we haven't tested this for windows

Comment on lines +97 to +121
On-target measured latency and RTF for all four models are **TBD** - to be
filled in from the Model Zoo inference scripts on the AM62D EVM:

.. list-table::
:header-rows: 1
:widths: 20 20 30 30

* - Model
- On target
- Measured latency
- RTF
* - VGGish11
- C7\ |trade| NPU
- TBD
- - (clip classifier)
* - YAMNet
- C7\ |trade| NPU
- TBD
- - (clip classifier)
* - GCRN
- C7\ |trade| NPU
- TBD
- TBD
* - GTCRN
- Arm core

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Small question. If its TBD do we need to mention this part in the docs? Also add the arm core GTCRN model if the section will be included

@PrathamTI
PrathamTI force-pushed the am62d-docs branch 2 times, most recently from a0a0d2e to 599dcd1 Compare October 28, 2026 12:41
@PrathamTI

Copy link
Copy Markdown
Contributor Author

Any release notes section planned to be added somewhere at the bottom?

Yes we will create a separate section for release notes, but its not planned as of yet.

Adds the full EdgeAI documentation set for AM62DX covering audio
deep-learning inference (speech enhancement and audio classification) on
the C7x DSP via TVM + TIDL. The guide spans platform overview, hardware
setup, the out-of-box web GUI demo, the C++ inference application,
GStreamer audio pipeline development, the model workflow (zoo,
compile/evaluate, inspect), integrating a new model, and performance
benchmarking.

Co-authored-by: JuneChul Roh <jroh@ti.com>
Co-authored-by: Paresh Bhagat <p-bhagat@ti.com>
Signed-off-by: Pratham Deshmukh <p-deshmukh@ti.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants