D-Robotics Official Website
1.0.0
D-Robotics Official Website
1.0.0
English

Product Overview

The D-Robotics LLM Toolchain (also known as D-Robotics LLM) is a specialized extension of the D-Robotics S600 toolchain designed for Large Language Model (LLM) applications. It enables the deployment of LLMs on the S600 and its derivative platforms, providing robust support for LLM requirements in robotic applications.

Release Package Content

The structure of the D-Robotics S600 LLM release package is as follows:

. ├── arm-gnu-toolchain-13.2.rel1-x86_64-aarch64-none-linux-gnu.tar.xz ├── oellm_build │ ├── requirements.txt │ ├── hbdk4_compiler-{version}-cp310-cp310-manylinux_2_17_x86_64.whl │ ├── hbdk4_runtime_aarch64_unknown_linux_gnu_nash-{version}-py3-none-any.whl │ └── leap_llm-{version}-py{version}-none-any.whl └── oellm_runtime ├── models ├── configs ├── examples ├── include └── lib

The contents are as follows:

  • arm-gnu-toolchain-13.2.rel1-x86_64-aarch64-none-linux-gnu.tar.xz: Cross-compilation toolchain package.

  • oellm_build: Contains environment dependencies and quantization tools for the x86 development machine.

  • oellm_runtime: Contains SDK dependencies and examples for S600 edge deployment.

    • models: Provides download methods for supported models.

    • configs: Contains configuration files for supported models.

    • examples: Includes binaries, source code, compilation scripts, and demo cases.

    • include: Header files required for compiling edge deployment examples.

    • lib: Dependency libraries for edge deployment programs.