{"id":1322,"date":"2025-09-09T10:21:01","date_gmt":"2025-09-09T10:21:01","guid":{"rendered":"https:\/\/blog.aetherix.com\/?p=1322"},"modified":"2026-03-27T13:43:27","modified_gmt":"2026-03-27T13:43:27","slug":"how-to-run-mlc-llm-on-jetson-agx-thor","status":"publish","type":"post","link":"https:\/\/blog.openzeka.com\/en\/how-to-run-mlc-llm-on-jetson-agx-thor\/","title":{"rendered":"How to Run MLC LLM on Jetson AGX Thor?"},"content":{"rendered":"

What is MLC LLM ?<\/h3><\/div>

MLC LLM (Machine Learning Compilation for Large Language Models)<\/strong> is an open-source project designed to make large language models (LLMs) run efficiently across different hardware platforms. Its main goal is to optimize performance and reduce energy consumption, enabling AI applications to run not only in the cloud but also on edge devices.<\/p>\n

NVIDIA\u2019s next-generation Jetson AGX Thor platform<\/strong> delivers powerful computing capabilities for robotics, autonomous systems, and AI-driven applications. By leveraging MLC LLM<\/strong> on Jetson AGX Thor<\/strong>, large language models can be optimized to run in real time, supporting tasks such as natural language processing, decision-making, and human-like interaction with higher efficiency.<\/p>\n<\/div><\/div><\/div>

In short, MLC LLM<\/strong> on Jetson AGX Thor<\/strong> acts as a bridge that brings high-performance large language model capabilities to edge devices.<\/p>\n<\/div>

Requirements<\/h3><\/div>