interactive Nsight LLM analyzer

Описание к видео interactive Nsight LLM analyzer

Nsight LLM Analyzer is a tool that reads output from NVIDIA Nsight Systems, analyzes it using OpenAI's GPT-4 (or other models), and provides insights on performance bottlenecks and resource usage. This repository includes a modular Python package for performing the analysis and a main script for running the tool. This demo shows the Python version of the interactive app. A C++ version has been created but not yet tested.

Комментарии

Информация по комментариям в разработке