TT-XLA documentation

Get started

• Getting Started
  • Prerequisites
  • TT-XLA Installation Options
  • Testing
  • Common Build Errors
  • Pre-commit
  • Where to Go Next
• Breaking Into the Source With a Debugger
  • Prerequisites
  • Debugging Python Integration Tests
  • Debugging PJRT Unit Tests
• Improving Model Performance
  • Overview
  • 1. Optimization Levels
  • 2. Device Warmup
  • 3. Data Formats
  • For more advanced usage including JSON configs, the tt-gen-weight-template CLI, and implementation details, see Mixed Precision.
  • 4. Runtime Trace
  • 5. Batch Size Tuning
• Mixed Precision (Per-Tensor Weight Dtype Overrides)
  • Method 1: Python dict (recommended)
  • Method 2: JSON config + CLI
  • In-model annotation
  • How it works
• Test Infra
  • Op and Graph Tests
  • Model Tests
  • Serialization and FileCheck

Compiler and tools

• Fusing and Composite Ops
  • Compilation Pipeline Overview
  • Configuration Options
  • Fusion + Composites: Working Together
  • Composite Ops
  • Torch FX Fusing
  • MLIR Fusing (Advanced)
• Model Auto-Discovery Tests
  • Overview
  • Prerequisites
  • Quick start / commonly used commands
  • How discovery and parametrization work
  • Test IDs and filtering
  • Parallelism modes
  • Per-model requirements
  • Test configuration and statuses
  • Model status and bringup_status guidance
  • Targeting architectures
  • Placeholder models (report-only)
  • CI setup
  • Adding a new model to run in Nightly CI
  • Troubleshooting
  • Future enhancements
  • Reference
• Code Generation Guide
  • Quick Reference
  • Overview
  • Basic Usage
  • Configuration Options
  • Generated Output
  • Code Generation Behavior
  • Use Cases
  • Advanced Topics
  • Related Documentation
  • Next Steps
• Tutorial: Generate Python Code from Your Model
  • What You’ll Learn
  • What is Code Generation?
  • Prerequisites
  • Step-by-Step Guide
  • Next Steps
  • Summary
• Troubleshooting code generation
  • Code generation fails
• Building PyTorch XLA from Source
  • Overview
  • Build
  • Incremental Rebuilds
  • Troubleshooting
• Tools
  • Available Tools
• Explorer
  • What is Explorer?
  • Building with Explorer
  • Using Explorer
  • Learn More

Indices and tables

• Index

• Search Page