liuwenzhoa/ktransformers

KTransformers is a Python framework that enhances Hugging Face Transformers with advanced kernel optimizations and placement/parallelism strategies for efficient local LLM inference. It's designed for developers and researchers who want to experiment with cutting-edge LLM optimization techniques while maintaining compatibility with existing Transformers workflows through simple injection templates.