Colossal-AI Team Open-Sources SwiftInfer: A TensorRT-Based Implementation of the StreamingLLM Algorithm
The Colossal-AI workforce has open-sourced Swiftlnfer, a TensorRT-based implementation of the StreamingLLM algorithm. The StreamingLLM algorithm ...
Read more
