TensorRT
Jump to navigation
Jump to search
TensorRT is a timing-based kernel schedule. It is non-deterministic (see Determinism) so it cannot be used for Grassland nodes until that is fixed. "Each time an inference engine is generated, it could be slightly different, particularly if there is varying load on the machine used to run TensorRT. There is a solution planned for this"[1].