TensorRT

From Grassland Wiki
Jump to navigation Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

TensorRT is a timing-based kernel schedule. It is non-deterministic (see Determinism) so it cannot be used for Grassland nodes until that is fixed. "Each time an inference engine is generated, it could be slightly different, particularly if there is varying load on the machine used to run TensorRT. There is a solution planned for this"[1].