TensorRT

From Grassland Wiki
Revision as of 20:25, 21 February 2020 by Davidt (talk | contribs) (Created page with "TensorRT is a timing-based kernel schedule. It is non-deterministic so it cannot be used for Grassland nodes. "Each time an inference engine is generated, it could be slightly...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

TensorRT is a timing-based kernel schedule. It is non-deterministic so it cannot be used for Grassland nodes. "Each time an inference engine is generated, it could be slightly different, particularly if there is varying load on the machine used to run TensorRT. There is a solution planned for this"[1].

  1. ↑ https://github.com/NVIDIA/tensorflow-determinism/tree/8d4580609c2ac5ae9d5e33956bec802152220449#sources-of-non-determinism-beyond-tensorflow
Retrieved from "https://wiki.grasslanders.org/index.php?title=TensorRT&oldid=36"