onnxruntime

Run ONNX models through Microsoft's ONNX Runtime from Haskell. An environment, session options (thread counts, graph optimisation, the CPU by default with CUDA or ROCm on request), sessions opened from a file or from bytes, and tensors made from storable vectors with their shapes and element types, run by named inputs and outputs. Every handle is held by a bracket, and every failure is a typed OrtError. The runtime's C API is reached through a small C file that calls its function table; the library links the system's onnxruntime.