The runtime's process-wide state, which every session runs in.
Moduleonnxruntime-0.1.0.0GHC2024
OnnxRuntime.Session
The runtime's environment, session options and sessions, each held for the length of an action and released however it ends, and runs of a session on named tensors. Every failure is thrown as an OrtError.
Synopsis
- newtype Environment
- data LoggingLevel
- value withEnvironment
- data GraphOptimisation
- data ExecutionProvider
- data SessionOptions
- value defaultSessionOptions
- data TensorInfo
- data Session
- value sessionInputs
- value sessionOutputs
- value withSession
- value withSessionFromBytes
- value run
- value runtimeVersion
- data LiveHandles
- value liveHandles
- Packageonnxruntime-0.1.0.0
- Exports17
- LanguageGHC2024
- LicenceMIT
- SourceSession.hs
How much the runtime logs to stderr.
Instances5Bounded, Enum, Eq, Ord, Show
Bounded LoggingLevelDefined in onnxruntime-0.1.0.0 · OnnxRuntime.SessionEnum LoggingLevelDefined in onnxruntime-0.1.0.0 · OnnxRuntime.SessionEq LoggingLevelDefined in onnxruntime-0.1.0.0 · OnnxRuntime.SessionOrd LoggingLevelDefined in onnxruntime-0.1.0.0 · OnnxRuntime.SessionShow LoggingLevelDefined in onnxruntime-0.1.0.0 · OnnxRuntime.Session
An environment for the length of an action, logging at this level under this identifier.
How far the runtime rewrites a graph before running it.
Instances5Bounded, Enum, Eq, Ord, Show
Bounded GraphOptimisationDefined in onnxruntime-0.1.0.0 · OnnxRuntime.SessionEnum GraphOptimisationDefined in onnxruntime-0.1.0.0 · OnnxRuntime.SessionEq GraphOptimisationDefined in onnxruntime-0.1.0.0 · OnnxRuntime.SessionOrd GraphOptimisationDefined in onnxruntime-0.1.0.0 · OnnxRuntime.SessionShow GraphOptimisationDefined in onnxruntime-0.1.0.0 · OnnxRuntime.Session
Where a session runs its nodes. The CPU always runs whatever the others leave; CUDA and ROCm take a device number, and a runtime built without them refuses the session with a RuntimeError.
Instances2Eq, Show
Eq ExecutionProviderDefined in onnxruntime-0.1.0.0 · OnnxRuntime.SessionShow ExecutionProviderDefined in onnxruntime-0.1.0.0 · OnnxRuntime.Session
Constructors
MkSessionOptionsintraOpThreads :: Intthreads within one node; 0 lets the runtime choose
interOpThreads :: Intthreads across nodes; 0 lets the runtime choose
graphOptimisation :: GraphOptimisationexecutionProviders :: [ExecutionProvider]tried in order before the CPU
Instances2Eq, Show
Eq SessionOptionsDefined in onnxruntime-0.1.0.0 · OnnxRuntime.SessionShow SessionOptionsDefined in onnxruntime-0.1.0.0 · OnnxRuntime.Session
The runtime's own thread counts, every optimisation, the CPU alone.
An input or output a model declares.
Constructors
MkTensorInfotensorName :: TexttensorElementType :: Maybe ElementTypeNothing when it is not a tensor of a supported element type
tensorDims :: [Dim]
Instances2Eq, Show
Eq TensorInfoDefined in onnxruntime-0.1.0.0 · OnnxRuntime.SessionShow TensorInfoDefined in onnxruntime-0.1.0.0 · OnnxRuntime.Session
An open model with what it declares. It is valid only inside the action it was opened for.
A session on a model file for the length of an action.
A session on a model held in memory for the length of an action.
Run a session on named inputs for the named outputs, in that order. Each input is checked against what the model declares first.
The version of the runtime library loaded.
How many of each handle are open in the process: a program whose brackets have all ended holds none.
Constructors
Instances2Eq, Show
Eq LiveHandlesDefined in onnxruntime-0.1.0.0 · OnnxRuntime.SessionShow LiveHandlesDefined in onnxruntime-0.1.0.0 · OnnxRuntime.Session