Start with a runtime preset
| Preset | Use it for |
|---|---|
| Battery Saver | Lower sustained workload and energy use. |
| Balanced | Everyday chat with sensible memory and speed trade-offs. |
| Max Speed | Highest practical throughput when thermal and battery cost are acceptable. |
| Max Context | Longer conversations or documents when the model and device fit. |
| Vision Heavy | Image prompts that need additional multimodal headroom. |
| Tool Heavy | Chats expected to use many tool definitions and results. |
Context and RAM guards
Context length affects memory, speed, and how much conversation or retrieved material the model can see. Noema estimates the working set against the current device and warns when a configuration is likely to exceed safe headroom.
- Reduce context before changing many advanced controls at once.
- Leave space for attachments, retrieval passages, and tool schemas.
- A configuration that fits on a Mac may not fit on an iPhone with the same model file.
Sampling and generation
- Temperature, top-p, top-k, min-p, and repetition controls vary by runtime.
- Reasoning and maximum-output controls appear only when supported by the selected model.
- Some packaged runtimes intentionally expose fewer options than GGUF.
- Reset to a preset if a heavily tuned configuration produces unstable or repetitive output.
Advanced local features
The faster GGUF settings screen can expose benchmarking, speculative decoding with a compatible helper model, and multi-token prediction options. These controls are format- and model-dependent and should be enabled only when the compatibility checks pass. Vision options appear only for models that support them.
Apple Foundation Models
AFM settings depend on the operating system and supported device. Noema does not present the obsolete Default or Permissive guardrail choice. Availability, execution mode, and any Apple cloud controls are shown only when the public OS exposes them.