What you can add manually
| Material | Examples and limits |
|---|---|
| Documents | PDF, EPUB, Markdown, plain text, JSON, and JSONL, subject to extraction support. |
| Media | M4A, MP3, WAV, AAC, AIFF, CAF, MOV, MP4, and M4V through a configured transcription engine. |
| Tabular files | Direct manual CSV and TSV imports are currently rejected, even though downloaded dataset packages can contain them. |
Other dataset sources
- Download compatible Hugging Face datasets from Explore.
- Install curated Knowledge Packs with source, license, and snapshot information.
- Receive managed enterprise datasets when enrolled in a workspace.
Embeddings are required for retrieval
A chat model writes the answer; an embedding model builds and searches the semantic index. Install the embedding model before indexing documents, datasets, or Knowledge Packs.
- Import or download the material.
- Allow extraction or transcription to complete.
- Configure chunking and retrieval settings when needed.
- Wait for embeddings and the index to finish.
- Select the dataset for a chat or arm Dataset Search.
Dataset Health and maintenance
- Use Dataset Health to inspect missing, stale, or incomplete index state.
- Refresh when source material changed; rebuild when extraction, chunking, or embeddings need to be regenerated.
- Tune retrieval count and relevance behavior to the model’s context budget.
- Dataset Search can query indexed material beyond the dataset selected for the conversation.
Citations require judgment
Retrieved passages include source information and relevance signals. Noema can ask the model to cite them, but it cannot promise that every generated answer identifies the exact passage that determined the conclusion. Open the underlying evidence for high-stakes work.