Creating an Intelligent Context configuration includes these key steps: uploading sample documents for evaluation, configuring the Intelligent Context configuration, testing the results, iterating on the configuration, and publishing to a search index.
Required Editions
| Available in: All Editions supported by Data 360. See Data 360 edition availability. |
| User Permissions Needed | |
|---|---|
| To create an Intelligent Context configuration: | |
Enable Agentforce
Intelligent Context requires generative AI features available through Agentforce.
- Enable Agentforce: If you haven't already, enable Agentforce in your org.
- Turn On Einstein Generative AI: Enable Einstein Generative AI in Data 360.
Create a Configuration
To get started with a new Intelligent Context configuration, upload up to five unstructured files or select a data model object (DMO) with up to 30 records.
- In Data 360 home, go to the Process Content tab.
- Select Intelligent Context in the left-hand navigation and click New Configuration.
- In the New Search Configuration dialog, choose a data space and name for the search configuration, and click Save.
- From the Intelligent Context page, select your new project.
- Click Upload Files or Choose different source to select a DMO.
- Select a file or a DMO to review its content in the Configuration Preview.
Configure with AI Smart Defaults
Generate a configuration using AI smart defaults.
- In the agent chat, click Set up my configuration using smart defaults.
-
Review the configuration summary, and choose to accept or modify it.
- If you accept the configuration, continue to Test and Evaluate a Configuration.
- If you want to modify the configuration, continue to Modify an Intelligent Context Configuration.
Modify an Intelligent Context Configuration
The configuration preview shows the generated chunks created from your source documents. Modify these configuration settings as necessary.
- Click the Edit Configuration tab.
-
To change the search type, click Select Search Index Type, and choose vector
or hybrid search.
Vector Index content based on semantic meaning. Hybrid Index content based on semantic meaning and keywords. -
To change how your content is parsed, click Set Parsing Options.
You can't select both LLM-based parsing and LLM-based Visual Data Preprocessing options. Review LLM-based parsing and preprocessing for more information about these options.
-
Choose one of these options.
Default Parser Extract text using built-in platform settings. LLM-based Parser Extract all text, images, and other visual elements using a large language model (LLM). Docling Parser Extract text from images, tables, and document layouts using the Docling parser. -
To change how your content is preprocessed for chunking multimodal elements, such as
images and tables, click Set Preprocessing Options.
Preprocessing extracts context from images and extracts data from tables while maintaining context and relationships.
-
From the Preprocessing dropdown list, choose one of the following:
No preprocessing Default setting. LLM-based preprocessing Use the default prompt as is, or edit it for your specific use case. - To extract text from tables, forms, and image captions, turn on Image Processing.
- Click Select an Embedding Model, and choose an embedding model from the list.
- To change how your content is chunked, click Set Data Chunking Rules, and choose a chunking strategy.
-
Adjust the token settings as needed.
Chunking Strategy Description Section-Aware Chunking Uses title and heading elements to chunk documents. Additional settings:
- Max Tokens: Combine adjacent small sections into larger chunks by adjusting the token size.
- Overlap Tokens: Use only if you create multiple chunks from a single section. Specify the number of tokens to add from the end of each chunk to the beginning of the next chunk.
Passage Extraction Uses the semantic meaning inherent in HTML tags to chunk a document into passages. Additional settings:
- Max Tokens: Combine adjacent small sections into larger chunks by adjusting the token size.
- Turn on Knowledge Harmonization to render your content in a consistent viewing experience without merging the source content.
- To add and map metadata fields, such as subject and file type, for local file uploads, select SI Optimization. Use these fields to apply prepend values to your generated document chunks, or to set pre-filter conditions that refine your search results.
- Select the metadata fields to prepend to the generated document chunks.
- Add pre-filter conditions to refine query results based on your metadata field values.
-
Click Apply Changes.
When you click the button, Data 360 automatically generates and displays a new set of content chunks in the Configuration Preview pane.
- Continue to test and evaluate your configuration.
Test and Evaluate a Configuration
To verify search quality and chunk accuracy, test your configuration by asking questions in the agent chat pane, or compare the generated chunks with your source documents. Each generated chunk displays a confidence score, a source file reference, and a citation.
- In the agent chat pane, select a suggested question or enter your own query in the chat box.
- To open the source file in the preview pane, click a generated chunk. You can also search or filter the list of chunks.
- To compare the generated chunks directly with the source document, click Compare with Source.
- To make further changes to your configuration, follow the steps in Modify an Intelligent Context Configuration.
- Continue to publish your search index configuration.
Publish the Search Index Configuration
Before you can publish your configuration, you need to set up an unstructured data connection to ingest your source files. Set up an unstructured data connector to ingest your source files into an unstructured data lake object (UDLO) in Data 360. See Unstructured Data File Formats and Connectors for a list of connectors.
After you test and modify your configuration, the final step is to publish it to make it available for use in your org.
- From Intelligent Context, click Publish.
- In the Select an Unstructured Data Model Object dialog, select a data model object to apply the configuration to.
- Click Next.
- In the Create Search Index dialog, confirm or change the index name, and click Publish.
- Navigate to the Content Indexing or Search Index pages to review the results.
- To manage and review your harmonized objects in Data 360, go to the Knowledge Harmonization page under Process Content.