Prepare unstructured data for chunking by using Data 360 content parsing and preprocessing methods. Parsing and preprocessing identify document structures, such as headings, paragraphs, or tables, remove irrelevant content, and prepare the text for chunking and indexing.
- LLM-based Parsing and Preprocessing
Use LLM-based parsing and preprocessing to extract and prepare text, metadata, tables, and images from unstructured documents for chunking. - Docling Parser
The Docling parser is a third-party intelligent document parsing framework that brings together multiple open-source models for layout understanding and table extraction. To enhance responses from information available in images and complex tables, combine the Docling parser with image processing by using Large Language Models (LLMs).