--- schema_version: "1" id: d7524a72192ab92bf1f0b378164950c0694ffbadd0d3bf4375d44c3ef50502f8 title: Apply File Transformers in Marketing Cloud Intelligence collection: admin version: current locale: en-us portal_url: https://docs.salesforce.com/admin/current/en-us/mktg/264-0-0/dato_data_streams_tc_transformers_apply.md canonical_url: https://help.salesforce.com/s/articleView?id=mktg.dato_data_streams_tc_transformers_apply.htm&release=264.0.0&type=5 source_site: help.salesforce.com content_type: documentation content_hash: 2afcbb07188bec6d5da29fce0c35df811ddf6505c594797e9cd13f13e3605ea0 description: Use file transformers when you want to transform a file that has special characteristics like uncommon delimiters, multiple sheets, or specific file encoding. For example, if a file uses ~~ as the delimiter instead of a comma or a tab, use the file transformer to specify the custom delimiter so that you can map the file correctly. products: - Marketing - Marketing Cloud Intelligence release: "264" --- # Apply File Transformers in Marketing Cloud Intelligence Use file transformers when you want to transform a file that has special characteristics like uncommon delimiters, multiple sheets, or specific file encoding. For example, if a file uses ~~ as the delimiter instead of a comma or a tab, use the file transformer to specify the custom delimiter so that you can map the file correctly. ### Required Editions

User Permissions Needed
To apply transformers:	Admin

1. From the **Connect & Mix** tab, select **Data Streams**, and then **Data Streams List**. 2. Create a data stream, or edit an existing one. 3. In the **Preview Source** screen, click **Edit Transformers**. File transformers are added by default. 4. In the **Transformers in Use** section, next to the File transformer, click **Edit**. 5. In the **File Format** dialog, in the **Detection** area, select how you want to detect the file types.

Auto	Detects any format type
Custom	Manually defines allowed formats and the order of detection. If you select this option, you can change the order of the format types and decide which to include or not to include.

6. In the **Settings** area, click on a format type to edit the settings. 7. Click **Done**. CSV Options - **Use Unquoted Multiline Fields Format** — The standard in text files is that quotation marks surround each value. For example, "campaign name". The quotation marks indicate where the value starts and ends. When “Enter” is used, it marks a new line of data. When these settings don’t exist, you need a special configuration so that the platform understands the file correctly. Before selecting this option, it’s advisable to consult with the R&D team. - **Use Custom Delimiter** — All text files have a delimiter that separates between different columns. Two of the more common separators are CSV, which uses a comma-separated file, and TSV, which uses a tab-separated file. You can also create a text file that has a special separator. Typically you use this option when there are tabs and commas inside the data. - **Use Custom Quote Character** — The standard in text files is that quotation marks surround. For example, "campaign name". The quotation marks indicate where the value starts and ends. In some cases, there’s no separator between values. When quotation marks or separators don’t exist, you need a special configuration so that the platform understands the file correctly. - **Use Custom Escape Character** — An escape character allows you to insert characters that are usually part of a file’s string and not as standalone characters. In text files, the standard escape character is usually a backslash \\. For example, you have inches in your file, say, 21", and your quote character is ". The escape character allows the platform to understand that the quotes aren’t used as quote characters, but rather as part of the data. So if you enter 21", the data looks like 21" at the end. However, if your file contains a different escape character, other than a backslash, select this option, and then insert the custom escape character that’s in your file. - **File Encoding** — It’s recommended that you set this option to **Auto Detect**. In cases where you see that the encoding wasn’t properly detected, for example, the field names read like gibberish or are sliced incorrectly, set the encoding manually. Excel Options - **Sheet Name** — If you have multiple sheets in your file, select the sheet that you want to upload. Or you can use a wildcard with an asterisk for the sheet name in case it changes. For example, the sheet contains today’s date, such as Report Jan 1, and the date changes with every upload (Report Feb 2, Report Mar 3, etc). In that case, you can use a wildcard (Report\*) and then choose the sheet dynamically. - **Use first sheet as default** — Select this option, if you want the first sheet to be selected in cases where the selected sheet isn’t found in the file. - **Protected Workbook Password** — If the Excel file you uploaded is password-protected, enter the password here. Upload the file after the password is provided. If you didn’t know the file was encrypted, and you uploaded it before being asked to supply a password, upload it again after providing the password. Decryption is available only for workbook encryption for Excel version 2007 and above. Sheet encryption isn’t supported. - Best practice — Marketing Cloud Intelligence must be able to open the source file of the data stream, which is the first file uploaded. After the source file is encrypted, you want the password for the data stream to always match this file so that it can always be opened. When using passwords in encrypted files the password can’t be changed. If you know the password could change over time, it’s best to upload the first file in a non-protected format, and then all files after can be encrypted. If the password changes over time, change it in the file transformers before uploading the file with the new password. XML Options - **RSS Feed Format** — If the file you’re uploading is in an RSS format, select this option. - **RSS Custom Header Name** — When you don’t want to use the standard RSS headers, enter the desired headers in this field. - **XML XSL Transformation** — If you have XSL for the XML file that you’re uploading, enter it here. XSL is a scripting language used to access XML elements. XSL is often used to reorganize the file’s structure. You want your XSL script to reorganize the XML into a comma-delimited format, similar to that of a CSV file. For more information on XSL functions and syntax, refer to this [tutorial](https://www.w3schools.com/xml/func_functionavailable.asp). PDF Options - **Pages** — Insert the pages that you want to use in the file transformers. You can insert ranges separated by a comma or all. For example, 1-3,5-7,9 or all. - **Protected Workbook** — If your PDF is password-protected, insert the password here, and then upload the file again to process it. - **Page Area** — Insert the portion of the page to analyze, such as top, left, bottom, or right. For example, 269.875,12.75,561. - **Use Spreadsheet Mode** — To force the PDF to be extracted using spreadsheet-style extraction, select this option. - **Use Non-Spreadsheet Mode** — To force the PDF to not be extracted using spreadsheet-style extraction, select this option. JSON Options - **Use JSON Path** — When uploading a JSON file that includes hierarchies, you can use a JSON path to access the specific hierarchy that you want to upload. For an explanation on the JSON path, refer to this [documentation](https://github.com/json-path/JsonPath). - **Use Keys as Values** — The default behavior when uploading a JSON file is to use the keys as the column names. The key values appear in the Source Fields section. When this option is selected, the keys are counted as values and the columns receive a name from Marketing Cloud Intelligence. Example: ``` JSON file - { "id": 1, 2 "name": [“A green door", “window frame”] "price": [12.50, 10.50] "tags": [“home", “home”] } ```

Default Behavior
id	name	tags
1	a green door	home
2	window frame	home

With 'Use Keys as Values" Checked
Header 1	Header 2	Header 3
id	1	2
name	a green door	window frame
price	12.5	10.5
tags	home	home

- **Flatten Nested Objects** — When uploading a JSON file with hierarchies, Marketing Cloud Intelligence recognizes only the top hierarchy by default. If you want to process lower hierarchies, you must flatten the file. When the Flatten Nested Objects option is selected, the platform flattens the nested objects and creates additional columns for them. It’s similar to the action performed by JSON to CSV tools. (_Currently_, _nested arrays aren’t supported_.)