---
schema_version: "1"
id: b053872ab662e83bafa00a40ec06db86c44f66f60a70f8077c9bb996dc478b11
title: Web Content (Crawler) Connector Troubleshooting Guide
collection: developer
version: current
locale: en-us
portal_url: https://docs.salesforce.com/developer/current/en-us/data-cloud/data-cloud-int/guides/webcontentcrawler/c360-a-crawler-troubleshooting-guide.md
canonical_url: https://developer.salesforce.com/docs/data/data-cloud-int/guide/c360-a-crawler-troubleshooting-guide.html
source_site: developer.salesforce.com
content_type: documentation
content_hash: b42aaadd504687c325bf3622e791c4abc662af654f45d3b66a060809d83608a2
products:
  - Data 360 Integration Guide
  - Data 360 Developer Documentation
---
# Web Content (Crawler) Connector Troubleshooting Guide

Tips for troubleshooting issues that may occur when you ingest a website content into Data 360 using the Web Content (Sitemap) connector.

## Clicking Test Connection in the Connection Setup Fails

When you create a new connection, Data 360 performs a validation test.

### Issue

The test connection fails.

### Solution

Check if the website you're ingesting blocks the connector. Some websites may block the connector in two possible ways.

- **User-Agent Blocking**: By default, the connector uses the Mozilla/5.0 user agent. Some sites may reject it. If your connection test fails, try entering a different user agent in the **User Agent** field.
- **IP Blocking**: Sites using services like Cloudflare may block unauthorized IPs. Confirm with your IT or security teams that the website doesn’t block an IP address used by Data 360 listed in [IP addresses used by Data 360 services](https://help.salesforce.com/s/articleView?language=en_US&id=data.c360_a_data_cloud_ip_address_allowlist.htm&type=5).

## New Data Fails to Ingest

When you ingest data using the Web Content (Crawler) connector, Data 360 syncs it.

### Issue

The sync fails.

### Solution

Review the [troubleshooting guide for common errors and solutions](https://developer.salesforce.com/docs/data/data-cloud-int/guide/c360-a-common-web-content-crawler-errors-and-solutions.md).

## My Sync Completed, But No Records Are Showing on the Data Stream Tab

When you ingest content from a website using the Web Content (Crawler) connector, your records can be viewed on the Data Stream tab.

### Issue

No records were ingested.

### Solution

1.  Check the format of your ingested files. The Web Content (Crawler) connector currently supports only HTML and PDF files. Data Cloud skips and doesn’t index other file formats.

2.  Dynamic Content and JavaScript Rendering: The Web Content (Crawler) connector doesn’t support content that is dynamically rendered via JavaScript at runtime.
    To validate whether this is the issue, inspect the website page source.

#### Option 1

1. Right-click on the page.
2. From the context menu, click **View Page Source** (in Mac, click command+option+u).
3. Check if the expected content is present. If the content is only visible after the page loads in a browser and not in the raw HTML source, it’s likely that it's JavaScript-rendered, and can’t be ingested.

#### Option 2

1. Right-click on the page.
2. From the context menu, click **Inspect**.
3. Click the Settings icon button on the top right.
4. Scroll down to **Debugger** and check **Disable JavaScript**.
5. Refresh the page to view what the connector can ingest.