---
schema_version: "1"
id: a179af7a244be82207b199cb1265b025c5fcd534d092976d6c14791483366c22
title: Web Content (Crawler) Connector Limitations
collection: developer
version: current
locale: en-us
portal_url: https://docs.salesforce.com/developer/current/en-us/data-cloud/data-cloud-int/guides/webcontentcrawler/c360-a-web-content-crawler-connector-limitations.md
canonical_url: https://developer.salesforce.com/docs/data/data-cloud-int/guide/c360-a-web-content-crawler-connector-limitations.html
source_site: developer.salesforce.com
content_type: documentation
content_hash: 4482b24eaaa1225b61b60fa731a1d9c133bb166ebd43de1966ec60dec60ad564
products:
  - Data 360 Integration Guide
  - Data 360 Developer Documentation
---
# Web Content (Crawler) Connector Limitations

Learn about the functional limitations of the Web Content (Crawler) connector that affect certain behaviors and outcomes.

## Unsupported File Types Aren't Ingested

- HTML and PDF pages are supported.
- Supported image formats: .jpg, .jpeg, .png.
- Video and audio files (.mp3, .mp4, etc.) aren’t supported.

## Language Metadata Isn't Supported

- The Web Content (Crawler) connector only identifies the ingested content as English, without providing other language metadata.

## Client-Side Rendering Isn't Supported

The Web Content (Crawler) connector doesn’t support content that is dynamically rendered via JavaScript at runtime. Any content rendered in this manner isn't ingested.

## URL Query Strings Aren't Supported

When parsing links, the connector automatically removes the query string from the URL—all text following the `?`. This limitation applies to all pages except the root page.

## Rate Limit

The connector’s rate limit is 5 records (pages) per second. If your website doesn't support this rate limit, the connector may fail.

## Apache HttpClient Requests

The ingested site needs to allow Apache HttpClient Requests.

## General Data 360 Limitations

Learn about [Data 360's general limitations](https://help.salesforce.com/s/articleView?language=en_US&id=data.c360_a_limits_and_guidelines.htm&type=5) which may create issues for this specific connector.