Salesforce Docs Portal

Ingest Data by Uploading a File

Create a data stream by bringing in data from a local CSV file into Data 360.

Required Editions

Available in: All Editions supported by Data 360. See Data 360 edition availability.
User Permissions Needed
To upload data using a file

Permission set:

  • Data Cloud Architect

Before You Begin

  • Verify that your file is less than 2 GB and has a maximum of 1,050 columns.
  • Use the four-digit (“yyyy”) format for date and time records that include a year. When data from an ingested file uses the two-digit (“yy”) format, additional date and time pattern rules for the “year” are applied. This can result in an unexpected date value.
  • Use a supported format when your file contains date or date-time values. See Date and Datetime Formats.
  • If you create or update a sandbox org, activate the UploadedFiles connection from Setup, in Other Connectors.

Watch this video or follow the steps to use this feature.

  1. In Data Cloud, go to the Data Streams tab and click New.
  2. Select the File Upload tile, and click Next.
    Click the File Upload tile to upload a local file.
  3. Select the CSV file with your data.

    You can upload up to 2 GB.

  4. Specify your data lake object (DLO), and API name.
    Name the new DLO and API.
  5. In the Properties section, select the category for your data stream and primary key.
    Set properties for the new data stream.
  6. To change a field's data type, click the Supported Fields tab.
    Use the Supported Fields tab to change a field's data type.
  7. Click Next.
  8. (Optional) If needed, change the data stream name. The data stream uses the uploaded file name.
  9. (Optional) If needed, choose a data space and set filters.
  10. To create your data stream, click Deploy. This ingests your data into the DLO.
    Specify data settings to create a new data stream.
    Important
    Important

    You can create a maximum of 100 data streams and DLOs from file uploads.

    Note
    Note

    If you upload a file to the data stream and no records are visible after the upload, check if there are null values in the primary key column of the file. If the column contains null values, remove them from the file and upload it again.

    Note
    Note 


    When you install a File Upload Stream in a target org using a Data Kit, the stream is inactive and returns the error "INVALID_ARGUMENT: Invalid tenantId in FullyQualifiedPath". This issue occurs because the stream points to file storage in the source org, which the target org can't access. To resolve the issue, open the stream in the target org, click Update File, and upload the file to reconnect it to the target org's storage.

  • Data Stream Updates Using File Upload
    Update the data of an existing data stream created using File Upload. Quickly update your data by re-uploading the revised CSV file with added or removed records. Updating data replaces the data that was previously stored in the associated Data Lake Object (DLO). It also ensures that the data stream is always current with the latest information.