Data Stream Updates Using File Upload

Update the data of an existing data stream created using File Upload. Quickly update your data by re-uploading the revised CSV file with added or removed records. Updating data replaces the data that was previously stored in the associated Data Lake Object (DLO). It also ensures that the data stream is always current with the latest information.

Before you upload data, verify that your file is less than 2 GB and has a maximum of 1,050 columns. Use the four-digit ("yyyy") format for date and time records that include a year. When data from an ingested file uses the two-digit ("yy") format, additional date and time pattern rules for the "year" are applied. This can result in an unexpected date value.

Important
Important File updates aren't supported while the last run status is Pending, Extracting, or In Progress. Wait until the data stream status is Active and the last run status shows Success or Error before uploading a new file.
Important
Important To update an existing data stream, upload a revised file with columns that exactly match the original file. If the columns don't match, your data won't upload correctly.

You can update a data stream created with File Upload from the data streams list view or the overview page.

Data Streams List View

You can view data streams created from an uploaded file on the list view page. To update a file for a specific data stream, go to your data stream and use the dropdown option on the right side of the page to select this option.

Data streams list view displaying the option to update an existing data stream with a local file upload.

Data Stream Overview

After you create a new data stream using an uploaded file, you can see its details on its overview page. Additionally, you can find the option to update your file.

Data stream overview displaying the option to update an existing data stream with a local file upload.