Configure Amazon S3 as a source

Learn how to configure a custom meter using an Amazon S3 bucket as the source for event data.

Create a Custom Meter.

Select Amazon S3 as the source. The Amazon S3 settings page is displayed.

Amazon S3 source settings

Click Select to select an Event Definition. You can create or select an existing Event Definition, or import an Event Definition.

Under the Amazon S3 Settings section, configure the following settings:

Setting	Configuration
Connection	Select S3 from the Connection drop-down list which includes the S3 bucket, credentials, and base path. To set up a connection, see Create AWS S3 connections in meters.
Folder	Add the path to the main folder in the Folder field where you want to read data from Amazon S3. Note that when you add a folder to read data also grants read access to all the subfolders and files under the main folder.
Incremental Mode	The Incremental Mode checkbox gives the following options: If checked, will allow mediation to monitor and process new files added to the Folder you specified in the S3 source. This means that the Meter will continue to function. If unchecked (the default), the meter will process the currently existing files in the folder, and the job will be completed once the process is complete. The Meter will operate in batch mode and must be triggered with each new file upload.
File Format	Click the File Format drop-down list to select a file format. Note that all of the files in the folder you chose must be in the same format, or the ingestion of a file in a different format will fail.

For Amazon S3 sources, Mediation automatically captures source-file metadata during ingestion. You do not need to add these values to the source file or define them in the event definition. The available metadata includes fileSize and fileModificationTime. Run history results for Amazon S3 ingestion also include source-file metadata such as filePath, etag, fileSize, and fileModificationTime.

Click Save to save the Amazon S3 source settings.