AWS S3: Export Audiences

A wide ecosystem of tools can read JSON or CSV files from Amazon S3. This export allows you to bring Lytics user profiles based on your identity resolution strategy into other tools or to simply store as an archive of user data.

• Implementation Type: Server-side.
• Type: REST API.
• Frequency: One-time or scheduled batch which may be hourly, daily, weekly, or monthly depending on configuration.
• Resulting Data: User profile data written to a CSV or JSON format.

This integration uses the Amazon S3 API to upload data to S3. Each run of the job will proceed as follows:

1. Create file(s) with the format selected in configuration.
2. Scan through the users in the audience selected. Filter user fields based on the export configuration, and write to the file(s) created.
3. Compress event data, if selected in the export configuration.
4. Upload the User data files to S3 via AWS S3 Manager SDK Uploader Method

The fields exported to the S3 file will depend on the Fields to Export option in the job configuration Any user field in your Lytics account may be available for export.

Follow these steps to set up and configure an export of user profiles to S3 in the Lytics platform. If you are new to creating jobs in Lytics, see the Jobs Dashboard documentation for more information.

1. Select Amazon Web Services from the list of providers.
2. Select the Export Audiences job type from the list.
3. Select the Authorization you would like to use or create a new one.
4. Enter a Label to identify this job you are creating in Lytics.
5. (Optional) Enter a Description for further context on your job.
6. From the Audience Name drop-down list, select the Lytics audience you want to export.
7. From the S3 Bucket Name drop-down list, select the bucket you wish to export to from the drop down. If you do not select an option from this drop-down you must enter a bucket in the text field below.
8. (Optional) In the S3 Bucket Name (Alt) box, you can enter the name of the bucket you want to export to if it is not available in the drop-down above.
9. From the Directory drop-down list, select the directory that you would like to save your files in.
10. (Optional) In the Email to box,enter an email address, to recieve a link to the completed file.
11. From the File Type drop-down list, select the type of file(s) you want to export.
    • CSV: the file will be a flat CSV, list and map fields will be joined by &
    • Multi-CSV: multiple files will be created; scalar values and non-scalar values will be in diffenent files. A separate file will be created for each non-scalar field that maps the various values to its user. Each user will be assigned a join key that can be used to join data accross multiple files. This join key can is based on the BY fields of the user and can change between exports.
    • JSON: The users will be exported as a JSON file.
12. Select the Additional Segments checkbox to add an additional field containing the full list of audiences the user is a member of. Selecting this option may extend the time it takes for the export to complete.
13. Additional Configuration options are available by clicking on the Show Advanced Options tab.
14. (Optional) From the Compress drop-down list, select a compression method for the file.
15. In the Filename box, enter the name of the destination file. You can use {TIMESTAMP} in this name, and it will be replaced with the timestamp at the time of the export. By default, the filed is exported with the name lytics-events-{TIMESTAMP}.
16. (Optional) From the Timestamp format drop-down list, select the format for the timestamp in the filename. MM = month, mm = minute
17. Select the Include Headers checkbox to include field names as the first row of the CSV (this is selected by default).
18. Use the Fields to Export input to select the user fields to include in the exported file. If left blank all fields will be included.
19. In the User Limit box, enter the maximum number of users to export. If left blank all users will be exported.
20. (Optional) Select the Keep Updated to run the export repeatedly.
21. (Optional) From the File Export Frequency drop-down list, select the frequency to run the export, if Keep Updated is selected.
22. (Optional) From the Time of Day drop-down list, select the time of day for the export work to be scheduled, if Keep Updated is selected. Note: The export will run once within a few minutes of clicking Start Export, each run after that will be started at the selected time.
23. (Optional) Timezone drop-down list, select the timezone for the Time of Day.
24. Click Start Export.