Documentation / Product / Integrations / Amazon Web Services / AWS S3

AWS S3: CSV Event Export

Export events into S3 so you can access, archive, or run analysis on Lytics events in the AWS S3 ecosystem.

Integration Details

  • Implementation Type: Server-side.
  • Type: REST API.
  • Frequency: One-time or scheduled batch which may be hourly, daily, weekly, or monthly depending on configuration.
  • Resulting Data: Raw events exported to a CSV file format.

This integration uses the Amazon S3 API to read the CSV file selected. Each run of the workflow will proceed as follows:

  1. Create a file with the configured file name.
  2. Start a multi-part upload in S3.
  3. Read events from the stream selected. If the export is configured to run periodically, only the events since the last run of the export will be included.
  4. Compress event data, if selected in the export's configuration.
  5. Write the event data to S3.
  6. Check that the upload has completed after the last event before the start of the export is written.

Fields

The fields included depend on the raw event in Lytics data. All fields in the selected stream will be included in the exported CSV. To see a list of fields in a stream, select the stream name in the dropdown from Data > Data Streams in the Lytics platform.

Configuration

Follow these steps to set up and configure an export of event data to AWS S3 in the Lytics platform.

  1. From Data > Integrations Select the Amazon Web Services tile. aws
  2. Click on New workflow button.
  3. Select CSV Event Export workflow.
  4. Select the authorization you created during the authorization step.
  5. (Required) In the S3 Bucket Name drop-down list, select the bucket you wish to export to from the drop down. If you do not select an option from this drop-down you must enter a bucket in the text field below.
  6. (Optional) In the S3 Bucket Name (Alt) box, you can enter the name of the bucket you want to export to if it is not available in the drop-down above.
  7. (Required) From the Directory drop-down list, select the directory that you would like to save your files in.
  8. (Required) Use the Data Streams to Export input to select data streams to export. A stream is a single source/type of data (you may choose more than one). If none are selected, all streams are exported.
  9. (Optional) In the Email to box,enter an email address, to recieve a link to the completed file.
  10. (Optional) From the Compress drop-down list, select a compression method for the file. Configuration
  11. Additional Configuration options are available by clicking on the Show Advanced Options tab.
  12. (Required) In the Filename box, enter the name of the destination file. You can use {TIMESTAMP} in this name, and it will be replaced with the timestamp at the time of the export. By default, the filed is exported with the name lytics-events-{TIMESTAMP}.
  13. (Optional) From the Timestamp format drop-down list, select the format for the timestamp in the filename. MM = month, mm = minute
  14. (Required) Select the Include Headers checkbox to include field names as the first row of the CSV (this is selected by default).
  15. (Optional) Select the Keep Updated checkbox to run the export repeatedly.
  16. (Optional) From the File Export Frequency drop-down list, select the frequency to run the export, if Keep Updated is selected.
  17. (Optional) From the Time of Day drop-down list, select the time of day for the export work to be scheduled, if Keep Updated is selected. Note: The export will run once within a few minutes of clicking Start Export, each run after that will be started at the selected time.
  18. (Optional) Timezone drop-down list, select the timezone for the Time of Day. AWS S3 export event cfg adv
  19. Click the Start Export button when you're ready to begin the export.