Microsoft Azure: Export Events (Blob Storage)

Export events into Azure Blob Storage so you can access, archive, or run analysis on Lytics events in the Azure ecosystem.

• Implementation Type: Server-side.
• Implementation Technique: REST API
• Frequency: One-time or scheduled batch which may be hourly, daily, weekly, or monthly depending on configuration.
• Resulting data: raw event data exported to a CSV file format.

This integration uses the Azure Blob Service REST API to write CSVs to the configured container in Azure Blob Storage. Each run of the job will proceed as follows:

1. Create a blob with the configured file name.
2. Read events from the configured Lytics data streams. If the export is configured to run periodically, only the events since the last run of the export will be included.
3. PGP encrypt the CSV if a PGP key is provided in the Azure authorization.
4. Compress the CSV, if selected in the export's configuration.
5. Write the event data to Azure Blob Storage by PUTing blocks of data.

The fields included depend on the raw event in Lytics data. All fields in the selected stream will be included in the exported CSV. To see a list of fields in a stream, select the stream name in the dropdown from Data > Data Streams in the Lytics platform.

Follow these steps to set up and configure an export job for Microsoft Azure in the Lytics platform. If you are new to creating jobs in Lytics, see the Jobs Dashboard documentation for more information.

1. Select Microsoft Azure from the list of providers.
2. Select the Export Events (Blob Storage) from the list.
3. Select the Authorization you would like to use or create a new one.
4. Enter a Label to identify the job you are creating in Lytics.
5. (Optional) Enter a Description for further context on your job.
6. Complete the configuration steps for your job.
7. From the Container input, select the Azure container that will hold the Blob.
8. From the Data Streams to Export input, select the event data streams to export, a stream is a single source/type of data (you may choose more than one). If none are selected, all streams are exported.
9. (optional) From the Compress input, select the compression type (gzip, zip, or none) of the file.
10. In the Filename input, enter the naming convention for the files. {TIMESTAMP} will be replaced with the current time of the export. The filename may include folder e.g.: /myfolder/myfile-{TIMESTAMP}. File extension e.g., .csv, .csv.gz will automatically be added.
11. (optional) From the Timestamp Format input, select the format for the {TIMESTAMP} in the filename. MM = month, mm = minute.
12. (optional) Select the Include Headers checkbox to include the field names as the first row of the exported file.
13. (optional) Select the Keep Updated checkbox to run this export continuously.
14. (optional) In the Start Date text box, enter events from this date onwards will be exported. Use yyyy-mm-dd format (2015-08-13).
15. (optional) In the End Date text box, enter events before, but NOT including this date will be exported. Use yyyy-mm-dd format (2015-08-13).
16. (optional) From the File Export Frequency input, select how often a continuous export should export a new file. Default is daily.
17. (optional) From the Time of Day input, select the time of day to run a Daily or Weekly export.
18. (optional) From the Timezone input, select the timezone for the time of day specified above.
19. Click Start Export.