Documentation / Product / Integrations / Salesforce / Salesforce Marketing Cloud

Salesforce Marketing Cloud: Import Subscriber and Activity

Importing subscribers and activity data from Marketing Cloud results in new users or existing user profiles supplemented with Marketing Cloud campaign activity data. You can use this data to build and refine your existing Lytics audiences to power better, cross-channel campaigns.

Integration Details

Implementation Type: Server-side.
Implementation Technique: REST API and SOAP API.
Frequency: Batch (scheduled hourly by default).
Resulting data: User profiles.

This integration utilizes both the Marketing Cloud REST and SOAP APIs to pull in subscriber and event data.

Every hour the job will scan for new subscribers via the SOAP retrieve call for SubscriberList to pull in new subscribers for the imported lists and written to the sfmc_subscribers data stream in Lytics.
If importing subscriber attributes is selected, full Subscriber is retrieved and written to the sfmc_subscribers data stream in Lytics. Note: subscriber attributes are only imported on the initial import, or if the subscriber list membership is updated. If list subscription is not updated, Lytics will not get new subscriber attribute updates.
Every hour, if activity data import is selected, activity data since the last run is retrieved through the SOAP retrieve endpoints for each of the following events, BounceEvent, ClickEvent, ForwardEmailOptInEvent, FowardEmailEvent, OpenEvent, SentEvent, SurveyEvent, and UnsubEvent. All activity data is written to the sfmc_events data stream in Lytics.
If historical subscriber or activity data is selected to be imported, the above calls are repeated for a days worth a data at a time, going backward in time, until all selected historical data is imported.

Fields

sfmc_events fields

The following fields are included in the default mapping of the sfmc_events stream:

Source Field	Lytics User Field	Description	Type
subscriber_key	sfmc_subscriber_keys `unique id`		[]string
	channels	All Channels Used	[]string
url	hashedurls	Hashed Urls Visited	map[string]intsum
	last_active_ts	Last Active	date
	last_channel_activities	Last Activity By Channel	map[string]time
bounce_category	sfmc_bounce_category	SFMC Bounce Category	string
bounce_type	sfmc_bounce_type	SFMC Bounce Type	string
campaign_name	sfmc_campaign_name	SFMC Campaign Name	string
url	sfmc_click_urls	SFMC Urls Clicked on	[]string
event_type	sfmc_clickct	SFMC Click Count	int
event_type	sfmc_events		map[string]intsum
	sfmc_firstclick_ts	SFMC First Click	date
	sfmc_firstopen_ts	SFMC First Open	date
	sfmc_hourlyopen	SFMC Hourly Opens	map[string]intsum
	sfmc_hourofweek	SFMC Hour of Week Events	map[string]intsum
	sfmc_lastclick_ts	SFMC Last Click	date
	sfmc_lastopen_ts	SFMC Last Open	date
list_name	sfmc_list_name	SFMC List Name	string
event_type	sfmc_openct	SFMC Open Count	int
opt_in_sub_key	sfmc_opt_in_sub_key	SFMC Forward Opt-In	string
send_id	sfmc_send_id	SFMC Send ID	string
event_type	sfmc_sendct	SFMC Send Count	int
smtp_reason	sfmc_smtp_bounce_reason	SFMC SMTP Bounce Reason	string
survey_answer	sfmc_survey_answer	SFMC Survey Answer	string
survey_question	sfmc_survey_question	SFMC Survey Question	string
	sfmc_unsub_ts	SFMC Unsub date	date
	sfmc_yymm	SFMC Opens By Month	map[string]intsum
send_id	total_clicks_by_message	The number of clicks for a message	map[string]intsum
send_id	total_opens_by_message	The number of opens for a message	map[string]intsum

sfmc_subscribers fields

The following fields are included in the default mapping of the sfmc_subscribers stream:

Source Field	Lytics User Field	Description	Type
subscriber_key	sfmc_subscriber_keys `unique id`		[]string
email	email `unique id`		string
subscriber_id	sfmc_subscriber_ids `unique id`		[]string
email	emaildomain	Email Domain	string
business_id	sfmc_business_id	SFMC Business ID	string
business_name	sfmc_business_name	SFMC Business Name	string
created_date	sfmc_created_date	SFMC Created Date	date
list_id, status	sfmc_list_ids_status	Subscription Status by List ID	map[string]string
list_name, status	sfmc_list_name_status	Subscription Status by List Name	map[string]string

Configuration

Follow these steps to set up and configure an import of Marketing Cloud subscriber data and activity into the Lytics platform. If you are new to creating jobs in Lytics, see the Jobs Dashboard documentation for more information.

Select Salesforce Marketing Cloud from the list of providers.
Select the Import Subscribers and Activity job type from the list.
Select the Authorization you would like to use or create a new one.
Enter a Label to identify this job you are creating in Lytics.
(Optional) Enter a Description for further context on your job.
Select what data you would like to import from Salesforce Marketing Cloud, Subscribers and/or Activity.
Click to Show Advanced Options to reveal additional settings.
- Business Units: Use this input to select a set of Salesforce Marketing Cloud business units to import. Business unit available to be imported from Salesforce Marketing Cloud are located in the left column. Business units added to the right column will be imported into Lytics. Leave the right column empty to import from all business units. Depending on your authorization settings, leaving empty may cause the import to pull in the All subscriber list from Salesforce Marketing Cloud. To ensure importing from only the business units available to the selected authorization, you must select all the listed business units.
- Get Custom Subscriber Attributes: Select to import custom subscriber attributes. This will cause your imports to take a longer time.
- Subscriber Properties: Select the subscriber properties to import. One of subscriber key or ID must be selected. Properties in the left column are Salesforce Marketing Cloud properties available to import. Properties in the right column will be imported into Lytics. If no properties are selected, all properties will be imported.
- Subscriber Backfill Start Date: Use in conjunction with Subscriber Backfill End Date to import a set of subscribers who already exist in Salesforce Marketing Cloud. Enter a date string, for example 2019-05-11, in the text box. All subscribers created beginning on this date until the end date will be imported into Lytics.
- Subscriber Backfill End Date: Use in conjunction with Subscriber Backfill Start Date to import a set of subscribers who already exist in Salesforce Marketing Cloud. Enter a date string, for example 2019-05-11, in the text box. All subscribers created before this date but after the start date will be importing into Lytics.
- Activity Backfill Start Date: Use in conjunction with Activity Backfill End Date to import a set of activity data that already exists in Salesforce Marketing Cloud. Enter a date string, for example 2019-05-11, in the text box. All activity recorded beginning on this date until the end date will be importing into Lytics. NOTE: Importing more than 6 months of activity data can slow down processing time with little actionable benefit.
- Activity Backfill End Date: Use in conjunction with Activity Backfill Start Date to import a set of activity data that already exists in Salesforce Marketing Cloud. Enter a date string, for example 2019-05-11, in the text box. All activity recorded before this date but after the start date will be importing into Lytics.
- Activities: Use this input to select a subset of Salesforce Marketing Cloud activities to import. In most cases you can leave the right column empty to import all activities. Activities in the left column are Salesforce Marketing Cloud activities available to import. Activities in the right column will be imported into Lytics. NOTE: In large accounts importing all activities, particularly Opens may cause the activity import to not keep up in real time.
Click Start Import.

Salesforce Marketing Cloud data should start populating in Lytics within a few minutes.