Command Center Marketo Data Extractor Details

Connect to your account

The Command Center Marketo Data Extractor dxp file is used to connect and extract data from the Marketo REST API. This dxp file requires Spotfire Analyst with 'scripting' enabled.

Enter your Marketo information: Customer URL, Client ID, and Client Secret.   The 'Customer URL is also known as 'REST API Endpoint URL' & can be found within the Marketo Admin > Web Services panel.  To learn how to obtain your Client ID and Client Secret please refer to this (video) or the Marketo API doc.  Pressing the 'Get Started' button will automatically connect to the Marketo Rest API and display the following dashboard that will allow the configuration for extracting from the Bulk Activity table.

Bulk Activity Extraction Configuration

As shown, all 'Activities' are available for selection.  The ">>" and "<<" buttons allow for modification of the pre-populated list.  Data for the past '24 hours' or '7 days'.  The configuration allows data to be appended or replaced with the previously extracted data.  Selecting the 'Load Activities' button will launch the extraction job (batch scripts). 

The Activities extraction job consists of Creating the Job (based on the configuration), Starting the Job, Checking Updates (looping until the Job is 'Completed'), and Extracting the Job data.  The data extraction will take several minutes to complete.  The amount of time is dependent on the amount of data being pulled and the number of Jobs in the Marketo API Queue.  Once the data is downloaded, the Bulk Leads Extraction Configuration will get displayed.

Bulk Lead Extraction Configuration

The bulk Leads extraction configuration has a similar interface as the bulk Activities extraction configuration with the addition of being able to extract up to the last 30 days (updated date).  Like the Activities extraction,  selecting the 'Load Leads' button will launch the extraction job (batch scripts).  The Leads extraction job consists of Creating the Job (based on the configuration), Starting the Job, Checking Updates (looping until the Job is 'Completed'), Extracting the Leads Job data, Extract the Campaigns table, and removing any duplicate data.  The data extraction will take several minutes to complete.  The amount of time is dependent on the amount of data being pulled and the number of Jobs in the Marketo API Queue.  Once the data extraction is complete, all data is saved in the 'Data' folder as *.sbdf files and then the Data Overview is presented.

Data Overview

This Data Overview dashboard gives a high-level view of the currently loaded data (if 'Append' was used in the configuration, more than 7 days of data will be shown).  The 'Since yesterday...' visual shows KPIs only for the day since yesterday.  The 'Records currently loaded...' shows the number of records loaded by activity date and activity type; to see what 'activities' have the most data and on what days.  The 'Campaigns' chart shows the number of campaigns by date and type.  This dashboard is just intended to check the status of the data but can be customized and the results are stored in the 'Data' directory so the 'Command Center Dashboard' can leverage.

Bulk Job Diagnostics and Troubleshooting

The Job Status/Job Diagnostics dashboard allows for the analysis extraction of Bulk Extract Job (Activity & Leads).  The buttons at the top allow for the extraction of data and display the raw data table immediately below.  The outside bars give the total job counts for the last day (green - completed; blue-created;yellow-processing; gray-queued.  The middle bar/line charts give a daily trend of the total number of jobs, total data transferred, and average time to process/extract (respectively for Activities & Leads).