Bundle connector reference

This reference explains in detail how to combine data extracts from separate datastreams into a data extract.

Introduction

The Bundle connector combines data extracts from separate datastreams into a single extract file.

Limitations

Twitter Engagements data extracts cannot be included in Bundle datastreams.

Access Bundle configuration

To configure the Bundle connector, follow these steps:

1. Select the workspace you work with in Adverity and then, in the platform navigation menu, click Datastreams.

2. Select the Bundle datastream.

3. In the top navigation panel, click Settings.

Configuring which data extracts to combine

Bundle matches the data extract files to be combined in one of the following ways:

• Pattern - This option looks at the names of the data extract files to find similarly named data extracts.

• Created Date - This option matches data extract files by looking at the date on which they were created.

• Scheduled Date - This option matches data extract files based on the date range of the fetched data.

Pattern

The Pattern option matches the data extract files by looking at the names of the extract files and combining those with similar file names. This is achieved using regular expressions. When selecting this option, you must provide a regular expression in the Extract pattern field (a default regular expression is provided).

Keep the default settings to ensure Bundle combines the data extract files successfully. These default settings are as follows:

• For each of the datastreams with data extracts to combine, enable the option Local Data Retention > Extract Filenames > Unique by day. For more information, see Configuring advanced datastream settings.

• In the Extract Pattern field, keep the following regular expression: ^.*-%Y%m%d.*\.csv$.

These default options allow Bundle to match data extract files with the same date in their file names and combine them into a single data extract.

To match the data extract file names using another approach, enter a regular expression in the Extract Pattern field.

Created Date

This option matches the data extracts by the date of data extract creation. The created date is the date on which the data was collected. For example, data extract with a date range of 2021-03-01 to 2021-03-10 fetched on 2021-04-01, has the 2021-04-01 as created date of the data extract.

Scheduled Date

This option matches the data extract by the date range of the fetched data. The scheduled date is the start date of a data extract's date range. For example, data collected within the date range of 2021-03-01 to 2021-03-10 with a data fetch that took place on 2021-04-01, then the scheduled date of the data extract would be 2021-03-01.

The data extract scheduled date is found in the data extract metadata. For more information on viewing data extract metadata, see Using placeholders.

Including datastreams from parent workspaces in Bundle

When setting up Bundle connector, you select the workspace which contains the datastreams with data you wish to combine into a single data extract. If this workspace is a child workspace you can select datastreams from the parent workspace.

To include datastreams that belong to parent workspaces in the Bundle connector, follow these steps:

1. In the top left corner, click Select Workspace.

2. From the list, select the parent workspace that contains the datastreams to include in Bundle.

3. In the left navigation panel, click Datastreams.

4. Click the datastream to include in Bundle.

5. In the top navigation panel, click Settings.

6. Select the Share with children checkbox.

As a result, you can now select the datastream that belongs to the parent workspace when configuring the Bundle connector in any of its child workspaces.

Configuring Bundle's Data Mapping options

Bundle has the ability to apply Data Mapping when combining multiple data extracts into a single file. When configuring the Bundle connector, select the Apply Data Mapping checkbox to apply Data Mapping.

Set up Data Mapping on the individual datastreams before running Bundle to combine the data extracts.

If Data Mapping is to be applied during the data extract file combination, the following will occur:

• Mapped columns from different datastreams are combined into a single column. For example, the mapped columns of campaignName, campaign and ga:campaign from three separate datastreams are combined into the single column of campaign_name.

• Two new columns are added to the Bundle data extract file, these are as follows:

  • dt_datastream_name - This is the name given to the datastream. For example, Facebook Ads Insights - Q4 2020.

  • dt_datasource - This is the name of the data source. For example, Facebook Ads Insights.

The Apply Data Mapping feature is optional. If the Apply Data Mapping checkbox is not selected then all the columns in the multiple data extracts are displayed with their original names in the combined data extract.

Appendix

This section includes additional details of Bundle connector reference.

• A data extract creation date is not the same as the scheduled date. For example, data extract with a date range of 2021-03-01 to 2021-03-10 fetched on 2021-04-01.

  • The data extract creation date is 2021-04-01.

  • The data extract scheduled date is 2021-03-01.