Integrate Netcore with Amazon S3
This guide helps you integrate Netcore with Amazon S3.
This document outlines integrating your Netcore CE dashboard with Amazon S3 for seamless data export and analysis. This integration allows you to export campaign, journey, and on-site messages related to performance reports directly to your designated Amazon S3 bucket. This guide helps you configure your S3 bucket on the Netcore CE dashboard and use the reports to analyze further your ongoing campaigns, journeys, and on-site messages.
To set up and use the S3 bucket, you need to go through the following three major phases:
- Prerequisites
- Setup using IAM Policy Method
- Setup using Access Key Method
- Use of the activated connection
Prerequisites
Ensure the following prerequisites are fulfilled to enable this integration.
- Creation of a S3 bucket (on the AWS platform)
- Login to your AWS Console and search for AWS S3 , which takes you to the Bucket page.
- Click Create Bucket and provide details for Bucket Name, AWS S3 Bucket Region.
- Navigate here, to get your Access Key and Secret Key.
- Click Create Bucket and a success message appears.
- You can follow either of the two methods to configure your S3 bucket:
IAM Policy Method
Activation of the Integration
- Log into the Netcore CE dashboard and navigate to Settings.
- Click Integration > Cloud Storage Platform > Amazon S3. The integration modal opens up.
- Click Add Integrate and provide Connection Name.
- Enter the Bucket Name as specified in your AWS S3 setup.
- Specify the Bucket Path using the following naming convention, "bucket name/folder name/subfolder name."
- Select the Region from the dropdown menu, such as us-west-2, in-2, in-1, and so on.
- Select the email addresses from the dropdown menu in the Alert Email field. These email addresses receive notifications if issues arise during the ongoing export process.
- Select the IAM Policy button; relevant credentials appear below.
- Copy the policy code snippet provided.
- Navigate to AWS Console and select the bucket from the Bucket page.
- Navigate to Permissions > Bucket policy .
- Click Edit under the Bucket Policy section and enter the copied policy code snippet.
- Click Save changes to update the policy.
- Click the Activate button, and a test file is sent to the S3 bucket configured on the dashboard.
Note
When the file is successfully sent, the integration is activated immediately. If it fails, AWS sends an error response that is displayed on the Netcore CE dashboard, helping the user understand the issue and adjust the credentials.
Access Key Method
To fetch the Access Key, you need to follow the steps on the AWS console before entering them on the Netcore CE dashboard:
Set-up on the AWS Console:
- Navigate to AWS Console > S3.
- Select the bucket you wish to configure. Click on your bucket list and click Security Credentials.
- Navigate to Users > Add User.
- In the Add User section, enter your User name and select the Programmatic access checkbox. Click Next: Permissions, and the Set Permission appears.
- Click Create Group > Create policy When you click it, the Create Policy page opens in a new tab.
- Click the JSON tab and then paste the code snippet provided below:
{
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Action": [
"s3:ListBucket"
],
"Resource": [
"arn:aws:s3:::sample-bucket"
]
},
{
"Effect": "Allow",
"Action": [
"s3:PutObject"
],
"Resource": [
"arn:aws:s3:::sample-bucket/*"
]
}
]
}
Warning
Replace all instances of
sample-bucket
with the actual bucket name you created.
- Click Next: Tags > Next: Review, and the Create Policy page appears.
- Include a policy name in this section and click Create policy.
- Navigate to the Create Group tab and search for the policy you created. Assign this new policy to the new group. A success message appears on your S3 console.
- Navigate to Create Group and search for the policy name you provided in Step 8.
- Assign this policy to the new group.
- Click Create Group, and the page to add users appears.
- Click Next: Tags > Next: Review > Create User.
Success!
The Access Key and Secret Key to your S3 bucket are now visible.
You can download these credentials as a .csv file on your device or note them down and have them ready when configuring the S3 bucket on the Netcore CE Dashboard.
Set-up on the Netcore CE dashboard:
- Log into the Netcore CE dashboard and navigate to Settings.
- Click Integration > Cloud Storage Platform > Amazon S3. The integration modal opens up.
- Click Add Integrate and provide Connection Name.
- Enter the Bucket Name as specified in your AWS S3 setup.
- Specify the Bucket Path using the following naming convention: "bucketname/foldername".
- Select the Region. Choose the appropriate region from the dropdown menu. Examples: us-west-2, in-2, in-1, and so on.
- Select the email addresses from the dropdown menu in the Alert Email field. These email addresses receive notifications if issues arise during the ongoing export process.
- Select the Access Key button, and relevant details appear below
- Enter the Access Key
- Enter the Secret Key
- Click the Activate button, and a test file will be sent to the S3 bucket configured on the dashboard.
Note
When the file is successfully sent, the integration is activated immediately. If it fails, AWS sends an error response that is displayed on the Netcore CE dashboard, helping the user understand the issue and adjust the credentials.
Use of the Activated Integration
Campaign Report Export
- Log in to the Netcore CE dashboard and navigate to Campaigns. Then click the Download Reports icon.
- Select the specifications for the data to be exported.
- Choose AWS S3 from the dropdown menu.
- Select the Connection Name from the list or create a new connection.
- Select the export frequency (Daily, Weekly, Monthly).
Journey Report Export
- Log into the Netcore CE dashboard and navigate to Engage > Journeys.
- Click the Download reports icon.
- Select the specifications for the data to be exported.
- Choose S3 from the dropdown menu.
- Select the Connection Name from the list or create a new connection.
- Select the export frequency (Daily, Weekly, Monthly).
On-site Messages
- Log into the Netcore CE dashboard and navigate to Engage > On-site Messages.
- Click the Download reports icon.
- Select the specifications for the data to be exported.
- Choose S3 from the dropdown menu.
- Select the Connection Name from the list or create a new connection.
- Select the export frequency (Daily, Weekly, Monthly).
Editing of integration
- Log into the Netcore CE dashboard.
- Navigate to the Settings > Integration > Connected.
- Find the active connection.
- Click on the three dots and select View.
- You can edit the emails from the Alert Emails list in the View Section.
- Click Save.
Deactivation of Integration
- Log into the Netcore CE dashboard.
- Navigate to the Settings > Integration > Connected.
- Find the active connection to be deactivated.
- Click Deactivate.
Note
The user is warned that the ongoing exports will be stopped if the connection is deactivated or deleted, with a list of the ongoing exports.
Reactivation of Integration
- Log into the Netcore CE dashboard.
- Navigate to the Settings > Integration > Connected.
- Find the deactivated connection to be reactivated.
- Click Reactivate. The status changes to Activated.
Frequently Asked Questions
Q. How to get the Bucket Name?
A. In the AWS Console, open the S3 section. Here, a list of your buckets is present and when you click on your bucket, the name of this bucket is mentioned at the top. Another method to find out the bucket name is to go to the Properties section of your bucket. Look for the S3 ARN here, and in the link arn:aws:s3:::sample-bucket
, the instance sample-bucket
will be your bucket name.
Q. How to enter the Bucket Path?
A. To enter the Bucket Path, use the following nomenclature: bucket name/folder name/subfolder name
and enter the relevant information under each section, if applicable.
Updated 9 days ago