Skip to end of banner
Go to start of banner

DynamoDB Account

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 39 Next »

In this article

Overview

Use this account type to connect DynamoDB Snaps with data sources that use DynamoDB accounts. The account now supports the IAM role using the Authentication Types when setting up the account.

Prerequisites

None.

Limitations and Known Issues

None.

Account Settings

  • Asterisk ( * ): Indicates a mandatory field.

  • Suggestion icon ( (blue star) ): Indicates a list that is dynamically populated based on the configuration.

  • Expression icon ( (blue star) ): Indicates the value is an expression (if enabled) or a static value (if disabled). Learn more about Using Expressions in SnapLogic.

  • Add icon ( (blue star) ): Indicates that you can add fields in the field set.

  • Remove icon ( (blue star) ): Indicates that you can remove fields from the field set.

Field Name

Field Type

Field Dependency

Description

Label*

Default Value: None
Example: DynamoDB IAM Role

String

N/A

Specify a unique label for the account.

AWS Endpoint*

Default Value: None
Example: xyz876jhnJKBuya9730

String/Expression

 

N/A

Specify the AWS Endpoint URL. Refer to AWS Service Endpoints for more information.

AWS Region*

Default Value: None
Example: us-east-1

String/Expression

 

N/A

Specify the AWS region where the application is running from the allowed values.

Authenthication Type

Dropdown List

N/A

Select either of the following Authentication Types to create your DynamoDB Account:

  • User Credentials

  • IAM Role

Learn more about DynamoDB Account Configuration Scenarios.

Cross Account IAM Role settings are available in the Account settings dialog box regardless of the Authentication Type you choose.

AWS Access Key ID

Default Value: None
Example: us-east-1

String /Expression

Appears when you select User Credentials as Authentication Type.

Specify the Access Key ID associated with your AWS authentication.

AWS Secret Key

Default Value: N/A
Example: <Encrypted>

String/Expression

N/A

Specify the Secret Key associated with your AWS authentication.

AWS Security Token

Default Value: N/A
Example: <Encrypted>

String/Expression

N/A

Specify the Security Token to get access to AWS resources using credentials.

Cross Account IAM Role

Use this field set to configure the cross-account access. Learn more about - Setting up Cross-Account IAM Role.

Role ARN

Default Value: N/A
Example: arn:aws:iam::612864912850:role/EC2_to_assume_role

N/A

Specify the Amazon Resource Name (ARN) of the role to assume.

External ID

Default Value: N/A
Example: <Encrypted>

N/A

Specify an External ID that might be required by the role to assume.

DynamoDB Account Configuration Scenarios

Scenario

Groundplex Type

Role attached to EC2 instance

Authentication Type and other details

When the Groundplex type is an AWS EC2 and the role attached to the EC2 instance is the DynamoDB access role.

AWS EC2-type

DynamoDB access role.

Select Authentication Type as the IAM Role.

When the Groundplex type is an AWS EC2 and the role attached to the EC2 instance is the DynamoDB Cross-account access role.

AWS EC2-type

DynamoDB Cross-account access role.

Select Authentication Type as IAM the Role and provide details for the Cross-account IAM Role.

When you do not have an AWS-EC2 Groundplex and the role attached to the EC2 instance is the DynamoDB access role.

User does not have an AWS-EC2 Groundplex. Value is from local machine.

DynamoDB access role

Select the Authentication Type as User Credentials and provide details for the following fields:

  • AWS Access Key ID

  • AWS Secret Key

  • AWS Security Token (optional)

When you do not have an AWS-EC2 Groundplex and the role attached to the EC2 instance is the DynamoDB Cross-account access role.

User does not have an AWS-EC2 Groundplex. Value is from local machine.

DynamoDB Cross-account access role.

Select Authentication Type as User Credentials and provide details for the following fields:

  • AWS Access Key ID

  • AWS Secret Key

  • AWS Security Token (optional)

  • Cross-account IAM Role

DynamoDB Permissions

The ListTables permission requires all resources (*) to be selected (because it needs to be able to list all the DynamoDB tables), but the others can have policies that are more limited (for example, to a specific table) as per the DynamoDB API Permissions reference. Following is the most basic and permissive Policy document that could be assigned to the user that would guarantee all the required permissions are granted.

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Sid": "Stmt1482439123852",
      "Action": [
        "dynamodb:BatchGetItem",
        "dynamodb:BatchWriteItem",
        "dynamodb:DescribeTable",
        "dynamodb:ListTables",
        "dynamodb:Scan",
        "dynamodb:UpdateItem"
      ],
      "Effect": "Allow",
      "Resource": "*"
    }
  ]
}

Troubleshooting

Error

Reason

Resolution

Failed to validate account: Failed to connect to service endpoint.

The connection to the host failed.

Verify that the Cross-account IAM role is not attached to the EC2 instance. Refer to https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/2671280328/Configure+an+IAM+Role+in+a+DynamoDB+Account#Attach-IAM-Role-to-Instance for additional information.


Snap Pack History

 Click to view/expand
Release Snap Pack VersionDateType  Updates
May 2024main26341 StableUpdated and certified against the current SnapLogic Platform release.
February 2024main25112 StableUpdated and certified against the current SnapLogic Platform release.
November 2023main23721 StableUpdated and certified against the current SnapLogic Platform release.

August 2023

main22460

 


Stable

Updated and certified against the current SnapLogic Platform release.

May 2023main21015 StableUpgraded with the latest SnapLogic Platform release.

February 2023

main19844 StableUpgraded with the latest SnapLogic Platform release.
January 2023431patches19383 Latest

The DynamoDB Snap Pack supports the IAM role in the DynamoDB account.

November 2022main18944 StableUpgraded with the latest SnapLogic Platform release.
430 Patch430patches18355 LatestThe lineage for Ultra Pipelines containing the DynamoDB Bulk Get and DynamoDB Bulk Write Snaps is now preserved only when the Batch Size is 1.
430 Patch430patches18211 Latest

The DynamoDB Bulk Write Snap now does not fail with the Duplicate keys <table-name> are provided error when the Batch size or the Thread count is high.

August 2022main17386 StableThe DynamoDB Account includes AWS Security Token field to pass the security token when making calls using temporary credentials.
4.29 Patch429patches16169 Latest

Fixed an issue with the DynamoDB Snaps where the Snaps did not route the errors to the error view when the Snap encountered an exception and the Pipeline failed. Now the Snap route the errors to the error view and does not fail when it encounters an exception. If the error view is disabled, Snap stops the execution.

4.29 Patch

429patches15954 Latest

Enhanced the DynamoDB Account with AWS Security Token field to pass the security token when making calls using temporary credentials.

4.29main15993 Stable

Upgraded with the latest SnapLogic Platform release.

4.28main14627 StableUpgraded with the latest SnapLogic Platform release.

4.27

main12833

 StableUpgraded with the latest SnapLogic Platform release.
4.26426patches11593 LatestFixed an issue with the DynamoDB Update Snap, where the data type conversion for input keys caused an error.
4.26main11181 StableUpgraded with the latest SnapLogic Platform release.
4.25425patches10571 Latest

Updated the AWS SDK from version 1.11.688 to 1.11.1010 in the DynamoDB Snap Pack and added a custom SnapLogic User Agent header value.

4.25main9554
 
StableUpgraded with the latest SnapLogic Platform release.
4.24 Patch424patches9031 Latest
  • Supports autoscaling by adding retry logic with exponential backoff to the Snaps.
  • Enhanced the Dynamo DB Account  to support the expression enabler for account properties and creation of dynamic account.
  • Improved memory consumption in DynamoDB Bulk Write and Bulk Get Snaps.
4.24main8556
StableUpgraded with the latest SnapLogic Platform release.
4.23main7430
 
StableUpgraded with the latest SnapLogic Platform release.
4.22main6403
 
StableUpgraded with the latest SnapLogic Platform release.
4.21 Patch421patches5851 Latest

Removed the Snap timeout setting while waiting for the threads to complete processing.

4.21 Patchdynamodb8854 LatestFixed the DynamoDB Scan Snap pagination issue where the second page of output and beyond cannot be accessed during execution and validation.   
4.21snapsmrc542

 

StableUpgraded with the latest SnapLogic Platform release.
4.20 Patchdynamodb8709 Latest

Fixed the DynamoDB Scan Snap and the DynamoDB Update Snap where:

  • The DynamoDB Scan Snap is unable to produce a preview output on validation. (Instead, the Snap passes the output to the downstream Snap.)
  • The DynamoDB Update Snap produces two error documents for the same error during preview output.
4.20snapsmrc535
 
StableUpgraded with the latest SnapLogic Platform release.
4.19snaprsmrc528
 
StableUpgraded with the latest SnapLogic Platform release.
4.18 PatchMULTIPLE7778 Latest

Updated the AWS SDK library version to default to Signature Version 4 Signing process for API requests across all regions.

4.18snapsmrc523
 
StableUpgraded with the latest SnapLogic Platform release.
4.17ALL7402
 
Latest

Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers.

4.17snapsmrc515
 
Latest

Added the Snap Execution field to all Standard-mode Snaps. In some Snaps, this field replaces the existing Execute during preview check box.

4.16snapsmrc508
 
StableUpgraded with the latest SnapLogic Platform release.
4.15 Patchdynamodb6670 Latest

Added new functionality to the property Expression attribute values in the Delete Table Item, Scan, Update, and Bulk Get Snaps. The property now handles columns that are named after the DynamoDB reserve words.

4.15snapsmrc500
 
StableUpgraded with the latest SnapLogic Platform release.
4.14snapsmrc490
 
StableUpgraded with the latest SnapLogic Platform release.
4.13

snapsmrc486

 
StableUpgraded with the latest SnapLogic Platform release.
4.12

snapsmrc480

 
StableUpgraded with the latest SnapLogic Platform release.
4.11snapsmrc465
 
Stable

Added a new DynamoDB Query Snap with Secondary Index support.

4.10 Patchdynamodb3950 Latest

Resolved an issue with the DynamoDB Scan Snap which was not able to perform the scan operation on the table with huge amount of data (Actual description Error executing scan process, 0 after the 4.10 release)

4.10

snapsmrc414

 
Stable

DynamoDB ScanBulk WriteDelete Table Item and Update Snaps support the Set types (Binary, List and Map).

4.9 Patchdynamodb3329 Latest

DynamoDB Scan Snap - Fixed NPE during the Table name support.

4.9snapsmrc405
 
StableUpgraded with the latest SnapLogic Platform release.
4.8

snapsmrc398

 
Stable
  • Added the new Snaps DynamoDB Delete Table and DynamoDB Delete Table Item.
  • Info tab added to accounts.
  • Database accounts now invalidate connection pools if account properties are modified and login attempts fail.
4.7 Patchdynamodb2557 Latest

DynamoDB Bulk Get now writes the original object to error view and output view on error.

4.7 Patchdynamodb2279 Latest

Addressed a issue with generated signatures when non-ASCII data is used and ensured the original document is passed the Error View.

4.7

snapsmrc382

 
Stable

Updated the DynamoDB Bulk Get Snap with the new field, Batch Size.

4.6snapsmrc362
 
StableUpgraded with the latest SnapLogic Platform release.
4.5

snapsmrc344

 
Stable

All database Snaps have had updates in connection pooling.

4.4.1NA StableUpgraded with the latest SnapLogic Platform release.
4.4NA Stable
  • Resolved an issue with the DynamoDB account not validating if credentials did not have access to ListTables operation.
  • Added expression support to the Where clause property for Select Snaps.
4.3.2NA Stable
  • DynamoDB Bulk Write Snap now has Batch size and Request delay properties to help control the speed of the bulk write.
4.2.2NANAStable
  • Resolved an issue with the DynamoDB Scan Snap throwing an exception if Total segments was provided.
  • Resolved an issue with the DynamoDB Scan Snap not returning the specified attribute names list if Projection expression was set to an attribute name.
Related Content

  • No labels