This Snap allows you to fetch data from a database by providing a table name and configuring the connection. The Snap produces the records from the database on its output view which can then be processed by a downstream Snap.
ETL Transformations & Data Flow
This Snap enables the following ETL operations:
Fetch data from an existing Redshift table using the user configuration, and feed it to downstream Snaps.
JSON paths can be used in a query and will have values from an incoming document substituted into the query. However, documents missing values for a given JSON path will be written to the Snap's error view. After a query is executed, the query's results are merged into the incoming document overwriting any existing keys' values. The original document is output if there are no results from the query.
Queries produced by the Snap have an equivalent format:
SELECT * FROM [table] WHERE [where clause] ORDER BY [ordering] LIMIT [limit] OFFSET [offset]
If more powerful functionality is desired, then the Execute Snap should be used.
Input & Output
- Input: This Snap can have an upstream Snap that can pass a document output view such as Mapper or JSON Generator.
- Output: A document or a set of documents that contains the result of query for each input document. If no input document is provided, the query will be done only once.