Twitter Streaming Query

On this Page

Snap type:

Read


Description:

This Snap streams the Tweets based on the search keyword for the authenticated user. Streamed Tweets are written to the output view and are available for downstream Snaps immediately. The output format is JSON.

  • Expected upstream Snaps: [None].
  • Expected downstream Snaps: Any file formatter, followed by File Writer. A Structure Snap can be used to carry forward only required fields for downstream Snaps.
  • Expected input: Search keyword and timeout in seconds is required. Time out can be 0 for never or any non-zero value.
  • Expected outputTweets containing given search keyword.


Prerequisites:

[None]


Support and limitations:Works in Ultra Task Pipelines.
Account: 

This Snap uses account references created on the Accounts page of SnapLogic Manager to handle access to this endpoint. See Configuring Twitter Accounts for information on setting up this type of account. It is recommended that you edit the account and reauthorize old expired or invalid accounts.


Views:
InputThis Snap has at most one document input view; the input data can be provided in input view or in the properties.
OutputThis Snap has exactly one document output view.
ErrorThis Snap has at most one document error view and produces zero or more documents in the view.

Settings

Label


Required. The name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your pipeline.

Search by keyword  


The keyword to be searched on Twitter. 

Timeout in seconds


Required. The time out parameter for streaming Tweets on Twitter.

This setting may be used to control the behavior of this Snap in terms of the number of seconds it should listen for Tweets to be pushed from Twitter. If left at the default of 60 seconds, the Snap will wait 60 seconds before gracefully shutting down (and depending on the configuration of the overall pipeline, may cause the entire pipeline to stop). Longer durations may be used, as may a number of 0 (zero). If you use 0, the Snap will run indefinitely, waiting on incoming Tweets, and the Snap will not terminate itself. To stop a pipeline which is listening indefinitely, the "Stop Pipeline Execution" functionality should be used in the Designer or Dashboard. In the event of receiving a termination instruction, the Snap will stop listening and close its connection to Twitter, before closing its output stream and stopping. Any downstream Snaps will also be terminated and their connections closed.

Default: 60

Snap Execution

Select one of the three modes in which the Snap executes. Available options are:

  • Validate & Execute: Performs limited execution of the Snap, and generates a data preview during Pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during Pipeline runtime.
  • Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.
  • Disabled: Disables the Snap and all Snaps that are downstream from it.

Example


An example of a Twitter Streaming Search Snap is described using a use case.  

Download the sample pipeline: Twitter Stream. In this pipeline, a Twitter stream is searched against a keyword (SnapLogic), and the results are sorted and written to a file. As this pipeline is configured to run on a recurring basis, when the pipeline is run again, the latest search is combined with the data in the file, the data is sorted and duplicate entries are removed. 

Download

  File Modified

File Twitter Stream.slp

Apr 06, 2017 by Diane Miller

Snap Pack History

 Click to view/expand
ReleaseSnap Pack VersionDateTypeUpdates
4.26main11181 StableUpgraded with the latest SnapLogic Platform release.
4.25main9554 StableNo updates made.
4.24424patches8617 Latest

Fixes the error handling issue in the PostTweet Snap, where data and error are now routed to the error view.

4.24main8556
 
Stable

Upgraded with the latest SnapLogic Platform release.

4.23main7430
 
StableUpgraded with the latest SnapLogic Platform release.
4.22main6403
 
StableUpgraded with the latest SnapLogic Platform release.
4.21snapsmrc542
 
StableUpgraded with the latest SnapLogic Platform release.
4.20snapsmrc535
 
StableUpgraded with the latest SnapLogic Platform release.
4.19snapsmrc8338 Latest

Fixed the broken doc link for the PostDirectMessage Snap.

4.19snaprsmrc528
 
StableUpgraded with the latest SnapLogic Platform release.
4.18snapsmrc523
 
StableUpgraded with the latest SnapLogic Platform release.
4.17ALL7402
 
Latest

Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers.

4.17snapsmrc515
 
Stable

Added the Snap Execution field to all Standard-mode Snaps. In some Snaps, this field replaces the existing Execute during preview check box.

4.16snapsmrc508
 
StableUpgraded with the latest SnapLogic Platform release.
4.15snapsmrc500
 
StableUpgraded with the latest SnapLogic Platform release.
4.14snapsmrc490
 
StableUpgraded with the latest SnapLogic Platform release.
4.13

snapsmrc486

 
Stable

Upgraded with the latest SnapLogic Platform release.

4.12

snapsmrc480

 
StableUpgraded with the latest SnapLogic Platform release.
4.11snapsmrc465
 
StableUpgraded with the latest SnapLogic Platform release.
4.10

snapsmrc414

 
StableUpgraded with the latest SnapLogic Platform release.
4.9

snapsmrc405

 
Stable

Upgraded with the latest SnapLogic Platform release.

4.8

snapsmrc398

 
StableUpgraded with the latest SnapLogic Platform release.
4.7

snapsmrc382

 
StableUpgraded with the latest SnapLogic Platform release.
4.6

rcmsf233

 
StableUpgraded with the latest SnapLogic Platform release.
4.5.1

twitter1579

 
StableUpdated the Twitter Streaming Search Snap with a timeout of 10 seconds for preview if the original value provided is zero or more than 30 seconds. For more information, see Twitter Streaming Search.
4.5rcmsf231 StableDoc Enhancement: Examples added to Twitter Snap documentation.
4.2.2NA

Updated messages within the Snap Pack.
July/Summer 2014NA

Twitter Query enhanced to support until, since_id, and max_id.
June 30, 2014NA

  • NEW! Twitter Streaming Search Snap. This Snap streams tweets based on a keyword.
  • Addressed the following issues:
    • Twitter Lookup Snap errors out if an expression was used for the screen-name or user-id
    • Twitter Query null pointer exception
March 2014NA

The Twitter Snap Pack was expanded with the addition of Get Direct Messages, Get Tweets, Lookup, Post Direct Message, and Post Tweet.
January 2014NA

Twitter Query updated.

June 2013NA

Introduced in this release.