2 docs tagged with "bigdata"

Calls the legacy Twitter search Atom feed from a custom ScriptComponentSource using a 'SearchTerm' package variable, then writes new tweets above the last-seen TweetNumber to a 'dbo.TwitterLog' table via OleDbDestination.

Pulls RSS items from a configurable feed URL via a custom ScriptComponentSource, runs them through a Lookup against an existing log table to filter out items already loaded, and persists new entries into 'dbo.RSSFeedReader' via an OleDbDestination.