Looping Over Twitter Search Terms with ForEachAdoLoop
Extend the BigData Twitter snippet so a single Biml package iterates over a configurable list of search terms.
Extend the BigData Twitter snippet so a single Biml package iterates over a configurable list of search terms.
Calls the legacy Twitter search Atom feed from a custom ScriptComponentSource using a 'SearchTerm' package variable, then writes new tweets above the last-seen TweetNumber to a 'dbo.TwitterLog' table via OleDbDestination.
Pulls RSS items from a configurable feed URL via a custom ScriptComponentSource, runs them through a Lookup against an existing log table to filter out items already loaded, and persists new entries into 'dbo.RSSFeedReader' via an OleDbDestination.