Top companies trust Datastreamer to integrate, enrich, join, and apply their web data needs.
How Datastreamer works
Quickly apply Tisane Topic Extraction to Open Measures Odnoklassniki with a Datstreamer Pipeline.
Quickly connect Tisane Topic Extraction and Open Measures Odnoklassniki with a Datstreamer Pipeline.
Web data is the starting point for any pipeline. You can use any number of data sources to power your Pipelines. You can use web data from our partner network, your own systems, or any web data.
To accelerate using your web data, you can apply any number of operations to the data. Enrich, augment, join, structure, filter, storage, search, or more! Datastreamer has hundreds of plug-and-play operations that you can apply.
With Datastreamer it’s never been easier to use web data. You can dynamically expand your Pipelines with more capabilities, and you’ve now been able to solve your operational bottlenecks in working with web data.
Also known as: theme identification, subject detection, or key topic recognition. Topic extraction determines the dominant topics in the text.
Tisane provides the topics at a document level.
When a particular word has multiple interpretations, the sense of the word must be determined in the current context. For example, Jupiter is a planet and a Roman deity. Whether it's the planet or the deity, depends on the text.
For example, the sentence Juno is the wife of Jupiter refers to the deity. Tisane determines the relevant topics as Roman mythology, supernatural (gods), relationship, and family (since the spousal connection is mentioned).
There are common taxonomy standards that Tisane can provide::
native - native Tisane topic names; based on standard English terms for the topic. The default standard.iptc_code - codes of the IPTC (International Press Telecommunications Council) Media Topics classification - a standard used in the media.iptc_description - English descriptions of the IPTC codes.iab_code - codes of the IAB (Interactive Advertising Bureau) content taxonomy.iab_description - English descriptions of the IAB codes.wikidata - Wikidata codes (usually of the form Qnnnnn, e.g. Q123).Open Measures collection on OK(Odnoklassniki) began by aggregating around 5,000 OK group URLs that appeared across the existing collections and fed these into the crawler. The crawler then spiders across these groups by collecting posts, comments and group members.
Add Datastreamer components to your data stack and explore its full capabilities