Top companies trust Datastreamer to integrate, enrich, join, and apply their web data needs.
Find out the subjects the users are talking about. Classify content by topic. Intelligently deduce geographic region.
Super granular. Supports IPTC, IAB, and Wikidata IDs.
Also known as: theme identification, subject detection, or key topic recognition. Topic extraction determines the dominant topics in the text.
Tisane provides the topics at a document level.
When a particular word has multiple interpretations, the sense of the word must be determined in the current context. For example, Jupiter is a planet and a Roman deity. Whether it's the planet or the deity, depends on the text.
For example, the sentence Juno is the wife of Jupiter refers to the deity. Tisane determines the relevant topics as Roman mythology, supernatural (gods), relationship, and family (since the spousal connection is mentioned).
There are common taxonomy standards that Tisane can provide::
native - native Tisane topic names; based on standard English terms for the topic. The default standard.iptc_code - codes of the IPTC (International Press Telecommunications Council) Media Topics classification - a standard used in the media.iptc_description - English descriptions of the IPTC codes.iab_code - codes of the IAB (Interactive Advertising Bureau) content taxonomy.iab_description - English descriptions of the IAB codes.wikidata - Wikidata codes (usually of the form Qnnnnn, e.g. Q123).Open Measures collection on OK(Odnoklassniki) began by aggregating around 5,000 OK group URLs that appeared across the existing collections and fed these into the crawler. The crawler then spiders across these groups by collecting posts, comments and group members.
How Datastreamer works
Quickly apply Tisane Topic Extraction to Open Measures Odnoklassniki with a Datstreamer Pipeline.
For robust enterprise data integration, web data acts as a foundational source. It can be drawn from a variety of channels—including third-party partners, internal applications, and public web repositories.
Want to do more with your web data? Datastreamer offers hundreds of ready-to-use operations—filter, join, enrich, search, and more—to help you process and transform data at speed.
With Datastreamer, web data integration is effortless. Add new capabilities to your Pipelines dynamically and solve the operational issues that used to complicate your process.
Add Datastreamer components to your data stack and explore its full capabilities
