Top companies trust Datastreamer to integrate, enrich, join, and apply their web data needs.
How Datastreamer works
Quickly apply Tisane Entity Extraction to Socialgist Boards with a Datstreamer Pipeline.
Quickly connect Tisane Entity Extraction and Socialgist Boards with a Datstreamer Pipeline.
Web data is the starting point for any pipeline. You can use any number of data sources to power your Pipelines. You can use web data from our partner network, your own systems, or any web data.
To accelerate using your web data, you can apply any number of operations to the data. Enrich, augment, join, structure, filter, storage, search, or more! Datastreamer has hundreds of plug-and-play operations that you can apply.
With Datastreamer it’s never been easier to use web data. You can dynamically expand your Pipelines with more capabilities, and you’ve now been able to solve your operational bottlenecks in working with web data.
Entities are elements of relevance or interest in the text. Tisane extracts both standard entities and those relevant to trust & safety/law enforcement applications.
Standard entities are names of people, their social roles, organizations, places, and so on. We also extract cryptocurrency addresses, bank accounts, credit card numbers, phone numbers, software package names, and more.
Every entity entry is an object made of:
type - the type of the entityname - a standard name, if exists; otherwise, the string that was loggedsubtypes - more detailed additional typessubtype - the first subtype (for backward compatibility purposes)mentions - an array of all detected mentions, with:
offsetlengthsentence_indextextwikidata - a Wikidata ID, if existsCovering more than 200 popular Chinese message boards and forums, including baidu.com, hupu.com, and zhihu.com, and 3,000 English message boards and forums, Socialgist offers an unrivalled view into real-time discussions and community sentiments. This message boards dataset is goldmine for understanding consumer behaviour, tracking viral topics, and gaining insights into niche communities and broader public opinion.
Add Datastreamer components to your data stack and explore its full capabilities