Ingesting Raw Materials

Leveraging access to the Twitter Firehose - the full real-time stream of every tweet sent over the Twitter platform - The TIE ingests more than one-billion daily tweets.

Extracting Relevant Tweets

Each tweet is scanned individually to extract tweets related to particular cryptocurrencies. For example, a tweet mentioning LTC, LTC, LTC.X or Litecoin would be bucketed into a group of tweets on Litecoin. Using patented technology, we combat problems related to overlapping tickers across asset classes. For example, identifying whether an ETH tweet is on Ethereum or Ethan Allen, the publicly traded furniture company.

Relevant Tweet Extraction

Account Evaluation

A filter is used to assess the relevance of the data and to remove spam. Accounts are reviewed and bots are removed. After the evaluation process has been completed over 90% of tweets on a particular cryptocurrency are filtered out of the stream. Proprietary algorithms are used to identify and rate professional investors and traders.

Account Filtration

Individual Tweet Scoring

Each word in each tweet is individually scored using a proprietary natural language processor. The scores of each word are aggregated and each individual tweet is given a score.

Individual Tweet Scoring

Generating Actionable Insights

The TIE converts the raw data into actionable insights for cryptocurrency traders. Among those insights are daily sentiment scores which measures the total sentiment of a coin today vs. that coins’ 20 day moving average sentiment score.

Sentiment is measured on a per coin basis to ensure that scores reflect how positive or negative conversations on Twitter are for a particular coin relative to itself on other days. This helps remove bias of one coin generally having more positive or negative conversations than another.

The entire sentiment scoring process is done in less than 1/3rd of a second and scores are updated on The TIE every five minutes.

Generating Actionable Insights

Click here to learn about the individual data points offered on The TIE
Was this article helpful?
Thank you!