(866)-482-2177

sales@alphatheory.com

REQUEST A DEMO

SYSTEM REQUIREMENTS


Please note the following System Requirements. Further, please limit the number of open applications (particularly price streaming applications) while logged in to Alpha Theory™.


Recommended System Specifications
Processor: Dual Core or Quad-Core 2.4GHz or faster
RAM: 4GB+
Browser: Google Chrome 30+
Screen Resolution: 1280 x 1024 or greater
Internet Access: Business Class High-Speed


Minimum System Requirements
Processor: Intel Pentium-M 2.0Ghz or equivalent
RAM: 2GB+
Browser: Google Chrome, Mozilla Firefox, Internet Explorer 9+ (without Compatibility View), Safari
Screen Resolution: 1024 x 768 or greater
Internet Access: High-Speed

Subscribe to Alpha Theory content

Alpha Theory Blog - News and Insights

10 posts categorized "Analytics"

January 05, 2018

2017 Year in Review

 

Alpha Theory’s product helps investment managers reduce emotion and guesswork in position sizing. The result is reduced errors and improved returns. For six consecutive years, Alpha Theory clients have outperformed their peers (see table below – we use the benchmark of Major Equity Hedge Index because 86% of Alpha Theory clients are hedge funds). Our clients have consistently outperformed their competitors, more than doubling their returns over the period.

 

Graph1

*Totals are not including 2017 data

In 2017, our average client generated 18.9% returns and, when it is released, I anticipate that we’ll beat the Hedge Index again. These results are consistent with other blog posts we’ve written highlighting our clients in 3rd party rankings: Reuters / WSJ / Novus.

 

NEW 13-F ANALYSIS

This year, we expanded our analysis through a new 13-F dataset with all publicly filing funds. The upside of using this dataset is it enables us to compare results against every reporting fund in 2017. The downside is it only includes the US equity long positions. The results indicate that once again, Alpha Theory clients outperform their peers.

The average Alpha Theory client performance in 2017 (13-F data) was 27.6% vs 19.9% for all others (3013 total funds with over 20 positions). That’s almost one full standard deviation higher (8.8% standard deviation) than the mean and has a Z-Score of 2.03 (statistically significant above the 95% confidence level).

Even more interesting was the individual performance results of our clients, one Alpha Theory client was the 2nd best performing fund in 2017 (this client thanked us more than once for our contribution to their success) and four clients landed in the top 40 performers.  We also had six of the top 100, and 10 of the top 200. Statistically, we’d anticipate less than 1% in all categories because Alpha Theory clients are less than 1% of all funds. Instead, as in previous periods, there is a concentration of Alpha Theory clients amongst the top performers.

Graph2

Simply put, Alpha Theory clients outperform their peers. The traits these firms share are discipline, intellectual honesty, and process focused. They gravitate to Alpha Theory because it is their tool kit to implement and measure that process.

 

PROCESS EQUALS PERFORMANCE

Alpha Theory clients use process to reduce the impacts from emotion and guesswork as they make position sizing decisions. Alpha Theory highlights when good ideas coincide with largest position sizes in the portfolio. This rules engine codifies a discipline that:

1. Centralizes price targets and archives them in a database

2. Provides notifications of price target updates and anomalies

3. Calculates probability-weighted returns (PWR) for assets and the portfolio as a whole.

4. Enhances returns

5. Mitigates portfolio risk 

6. Saves time

7. Adds precision and rigor to sizing process

8. Real time incorporation of market and individual asset moves into sizing decisions.

DISCIPLINED USAGE REDUCES RESEARCH SLIPPAGE

Alpha Theory’s research not only suggests that adoption of the application by itself leads to improved performance, but actual usage intensity further enhances results.

Usage intensity is determined by:

1. Percent of Positions with Research

2. Correlation with Optimal Position Size

3. Login Frequency

 

Graph3

1.Measured as the annualized ROIC where data was available, for a sample of 48 clients, 12 for each quartile

 

OPTIMAL POSITION SIZING REDUCES RESEARCH SLIPPAGE

Comparing clients’ actual versus optimal returns shows:

HIGHER TOTAL RETURNS
ROIC is 4.5% higher.

IMPROVED BATTING AVERAGE
Batting Average is 8% higher. Explanation: many of the assets that don’t have price targets or have negative PWRs are held by the fund but recommended as 0% positions by AT. Those positions underperform and allow AT’s batting average to prevail.

 Graph4

1.Measured as the average full year return for clients where full year data was available, adjusted for differences in exposure, net of trading costs

2.Before trading costs

 

ALPHA THEORY CLIENTS OUTPERFORM NON-CLIENTS
Alpha Theory clients have outperformed Major Equity Hedge Indices every year since Alpha Theory started collecting historical data. While our clients are a self-selecting cohort who believe in process and discipline; process orientation goes hand-in-hand with Alpha Theory software that serves as a disciplining mechanism to align best risk/reward ideas with rankings in the portfolio.

 Graph5

PRICE TARGETING REDUCES RESEARCH SLIPPAGE

Alpha Theory has further found that ROIC for assets with price targets is 5.6% higher than for those without price targets. Some investors chafe at price targets because they smack of “false precision.” These investors are missing the point because the key to price targets is not their absolute validity but their explicit nature which allows for objective conversation of the assumptions that went into them.  Said another way, the requirements of calculating a price target and the questions that targets foster are central to any good process.

Graph6*Long-only as many short positions are hedges and have no price targets

 

December 15, 2017

Superforecasting for Investors: Part 2

Alpha Theory hosted a book club on December 6th with portfolio managers, analysts, and allocators coming together to discuss “Superforecasting” by Phil Tetlock. We were lucky enough to have a Superforecaster, Warren Hatch, moderate and perform forecasting exercises with the group. We spent 2 hours together and only scratched the surface on applying Superforecasting to investing.

 

Here are a few key takeaways:

1. COMMON ATTRIBUTES OF SUPERFORECASTERS:

INTELLIGENCE: Above average but genius isn’t required

QUANTITATIVE: Not only understand math but apply it to everyday life

FOXES, NOT HEDGEHOGS: Speak in terms of possibilities, not absolutes

INTELLECTUALLY HUMBLE: Understand the limits of their knowledge

SYSTEM 2 DRIVEN: Use the logic-driven instead of instinct-driven portion of their brain

DO NOT BELIEVE IN FATALISM: Life is not preordained

CONSTANTLY REFINE: Make frequent small updates to their forecast based on new information (but not afraid to make big changes when warranted)

COUNTERFACTUALS: Believe that history is one of many possible paths that could have occurred

OUTSIDE VIEW: Incorporate the internal and external views

GROWTH MINDSET: CONSTANTLY SEARCH FOR WAYS TO IMPROVE THEIR FORECASTING PROCESS

 

2. IDENTIFYING TALENT: There are identifiable attributes that can be used in hiring and have a profound impact on forecasting skill

 

Active Open Mindedness*

   image from alphatheory.typepad.com

Fluid Intelligence*

image from alphatheory.typepad.com

 

* At a prior book club, we measured participants and the results showed they had the attributes of Superforecasters with high Active Open-Mindedness (3.99 out of 5) and high Fluid Intelligence (8 out of 10 – this is the highest score that the Good Judgment  folks have seen).

Active Open Mindedness (i) and Fluid Intelligence (a) are two measurable traits that managers can use to select talent. In the chart below, the improvement impact of the definable attributes equates to about 40% of their forecasting skill over standard forecasts.

image from alphatheory.typepad.com

3. DEVIL’S ADVOCATE: Firms should appoint a Devil’s Advocate for each investment to expand critical thinking (someone to ask the question, “I see your downside is $40. How is that if the 52-Week Low is $22 and the trough multiple would put it at $25?”)

 

4. OUTSIDE VIEW: Firms should require an Outside View for every investment idea (“While everyone I’ve spoken to says this deal will close, only 20% of deals with one party under SEC investigation close.”)

 

5. REFINEMENT: New information should always be incorporated in forecast (think Bayesian).

 

6. TEAMS MAKE BETTER FORECASTS: Team dialog generally improves forecasting accuracy.

 

7. FORECAST CULTURE: Firms should embrace “forecast” as part of their vernacular and conversations should revolve around how information impacts the forecast.

 

8. MEASURE TO BE BETTER: We all forecast, but we rarely measure. That fact needs to change if we really want to improve.

 

9. CLUSTERING: Break complex topics into individual components that are better able to be forecast and use the combination of the smaller forecasts to forecast the more complex. (ie. Will AAPL break $200 is a complex forecast that can be broken down into Will iPhone X ship more than 400m units? / Will Samsung’s technology outpace Apple’s? / etc.)

 

10. INDEXING: Individual clustering questions can be weighted to come up with a forecast for the complex topic instead of using simple equal weighting.

 

11. DIVERSITY OF FORECASTS MATTER: Forecasts made from similar perspectives are less accurate than those made from multiple perspectives (see Boosting below).

 

12. BOOSTING: If you have three forecasters with different perspectives that all arrive at a 70% probability of an event occurring then the actual probability is greater than 70%.

 

13. GISTING: We didn’t get to spend much time here, but the idea is that complex subjects, reports, presentations, etc. can be distilled down into gists that the team votes on and refines into supergist. Full understanding is never just quantitative or qualitative. Superforecasting is quantitative. Supergisting attempts to provide the qualitative piece. 

 

14. HYBRID FORECASTING COMPETITION: IARPA, the defense agency that sponsored the forecasting tournament that launch the Superforecasters (Good Judgment) is sponsoring a new Man+Machine Forecasting Tournament. For those interested in Forecasting and Machine Learning, this is your spot: https://www.iarpa.gov/index.php/research-programs/hfc

 

November 10, 2017

Predictably Insightful: Recap of the Behavioral Alpha Conference

 

This is a picture of me and Dan Ariely, author of “Predictably Irrational” and five other great books on decision pitfalls we all fall into. Dan was the keynote speaker at Behavioral Alpha 2017 an event put on by our friends at Essentia Analytics and we were proud to help sponsor.

 

Behavioral Alpha

 

The day was packed with great speakers including:

- Dan Ariely: “Behavioral Finance in Practice” 

- Denise Shull talking about “Your Senses, Feelings & Emotions are the Ultimate Dataset”

- Clare Flynn Levy: "Applying Behavioral Finance to Your Own Investment Process" 

- Fireside Chat with Mark Baumgartner: “Why Asset Allocators Care About Behavioral Analysis” 

- Cameron Hight: “Mistakes Managers Make & How to Fix Them”

- Peer Idea Exchange: Paul Sonkin and Paul Johnson: “Pitching the Perfect Investment:

- Managing the Tensions Between Analysts and Managers” 

- Dave Winsborough: “How the Collective Personality of Your Team Affects Performance”

 

Here’s a quick recap of some of the takeaways:

Dave Winsborough discussed ways that we can build better teams by understanding the goal we’re trying to accomplish, the needed components to accomplish that goal, and measuring the team participants to make sure that the team has all of the necessary components. It’s a relatively straightforward idea that should be applicable to almost any team.

Denise Shull discussed ways we can become better in tune with our feelings and emotions with the idea of learning when and how to leverage those feelings. Learning how to identify our own emotions is a powerful first step towards being able to mute the negative emotions and take advantage of the positive (signals).

Much of the conference was on emotion and bias and how they cause us to make poor decisions. I completely agree, but that’s not my expertise. I spent much of my time talking the processes that help mitigate bias. This primarily involved making our assumptions and decision process explicit so that they can be judged and analyzed.

Dan Ariely gave several fascinating anecdotes like how casinos are the best at applying behavioral tools, how company internal satisfaction surveys have predictive power for stock performance, how Intuit is giving teams time and money to try bold new initiatives to help them get over the risk of projects that fail, a weight scale that doesn’t show your weight (but tracks it over time) is a much better way to lose weight than one that gives immediate feedback that is subject to good-habit-breaking volatility, and how people in the next to the lowest tax bracket are the ones most opposed to minimum wage hikes because it could push them into the lowest rung of society. His major takeaway was the bias and personality are tough to eliminate so you have to create habits, rules, and routinized behaviors that help us do the things we say we want to do (very Alpha Theory😉).

Clare Flynn-Levy showed how investors can make better decisions by capturing some basic information about themselves and their decisions. Taking the time to tie those data points together can help us better understand when we make good decisions and when we make poor decisions. By understanding these cues when they’re happening we can take advantage of the positive and avoid the negative.

Mark Baumgartner discussed his time at the Ford Foundation and Institute of Advanced Studies and some of the things he’s seen in the managers he evaluates. He said that about 10% of the managers he meets have some form of structured process around behavioral science, decision making, portfolio management, position sizing, etc. He believes that the primary value of a manager isn’t based on these processes, but he believes there is a lot of easy to pick up alpha form implementing process. He would like to see his managers embrace it more actively but says the industry moves glacially while the products that help improve the process are evolving very fast.

The room was full of managers and allocators. There was a self-selection bias, but the crowd truly embraced the concepts for how to be better using the behavioral science discussed during the day. In fact, the crowd asked amazing questions and one of my favorite parts of the day was from a member of the audience that was expanding on his thoughts about the difficulties of capturing alpha. He said the number of investors has increased from 5,000 to 1 million over 50 years. How do you reverse that trend when it is one of the highest paid professions, where you get to work with amazing people, research a broad range of interest, get to meet leaders in industry, academics, and government, and be exposed to an array of amazing ideas? If I’m ambitious and at the top of my class, why would I not pursue that profession.

Hmmmmm, maybe we can ask Dan Ariely if he has some creative way to change that behavior.

 

October 06, 2017

Poker: Art vs Science

 

“People describe poker as a game of art and science. Both intuition and science have merit, but the best players approach the game very quantitatively.” – Liv Boeree, Professional Poker Player

Our COO, Graham Stevens, and I met over a poker table. We’ve been playing together for many years and he was recently watching an Oxford Lecture Series video by Liv Boeree that he turned me on to.

Liv is a very successful poker player with a physics degree from the University of Manchester. She was discussing the use of Game Theory Optimal (GTO) play and the use of GTO Tables to break decisions down into ranges of hands based on different situations to aid poker players in knowing the optimal decision (Bet (big or small), Check, Fold).

She stated that the best players in the world all employ GTO. And even though all players assume their opponents are playing GTO, it is incredibly difficult to exploit those predicted decisions because they are optimal. In an interesting exchange in the video, Igor Kurganov, another very successful poker player who was in the audience, said that intuition (playing the player instead of playing the cards) factors into his decisions, but only to a small degree. He said that the best intuition can do is change a 50/50 bet to a 55/45.

The parallels to investing and Alpha Theory are clear. At Alpha Theory, we allow firms to build their own Game Theory Optimal system to figure out the “optimal” amount to bet on each position in their portfolio. And we find that firms that use intuition instead of their model lose to the hypothetical model performance about 75% of the time.

The reasons portfolio managers choose to vary from their model are numerous, but have a common theme; there is an intuition that the model isn’t capturing. Granted investing is not poker. Poker has a finite set of variables and permutations comparted to the seemingly infinite number of variables to consider in investing. But even still, just like in poker, the world-class players are going to be the ones that are following the model and only making small tweaks for intuition.

**Do I practice what I preach? A note on my own poker play. I do not play GTO because I have not memorized the tables. I know some of the shortcut rules for when to bet and fold pre-flop and I can do a rough calculation of pot odds post-flop but that’s the extent of my skills. If my buddies would let me pull out my computer while I’m sitting at the table, I would follow GTO.  If I were playing for a living, I would learn and follow the model.

 

September 14, 2017

Asset Manager Reliance on Human Judgement vs Machine

Asset management is the industry most reliant on human judgement according to a recent Price Waterhouse study on Data Analytics.

 

Screen Shot 2017-09-14 at 10.14.59 AM

 

Asset managers rely on human judgement 3x more than the next industry. For an industry with some of the best and brightest, we seem to be far behind. There is no expectation that this will happen overnight, but at a bare minimum we need to be experimenting with ways to enhance our judgement with machines.

Alpha Theory has been doing just that for over 10 years and our clients have outperformed the average hedge fund by over 2x. Getting started is not hard. Adopting “machine” does not require a wholesale change as all of our clients operate with Man + Machine. What it does require is an acceptance that Man alone is generally inferior to Man + Machine and a cultural embrace of the “machine” as an enhancement to the daily judgements we all make.

The reliance on human judgement will fall over time for asset managers. Do not be the last the change.

 

 

March 13, 2017

Ted Seides - Alpha Theory Book Club

 

On March 7th, Alpha Theory hosted a book club with over 30 portfolio managers, analysts, and allocators coming together to discuss Ted Seides’ book, “So You Want to Start a Hedge Fund?”. We were lucky enough to have Ted present and answer questions about the capital raise environment, investment process best practices, hiring, keeping investors happy, etc.

 

Here are a few takeaways:

 

1. CAPITAL RAISE ENVIRONMENT: It’s hard out there and isn’t getting any easier. Allocators are getting pressure from their investors about their hedge fund investments.

2. INVESTING ENVIRONMENT: Once again, it’s hard out there and isn’t getting any easier. There are more smart managers than ever looking at the same ideas.

3. FEES: Fee pressure will continue and managers will be asked for fee strategies which better align the interests of the investor and the manager.

4. DURATION DISCONNECT: There has been, and probably always will be, a disconnect between the duration that a manager is judged and the duration in which a manager manages their portfolio. The best thing a manager can do is be open and honest about their challenges so that investors get comfortable with volatility of performance numbers.

5. TURNOVER: Managers should be quick to remove “bad fit” analysts, even if they’re going to get push-back from investors over changes with the team.

6. STASIS: Many hedge funds have a “set it and forget it” mentality towards culture, personnel, and investment process. Many great corporations have advanced human capital strategies and hedge funds can leverage that knowledge to build superior organizations (i.e. Bridgewater or Point72).

7. COACHES: To prevent stasis, it is important to read and sometimes bring in outside help. There are experts in team building, time management, bias mitigation, decision science, investment process, etc.

8. RUNNING A BUSINESS IS HARD: Most hedge fund managers don’t have the luxury of just picking stocks. They’re charged with hiring/firing, raising capital, investor relations, human resources, picking accountants, selecting offices, etc. All the things that a CEO of a company deals with plus managing a fund. The reason portfolio managers are so busy is because they have two full time jobs.

9. THE BET: As most know, Ted was the other side of the famous 10-year bet with Warren Buffett pitting the S&P 500 against a basket of hedge fund allocators. Ted still fully believes that hedge funds can outperform in the right environments (i.e. market is overbought).

 

Thanks to all those that attended and contact Alpha Theory if you would like to learn more about attending future book clubs.

 

February 24, 2017

Stock Picking is Hard

 

Stock picking has never been so hard.

 

From a recent interview with Charlie Munger of Berkshire Hathaway:

“In the old days, I frequently talk to Warren about the old days, for years and years and years what we did was shoot fish in a barrel. It was so easy we didn’t want to shoot fish while they were moving. We waiting until they slowed down and shot at them with a shot gun. It’s gotten harder and harder. Now we get little edges. It isn’t any less interesting. And we do not make the same returns we made when we’d pick this low hanging fruit off trees that offered a lot of it.”

“I used to say, ‘you have to marry the best person that will have you.’ That’s a rule of life. You have to get by on the best advantage you can get. Things have gotten so difficult in the investment world.

 

From a recent article on investing by Ben Carlson of CNBC:

Michael Mauboussin calls this the paradox of skill. Mauboussin says, "It's not that managers have gotten dumber. It's precisely the opposite. The average manager is more skillful than in past years. The paradox of skill says that when the outcome of an activity combines skill and luck, as skill improves, luck becomes more important in shaping results." How many institutional investors bother to ask themselves if the investment managers they are investing with are lucky or truly exhibit skill?

Active managers are competing against many more managers these days than they did in the past. There are roughly 300,000 investment professionals worldwide (portfolio managers and analysts) working for hedge and mutual funds (Alpha Theory estimate). There are 43,000 exchange listed public companies5. That works out to about 7 analysts for every stock! Asset prices become more efficiently priced when lots of smart people pay attention. With those odds, it is no wonder that there is a dearth of good ideas.

 

From Daniel Chambliss’s paper on “The Mundanity of Excellence”:

“Superlative performance is really a confluence of dozens of small skills or activities, each one learned or stumbled upon, which have been carefully drilled into habit and then are fitted together in a synthesized whole.”

“Excellence is accomplished through the doing of actions ordinary in themselves, performed consistently and carefully, habitualized, compounded together, added up over time.”

It has never been more important to do the little things that lead to success. Alpha Theory’s dominant beneficial attribute is the process discipline it instills in our clients. Our clients have outperformed the HFRI Index for each of the last five years (as far back as we have data) by an average of 3%. I believe their discipline is a big part of what makes them excellent. As good as they are, they can be better. If they would have strictly followed their models, their performance would have been 6% higher. There is alpha out there for the good stock pickers but it requires discipline and a desire to be excellent.

 

January 31, 2017

ALPHA THEORY - 2016 YEAR IN REVIEW

Client Outperformance

For the fifth year in a row (as far back as we have data) our clients have outperformed the HFRI Equity Hedge Index. To date, our clients’ compound return is 20% greater than the index.

1

As good as our clients are, they would have been even better if they followed the optimal position sizes they built inside of Alpha Theory:

2

On average, Alpha Theory suggests a lower gross exposure. So, to compare on an apples-to-apples basis, we look at Return on Invested Capital. For 2016, the Optimal ROIC was 13.3% versus 6.5% actual. That’s a difference of 6.8%.

Let’s put that difference into perspective. Our clients manage over $100B using Alpha Theory. On an ROIC basis, 6.8% of additional return on $100B is $6.8B. Assuming 20% performance fees, our managers left almost $1.4B of income on the table.

In 2016, 84% of our clients would have performed better if they would have followed optimal position sizing.

Betting the Forecasting Edge

Lastly, 2016 was the best year on record for the correlation between our clients’ forecasts and actual returns. The correlation between expected and actual returns was 0.19 for 2016. While this may seem low, one would expect a correlation near zero if selected randomly. For every year since 2012, with the exception of 2015, the correlation between expected and actual returns has been positive.

We believe this is a strong indication of predictive power in analysts’ forecasts. If analysts’ forecasts were random, then optimal position size would not beat actual returns with such regularity.

There are many ways to try and improve but few are as easy as creating a discipline around position sizing. The evidence is clear, if a firm has any edge, then creating a repeatable process to bet that edge is the difference between good and great.

Additional Portfolio Metrics

Screen Shot 2017-01-31 at 6.56.58 PM

 

 

December 28, 2016

2017 NEW YEAR’S RESOLUTIONS

By Emma Vosburg and Cameron Hight

 

Every year, people make New Year’s resolutions and every year, people break them. Creating positive habits that reinforce resolutions is the difference between the people that keep their resolutions and those that break them.

Creating process that works for you is the key to forming habits that lead to accomplishing your goals. You must commit to the process. For investors, a lack of systematic investment process means it will be difficult to consistently outperform your competitors. Alpha Theory is process in a box!

Let us help you create a winning process and build the habits necessary to fulfill your New Year’s resolutions. Let’s look at a list of possible Alpha Theory New Year’s goals:

CREATE PROCESS ----> BUILD HABITS ----> ACHIEVE GOALS

Screen Shot 2016-12-28 at 9.27.05 AM

Why make an Alpha Theory New Year’s resolution? Alpha Theory’s research not only suggests that adoption of the application by itself leads to improved performance, but actual usage further enhances results. In the table below, we show that clients who are more process oriented (as measured by having price targets, frequency of review, and diligence at updating position size based on their forecasts) outperformed our clients who were less diligent.

2

A systematic approach to accomplishing goals is valuable in every aspect of life. In 2017, create process that builds habits and allows you to achieve your goals. No excuses!

 

November 30, 2016

Using Analytics to Improve Investment Process

By Cameron Hight and Justin Harris

 

Data is taking a precedence in modern life as a necessity for those who want to improve. With specific relevance to asset management, finding insightful feedback in data is where managers can use unbiased facts to flesh out the inefficiencies in their investment process. As more and more managers rely on data to inform their investment process, the cost of not doing so increases. We, at Alpha Theory, have spent considerable time over the past year working with clients to help them hone their process, based on insights from data. Here are a few examples:

PROBABILITY AND FORECAST ANALYSIS

Alpha Theory uses analyst forecasts to optimize portfolio position sizing. Managers must therefore know what confidence they can put on analysts’ research, because optimizing on bad research could be deleterious to returns.  Said another way, managers need to know who to trust.

As a starting point, the average analyst in our system forecasts that they’ll make money on their investments 75% of the time compared to their actual success rate of 53%. Additionally, they forecast upside returns of 43% compared to their realized returns of 26%. Clearly there is a pervasive, systematic overconfidence. With that perspective, you can evaluate your own team.

Probability Analysis. One of the first areas to evaluate is the forecasted probability of making money compared to the actual percentage of investments that were profitable. In the graph below, we show a representative comparison of forecast versus actual success rates. As a manager, this is excellent information because in one glance, you see which analyst is most accurate and who has the most bias. The actionable information would be requesting that Jimmy and Matt cap their forecasted success percentage at 50% and reviewing specific names with Jim to see why he has such dramatic bias.

Screen Shot 2016-12-01 at 8.49.59 AM

Additional analyses could include long/short and sector breakout or alpha-based analysis. These additional insights may help clarify the analyst’s differences. The point is that you ask questions based on empirical data that help your analysts improve while, at the same time, giving the portfolio manager the real-data to back up hunches of analyst bias.

Performance Analysis. In the graph below, we show how price forecasts (bars) compare to actual outcomes (underlay). We see that, while Jim Braddock had a disappointingly low success rate (graph above), his price forecasts were excellent. In fact, because the asymmetry was positive, his ideas were net profitable even though only 25% of them made money. From a manager’s perspective, encouraging Jim to make more realistic probability forecasts, gives you data that could dramatically improve fund performance.

Screen Shot 2016-12-01 at 8.50.16 AM

Simple Graphs, Profound Insights. These two simple graphs provide many insights, as illustrated above. A few others to show the power of the picture:

1. Matt Doherty’s names should be given lower confidence given that he only makes money in 50% of his names and he loses more on his losers than he wins on his winners.

2. Ahtray Dahurt’s forecasts should receive higher confidence as his reward and risk price targets and probabilities are in line with actual results.

3. Jim Braddock’s forecasts are net profitable, but his reward probabilities are over inflated. There is an opportunity to profit from his ability to call names with extreme upside returns, but, in the near term, scaling back confidence while working with Jim to improve his batting or at least decrease his forecast probabilities would improve the forecast process.

These are a few of the many insights that Alpha Theory provides to clients to help them become better investment managers. Data provides insights that lead to action that result in an improved process. This chain of improvement is the benefit of capturing and analyzing data. Until we “see the data”, the answer may not be intuitive. This is why it is so important to create a data driven approach, focused on process improvements, that allow you to keep pace with the rapidly evolving data-driven world.