The Pseudoscience of Trading System Development (Part 1)
Posted by Mark on June 9, 2016 at 07:11 | Last modified: May 4, 2016 08:14I subscribe to a couple financial magazines that provide good inspiration for blog posts. Today I discuss Perry Kaufman’s article “Rules for Bottom Fishers” in the April issue of Modern Trader.
In this article, Kaufman presents a relatively well-defined trading strategy. Go long when:
1. Closing price < 100-period simple moving average>
2. Annualized volatility (over last 20 days) > X% (varies by market)>
3. 14-period stochastic < 15>
Sell to close when:
1. Annualized volatility < 5%>
2. Stochastic (14) > 60>
Kaufman provides performance data for 10 different markets. All 10 were profitable on a $100,000 investment from 1998 (or inception). Based on this, he claims “broad profits.” Kaufman concludes with one paragraph about the pros/cons to optimizing, which he did not do. He claims this strategy to be robust as one universal set of parameters.
In the interest of full disclosure, let me recap my history with Perry Kaufman. I have a lot of respect for Kaufman because he has been around the financial world for decades. One of the first books I read when getting serious about trading was his New Trading Systems and Methods (2005). As a bright-eyed and bushy-tailed newbie, I even e-mailed him a few questions in thinking this was truly the path to riches.
Being a bit more educated now, I see things differently.
For starters, here is some critique about what jumps off the page at me after a second read. First, four of the 10 markets are stock indices (QQQ, SPY, IWM, DIA) that I would expect extremely to be highly correlated. “Broad profits” is therefore more narrow. Second, although the trading statistics all appear decent, the sample sizes are very low. Three ETFs have fewer than 10 trades and only two have more than 50 (max 64). Finally, Kaufman provides no drawdown data. Max drawdown may define position sizing and provides good context for risk. I feel this is very important information to provide.
When I first read the article, my critique focused on a different set of ideas. I will discuss that next time.
Categories: System Development | Comments (0) | PermalinkForecasting and Accountability
Posted by Mark on June 6, 2016 at 07:15 | Last modified: April 26, 2016 09:45From an article in the April 2016 Modern Trader magazine on oil price forecasting, Garrett Baldwin wrote:
> At the heart of it is the incapability of the human mind to wrap itself
> around the sheer size and factors that go into this global market. When
> something is this large with this many moving parts, we try valiantly to
> find shortcuts or justify one specific variable. Each day, a headline
> says that oil prices fell because of whatever factor an energy journalist
> can point to that day.
>
> It’s over-simplification at best, and malpractice at worst… And it’s
> clear that no one has a clue what oil prices will hit by the end of the
> year because of so many factors beyond our grasp. No one is suggesting
> that forecasting should be abolished, but history has shown that when
> it comes to accurately predicting oil prices, all bets are off. Are we
> willing to admit we’re just not good at this?
> …
> Right now, oil prices are hovering below $30 per barrel, a level that
> was deemed impossible just a few years ago. I remember sitting in a
> lecture with a prominent economics professor not long ago. He told
> the room that we wouldn’t see oil under $100 per barrel in our
> lifetime again. He somehow still has tenure.
>
> In the end, I still argue the real problem is that there is no
> accountability. People are allowed to make any prediction they want,
> and it is quickly lost in the 24-hour news cycle. When the prediction
> doesn’t come true, the blame falls on some unforeseen variable.
The article was on oil prices but it certainly is good information to know about financial forecasting in general. Baldwin’s words are consistent with those of Bob Veras in Doomsday Forecasting (a Primer): “nobody, including those who reported your alarmist views, will check up on your track record.” The lack of accountability allows anyone to forecast anything.
Personally, I believe the fault should not fall on the forecasters but rather on the readers who try to make use of the information. Forecasting is not actionable, period. That is why I categorized this post under “financial literacy.” Once I can identify content as a forecast, I can dismiss it and move on.
Categories: Financial Literacy | Comments (1) | PermalinkLessons from David Dreman (Part 3)
Posted by Mark on June 3, 2016 at 06:42 | Last modified: April 21, 2016 07:56I want to wrap up this mini-series today on David Dreman by discussing a few more cognitive biases, or heuristics, and offering some commentary on effectiveness.
David Dreman may be a living example of a repetitive theme throughout this blog: ideas that sound good but truly have no merit. I make no performance claims about Dreman Value Management. I mentioned backtesting his idea of investing in out-of-favor issues because I have not done so myself. Contrarian investing is conventional wisdom discussed in books and seminars for traders, which is a big reason it resonates with me and feels right.
I will close with discussion of a few other types of cognitive heuristics.
Historical consistency leads to greater confidence about predictability. Dreman found investors have more confidence in a stock that consistently rises with 10% earnings growth than a more volatile stock with 15% earnings growth. Is a less volatile stock more likely to outperform into the future? That is an empirical question.
The anchoring heuristic describes a common human tendency to rely heavily on the first piece of information when making decisions. Other judgments are made in reference to the anchor, and bias exists toward interpreting other information around the anchor. For example, a stock purchase price defines what is “good” (higher subsequent prices) and “bad” (lower prices). These are purely subjective judgments. Mr. Market certainly does not care about my cost basis.
Finally, confirmation bias is the tendency to search for, remember, interpret, and favor information in a way to confirm preexisting beliefs or hypotheses while giving less consideration to alternative possibilities. The effect is stronger for deeply entrenched beliefs and emotionally charged issues, which would certainly include the prospect of making money!
Confirmation bias is the main reason I seek collaboration for trading system development, which I have written for a long time. I do not want to be blinded by confirmation bias if I get a whiff of something good. In this case, other critical minds can better maintain objectivity; the idea remains less emotionally-charged because it is not theirs.
Certainly I would rather be proven wrong in the development stage rather than with real money on the line. Confirmation bias circumvents this and collaboration is the antidote.
Categories: Wisdom | Comments (0) | PermalinkLessons from David Dreman (Part 2)
Posted by Mark on May 31, 2016 at 06:30 | Last modified: April 21, 2016 05:43David Dreman uses a contrarian investing approach in an attempt to profit from irrational heuristic thinking. Today I want to discuss Dreman’s suggestions to protect yourself from such harmful cognitive biases.
With regard to the representativeness heuristic, Dreman suggests focusing on relevant factors that may result in an entirely different investment result. Do not be blinded by similarity. Sometimes only a slight similarity is necessary to significantly resonate with us especially if a big profit/loss was realized in the previous instance.
Dreman cautions against being influenced by short-term returns of a money manager, analyst, or any kind of financial adviser. The better the numbers, the more alluring the results but this is based on an insufficiently small sample size. Look for stronger supporting evidence like a longer term track record.
Dreman suggests being doubly cautious of short-term returns when they deviate significantly from long-term averages. This applies to performance of money managers, analysts, and advisers as well as to individual stocks or funds. Mean-reversion is the rule, not the exception.
Dreman recommends patience with new investment strategies rather than expectation of quick success. Investors are more likely to adopt strategies that have recently done well, which implicates mean-reversion as an immediate headwind. One way to offset this would be to enter a strategy when it seems somewhat out-of-favor. Such a strategy has already mean-reverted or is broken altogether, in which case future outperformance will no longer result. Only in retrospect can these two possibilities be differentiated.
These are four ways to prevent biases from affecting your investing decisions.
Dreman suggests purchasing out-of-favor stocks (e.g. low price-to-earnings ratios) as one way to profit from the biases of others. While this idea sounds good, as with most other strategies I would be interested to see a large backtest to better understand context.
Categories: Wisdom | Comments (0) | PermalinkLessons from David Dreman (Part 1)
Posted by Mark on May 26, 2016 at 07:19 | Last modified: April 19, 2016 10:27David Dreman founded Dreman Value Management in 1977 and has written many books and articles on contrarian investing. In this mini-series I will highlight certain aspects of his investment philosophy that resonate strongly with me.
According to Dreman, sound investment decisions are obstructed by psychological biases that I have called heuristic thinking. Crowd behavior is therefore irrational, which leads to market bubbles and violent selloffs. Contrarian investing aims to profit from the excess.
Dreman discusses the representativeness heuristic: human tendency to draw analogies and see similarities in things that are completely different. Overemphasis on similarity leads to miscalculation if we forget to assess the actual probability of an event occurring. One example would be recognizing a company as belonging to the automotive industry and remembering what happened last time an automotive stock was purchased. Representativeness reduces perceived importance given to the variables critical in determining actual probability of the event (e.g. the stock moving higher).
Dreman discusses the law of small numbers, which is a judgmental bias that occurs when one assumes characteristics of a sample population can be estimated from a small number of observations or data points. An example would be investors flocking to the hottest mutual fund. Research suggests funds that outperform in one time period often underperform in the next. Investors also tend to follow stock analysts who have demonstrated recent accuracy rather than checking the analyst’s performance over time for a logical measure of accuracy.
Investors ignore regression to the mean. Data show a tendency for valuations and returns to revert back to long-term averages—a conclusion overlooked by investors who pile in to buy a hot stock or rush to dump out-of-favor shares.
Investors fall prey to information overload, which is related to information bias. When under siege by information, people tend to see only what they are interested in while blocking out the rest. This is related to confirmation bias. Information bias is a delusion that more information guarantees better decision making.
In the next post I will review Dreman’s recommendations to overcome heuristic thinking.
Categories: Wisdom | Comments (2) | PermalinkIs There a Better Way?
Posted by Mark on May 20, 2016 at 07:14 | Last modified: July 16, 2020 11:35This morning I take a macroscopic view wondering what I’m trying to do here and why I seem to disagree with so many others in the financial industry. It’s not just that I’m trying to find a better approach: I’m trying to determine whether a better approach even exists.
I am not exaggerating when I say almost everywhere I look, I see marketing of a better trading/investing approach (substitute “Holy Grail” to make for slight exaggeration). Many seemingly innocent, matter-of-fact claims are actually the Holy Grail in disguise but that’s beyond the scope of this post.
Just as I questioned whether successful traders exist, I question whether a better trading/investing approach exists.
Consider the following observations:
–The disappearance of popular/outspoken traders over time
–Frequent flaws in advertising/marketing claims (e.g. affirming the
consequent, hasty generalization, fallacy of the well-chosen example)
–Rampant confirmation bias
–General ignorance about trading system development and inferential
statistics: tools capable of installing meaningful objectivity into an
environment of variable moving targets
–Multiple “professionals” telling me that generation of consistent, modest
annual returns [in comparison to what many investment newsletters and
trader education programs advertise] would have the big money storming
down my door to invest if I were to start a hedge fund
–Repetitive articles in financial planning and investment periodicals about
slight outperformance relative to benchmarks translating to large AUM
—American Greed on CNBC
–Financial industry’s overall ignorance about and misrepresentation of options
to the general public
–Attraction of discretionary trading as the Holy Grail for many profit seekers
If the concept of “a better investing approach” were on trial then perhaps none of these observations taken individually would be sufficient for debunking. Taken together, however, I see a boatload of reasonable doubt.
Sometimes I feel like X-Files. On the TV program, Mulder feels compelled to continue searching to ultimately discover “the truth is out there.” With regard to finance, I wonder if there is no particular truth to be found (i.e. a better way) even though everywhere I look I see advertising suggesting there is.
Categories: About Me | Comments (0) | PermalinkBirds of a Feather
Posted by Mark on May 16, 2016 at 06:36 | Last modified: April 2, 2016 08:38“Birds of a feather flock together.” So why don’t we as retail investors? I want to spend some time discussing this based on my time spent trying to network with others and meeting with trading groups.
I have had a difficult time trying to find other traders with whom to discuss option trading much less to collaborate on trading system development. I have already written about trading as a lonely pursuit.
If I were a conspiracy theorist then I would say this happens by design. “Divide and conquer” must be an institutional mantra because working unchecked, we [retail traders] fall prey to heuristic thinking. This probably contributes in large part to the fact that 80-90% of retail traders lose money to institutional coffers.
Except I am not really a conspiracy theorist.
Varied style preferences are perhaps the biggest reason traders have difficulty hooking up. Preferences are responsible for what tickers I like to trade, what software I like to use, what time frame I like to trade, and many other considerations. Incongruity amid any of these factors may be sufficient for incompatibility. If I am lucky enough to find a trading group where 10-20 people come together then what’s the probability I will find matches across the spectrum?
Aside from individual preferences, differences in personality traits can derail a potential partnership. I may not like anger, sarcasm, conceit, or laziness. It’s almost like we need eHarmony’s 29 dimensions of compatibility to discover who will get along. This isn’t like a corporate job, either, where people are forced to cooperate or be fired. When we can walk away without obligation, we will. I have found traders (myself included) to be a very fickle lot.
Bottom line: when I overlay the low probabilities of finding an overlap in style with finding a solid personality match, it’s no surprise why the trading space ends up seeming sparsely populated. Suddenly it makes more sense why people turn to commercial means (e.g. selling newsletters, trading services, or forming “trader education” companies) in an effort to create a following and to foster community.
Categories: Networking | Comments (1) | PermalinkLike Statistical Minds?
Posted by Mark on May 13, 2016 at 06:21 | Last modified: March 31, 2016 06:51Several weeks ago I listened to a presentation by David Wilt, co-founder of QuantyCarlo [QC], and for perhaps the first time in the option trading space, I heard what sounded like a kindred spirit. Today I will post some excerpts.
“With this tool you can propose a set of values for DTE, study them, and then evaluate
them: which gives you the best results and whether or not—and this is tremendously
important—any of those results are statistically significant or whether you are simply
looking at the random, stochastic behavior of trades in a sample space.”
“Desirability index is a standard method in inferential statistics and modeling—a single
measure (from 0 to 1) that reflects outcomes of interest to you.”
“When we have results from any kind of backtest… the first question you have to answer
is whether results are statistically significant: can you feel comfortable that when you
trade live you will get similar results?”
“QC Enterprise… provides you with a statistically sound (scientifically sound means to
provide significant, predictable, reliable improvements)…”
“I am absolutely convinced that 20-30 years from now, people will look back on this
and say ‘well that was easy. That was a no-brainer.’ I think what we’re really doing
here is taking a series of methods and techniques that have been applied in other
industries and bringing them to the options trading space and what we have here
is a tool that allows us to do the tests fast enough and sufficiently enough to
apply these statistical models and give us the kind of predictive capability that
has been achieved in other industries.”
“We want to get this in front of the people because there are a huge number of
smart people out there. We believe strongly that if we can engage them… if
they will share with us their views of QC: good, bad, or indifferent… if we
can learn from them then we will be able to continuously enhance this product.
The engagement with folks and the learning that we can anticipate from engaging
with them is invaluable and we appreciate the time and we appreciate people’s
questions and we appreciate their comments because that’s so important to
making this product and making the community more successful and I think
that’s really what we’d like to see. So I want to personally thank everybody
and say I look forward to the continued dialogue and I’m sure… QC [will] be
better for it.”
I look forward to learning more about QuantyCarlo!
Categories: Trading Software | Comments (0) | PermalinkWatching Out for Risk
Posted by Mark on May 10, 2016 at 06:46 | Last modified: March 28, 2016 09:16Many of my blog posts are inspired by forum discussions I have with other traders because thoughts had by others are often thoughts I once had too. Today’s example is about risk.
Over a year ago I was compelled to respond to “Pete,” a guy who had some definitive, optimistic words for trading strategies he claimed to be using. He posted a number of times before I responded with the following:
> If there’s potential reward then there is no such thing
> as zero risk.
>
> Your posts have full of phrases like:
>
> –“consistent weekly profits”
> –“‘gravy’ forever into the next generation”
> –“the coast is clear to keep it and make premiums
> until it runs up again”
> –“those who stayed are rich and retiring”
> –“sounds to me like profit all day long and all
> the way to the bank”
> –“this is a triple grand slam with insurance.”
>
> Where’s the one about trading being like an ATM
> machine that continuously spits out cash?
>
> Nothing about trading or investing is free, nothing
> is guaranteed, and nothing here is ever worth the
> kind of exuberance you seem to project with your
> posts. There’s risk inherent with everything and
> if you trade too large aiming to be too greedy then
> you will one day learn the hard way by getting
> blown out of the game for good.
Pete responded by asking me what I felt could possibly be wrong with some of the trades he was putting on. I replied:
> I’m not going to specifically analyze the pros/cons
> of your trade because we have other wonderful
> traders here who routinely share such insights
> Hopefully they can help with some of your analysis.
>
> Based on my real-world trading experience, though,
> focus on what I said in my last post. It’s at
> least urban legend (if not definitive truth: nobody
> knows) that over 80% of all traders lose money.
> Personally, I think the #1 culprit is unrealistic
> expectations. If you enter the markets thinking
> you’re going to make too much per month then
> you’re going to get beheaded. Your phrases that I
> quoted all suggest just that.
>
> Hence my caution: learn how to determine the real
> risk, watch your back, and be careful. If you don’t
> see the risk then walk (or run) far away.
I think this is good advice for everybody and that includes, first and foremost, myself. I try to remember this stuff each and every day.
Categories: Money Management | Comments (0) | Permalink