IIP-XX : The Robot Index (iRobot) **Backtest Update 2021-07-23**

iip : TBD
title : Robot Index (iRobot) :robot:
status : Proposed
author : bloom.fi DAO represented by @Monportefeuille
reviewed by : @TenaciousTerrier
created : 2021-07-16

Summary

This post is the formalization of the original PMI (Post-Modern Portfolio Theory Index) proposal drafted 3 months ago. It aims at summarizing the progress and changes made since then, paving the way for a DG1 vote.

  • Mission & Purpose :
    The Robot Index (iRobot) aims to become the 1st decentralized Robo-Advisor, automatically optimizing the composition of a sector-agnostic basket of crypto assets, by selecting and rebalancing its underlying components based on their annualized risk-adjusted returns.

  • Thesis :
    The core of Index Coop’s mission is to make crypto investing simple, accessible & safe.
    Unfortunately, and despite the potential offered by market-capitalization weighted benchmarks, building a diversified portfolio with long-lasting performance while minimizing its downside deviation is not always immediate for retail investors.
    This is particularly true for those entering the market in periods of high volatility, and hoping to outperform the top market caps. With generally little trading or portfolio management experience, a natural bias when facing a screen full of numbers and obscure token names is often to place bids on random projects, or based on external advice or crowd sentiment.
    The Robot Index aims at taking this difficulty out by automatically picking up the assets with the most growth potential and the least downside volatility.

  • Product Differentiation :
    There is no equivalent product elsewhere on the market. Thanks to its unique characteristics, the Robot Index also fills an interesting gap in the Index Coop’s product palette by unlocking the potential of quantitative trading techniques to supplement the broad sector exposure thesis.

  • Market Opportunity & Potential Size :
    1/ According to Statista, assets under management in the TradFi Robo-Advisors segment are projected to reach $1.4 trillions this year (~ 1.6% of the world’s top 50 asset management firms AUM). This market is expected to show an average annual growth rate of ~ 19% in the coming years.
    2/ Assuming decentralized Robo-Advisors capture an equivalent portion of the
    total value - currently - locked in DeFi results in a potential market size of ~ $880m.
    We believe the Index Coop could seize a significant share of this opportunity thanks to the 1st mover advantage that the Robot Index is offering.
    3/ Several major players in this sector such as Wealthfront or Betterment as well as new actors like Makara, are looking to attract digitally native generations with an ETF-like approach to crypto offering. Before its official launch, Makara already had 20000 beta testers with several million $ under management while its offer is currently limited to 3 “baskets” (“Blue Chips”, “Inflation Hedge” & “Decentralized Finance”).

Evolutions since the original PMI proposal

  • Community sentiment :
    The PMI proposal has gathered a large majority of positive votes (88%) FOR the progression towards a DG1 vote.

  • Product Working Group feedback :
    A pre-DG1 product priorization review was conducted by the Product Working Group (thanks to @overanalyser & @Metfanmike for their guidance on this). Based on the revised scoring framework, the Robot Index achieved an initial score of 1.38.
    The diversification and research automation have been identified as the potential strongest growth drivers, while the complexity of the methodology justifies a higher revenue potential.
    The adjustment of the rebalancing period to a monthly basis for the initial launch would be a further help in reducing the operational overhead with a potentially beneficial effect on the above score.

  • Engineering Working Group feedback :
    After a 1st discussion on the methodology’s technical implications with @dylan, it is envisioned to use the same interface for the rebalancing process as MVI or DPI for iRobot’s launch. It was also suggested that a bi-weekly rebalancing cadence would incur too much overhead in parametrization and actual trade monitoring, at least for the launch : although the original recommendation for this product is a bi-weekly rebalance to manage risk adjusted returns as efficiently as possible, the latest backtest data show that this would still be acceptable (read below the “Backtest & Bear Market Stories” …).
    The automatic calculation of the metrics underlying this methodology directly on-chain is theoretically possible and could be an option for the future, but Set Protocol is currently not set up to enable this.

  • Author Background & Commitment :
    Since early June the bloom.fi DAO has opened its doors to the broader English speaking community, with the aim to offer curated crypto / DeFi market research and analytics.
    I personally believe in the power of a collective intelligence to share & process the data generated by the most advanced research platforms, extract signals from the noise & provide a new type of consultancy / curation service to the industry.
    As an aspiring community methodologist, my intention is to build on the Robot Index to cement a strong connection with the Index Coop and bootstrap bloom.fi’s development in this new direction, including the recruitment of DAO members to support iRobot’s inception & development.

  • Narrative :
    Thanks to the input of various community members (:pray: @BigSky7, @lavi, @mrvls_brkfst) we’re confident that we’ve found a positioning which will enable us to communicate around this complex strategy in a simple and exciting way.
    The Robot Index narrative unleashes a lot of marketing potential directed at retail investors, looking for diversification & shorter term returns in addition to BED, DPI or MVI - without the hassle of managing volatility themselves : memes, embodiments of the product, for example via dedicated (& ready to fire !) Twitter or Discord accounts …

ip___

Backtest & bear market stories

The 1st backtest that we shared back in May was covering the period from 1st December 2020 until 1st March 2021 (see the original PMI discussion for details). Obviously we were still in the middle of a full blown bull market, and a lot has changed since then : that’s why it makes sense to look at iRobot’s performance against the same benchmarks (BTC, ETH, DPI and BED) but in a totally different context.

  • How would iRobot’s draft portfolio look like 3 months down the line ?

Illustrated below is the composition of the Robot Index as of 1st July 2021, identified during a methodology backtest covering the period between 1st May & 22nd July 2021 :

It is noticeably different from the composition proposed in the original PMI post, for 2 reasons :
1/ The ranking of tokens constantly evolves with the market and liquidity conditions.
2/ The list of tokens for which we’re able to process the annualized Sortino ratio has expanded significantly, from around 200 at the beginning of this year to more than 600 today ! This has been facilitated by the automation of our tools and the development of a dedicated script in Trading View .

  • How would this composition have changed over the course of the backtest ?

Illustrated below is the evolution of iRobot’s composition from 1st May to 1st July, taking the monthly rebalance constraint into account :

It is interesting to note that, despite the global market volatility, the selection of tokens composing the Robot Index would have stayed fairly consistent. The biggest rebalancing operations, notably 1 month after inception (-5.6% for LON, -3.5% for RLY & +9% for QUICK), would have focused on tokens offering the deepest liquidity (pools ranging from $20m to $30m) without compromising the methodology’s principles nor the index performance.
This and the 2 observations below confirm that, in the current market conditions, on-chain liquidity needs to be considered on a case-by-case basis during the index determination phase :
1/ While pushing the maximum number of components above 15 worked well in a bull trend to minimize the ratio trade size / token liquidity, it would have had a rather detrimental effects on iRobot’s performance in this new context : possible, but not ideal.
2/ Given the significant liquidity discrepancies between all candidates tokens, an “MVI-like” liquidity-weighting would have increased even more the composition bias towards QUICK.

  • How would this portfolio have performed since the beginning of the crypto market turmoil mid May ?

Illustrated below are iRobot’s average performance metrics from :

  • 1st to 31st May
  • 1st to 30th June
  • 1st to 22nd July

Again, the focus has been put explicitly on this period to simulate the worst possible market conditions for the product launch :

The average daily return and the standard deviation of negative returns are the 2 components of the Sortino ratio (see this article for a detailed mathematical definition).

In TradFi, the Sortino ratio has established itself as a more accurate indicator than its counterpart, the Sharpe ratio, to track a portfolio’s risk-adjusted return.

Here is how iRobot’s annualized Sortino ratio looks like compared to its benchmarks for each sub-period :

While May has been challenging from all point of views, it is interesting to confirm that iRobot would have been able to absorb similar levels of downside volatility as DPI, while starting to produce more return than the majority of its benchmarks as soon as June.

This trend has clearly accelerated in the last few days in parallel with the global market recovery, exacerbating the upside potential of iRobot’s components such as AXS, WOO or QUICK.

Here is the global Sortino ratio ranking based on the dataset covering all days between 1st May and 22nd July :

To date, the Robot Index outperforms all benchmarks from this perspective excepting ETH. The computation of cumulative returns for each asset confirms this result :

iRobot cumulative returns outperform DPI by ~ 5.8%, BED by ~ 3.3% and BTC alone by ~ 19.2% while ETH still benefits from an impressive rally during the 1st 2 weeks of May.

Given the current form of iRobot’s components, we’re impatiently waiting for the final results of this backtest on 31st July before going into DG1 : this will maximize the available data and the transparency for the vote.

It should also be reminded that this performance can be further improved by switching from a monthly to a bi-weekly rebalancing cadence !

Methodology recap

1/ Token inclusion criteria :

  • The token must be available on the Ethereum blockchain. This is subject to change if the Set Protocol infrastructure allows multi-chain indexes in the future.
  • The token must have at least 1 month of price and liquidity history : from our previous research, this is the minimum amount of time required for the annualized Sortino ratio to stabilize in a plausible range - while allowing to capture the upside potential of the token.
  • The token must have sufficient DEX liquidity to support inclusion (currently estimated minimum threshold : $4M liquidity pool). If a token has insufficient liquidity, it will be removed from the index during the determination phase.
  • The token must be emitted by a project considered to be building a useful protocol or product : projects with Ponzi characteristics, stablecoins, tokens with no utility or existing primarily for entertainment (meme coins for example) will not be included.
  • An independent security audit should have been performed on the protocol and results reviewed by the product methodologist. In the eventuality that no audit has been performed, the methodologist applies subjective judgement of the protocol based on assessment of the criteria above and communications with the team.
  • In the event of a security issue the methodologist will work with the project team to understand the issue and any effects to iRobot holdings. The team is expected to provide users of the protocol with a reliable solution and adequate documentation to ensure transparency about any incidents.

2/ Index weights calculation :

  • The Robot Index composition should include minimum 10 / maximum 15 tokens in order to capture uptrend potential and dilute risk.
  • The index will be maintained monthly at launch, subject to increase to a bi-weekly cadence as engineering constraints & operational overhead becomes less limiting factors.
  • During the final week of the month, the eligible tokens will be ranked by annualized Sortino ratio and weighted in proportion of their respective scores with respect to the overall ratio : this is the determination phase.
  • Following publication of the determination phase outcome, the index composition will change to the new weights during the 1st week of the following month.

3/ Fees :
Fees will be determined between the DG1 and DG2 vote and before the subsequent product launch.

Voting

Decision Gate 1: TBD

Decision Gate 2: TBD

  • Update 2021-07-19 :
    – Mentioned @TenaciousTerrier (:pray:) as IIP reviewer

  • Backtest Update 2021-07-23 :
    – Reassessed liquidity history for all candidate tokens all the way back to 1st May '21 :arrow_right: replaced DEUS & UNI by INJ & MUSE in initial index composition to maximize Sortino ratio.
    – Reviewed subsequent rebalancing operations and iRobot composition on 1st June & 1st July '21.
    – Updated average daily return & standard deviation of negative returns with the new data. Also added annualized Sortino ratio for each sub-period.
    – Upgraded iRobot backtesting spreadsheet to take missing days into account in the global Sortino ratio and the cumulative returns calculation.
    – Added cumulative returns for all assets.

5 Likes

Wow - blown away by the quality of proposals over the past few days. Index Coop’s fall product launch schedule is shaping up to be both extremely exciting and innovative. We are truly building a market leading suite of products.

I can see all the methodologies currently proposed finding clear product market fit and driving innovation for DeFi as a whole. It seems clear that indexes may play an even bigger role in DeFi than they do in tradfi.

I’m incredibly bullish on this full line up and hope we can launch as many of these as possible. It seems clear that some of the extremely tight engineering constraints faced by our community over the past few months are starting to lift - opening the gates for even more product launches.

Excited to dive further into this proposal and get $iRobot launched.

5 Likes

Hi bloom.fi

Could you clarify if the average daily return in the chart is a simple average or geometric average? Also, it may be helpful to include the cumulative returns of the various products from start to the end of the test period.

Would you please also clarify if the annualized sortino ratio was obtained by annualizing the average daily return and standard deviations or monthly values? I bring this up because daily fluctuations can be very noisy and can result in undue penalty.

Thank you!

3 Likes

Hey @Ahuja,

Thanks for raising these interesting points !

1/ The average daily return in the chart is a simple average over the considered period. It aims to illustrate variations in price of the corresponding asset or basket of assets from one day to another, without taking into account any notion of compounding.

2/ Adding the cumulative returns to the graph is a good idea, I’m working on it and will update the graphs accordingly before DG1.

3/ The annualized Sortino ratio was obtained by annualizing the average daily return and standard deviations. In order to be as transparent as possible and include more data from the month of July than what was taken into account here, I plan to release an update of the above backtest results just before DG1.

I hope I was able to answer your questions, let me know if you need anything else.

Backtest Update 2021-07-23 :
– Reassessed liquidity history for all candidate tokens all the way back to 1st May '21 :arrow_right: replaced DEUS & UNI by INJ & MUSE in initial index composition to maximize Sortino ratio.
– Reviewed subsequent rebalancing operations and iRobot composition on 1st June & 1st July '21.
– Updated average daily return & standard deviation of negative returns with the new data. Also added annualized Sortino ratio for each sub-period.
– Upgraded iRobot backtesting spreadsheet to take missing days into account in the global Sortino ratio and the cumulative returns calculation.
– Added cumulative returns for all assets.

1 Like