Lessons from finance’s experience with artificial intelligence

Posted By: Jogendra Kumar Posted On: Aug 06, 2023
Ai and machine-learning funds seemed like the final step in the march of the robots.(REUTERS)

Who are the earliest adopters of new technologies? Cutting-edge stuff tends to be expensive, meaning the answer is often the extremely rich. Early adopters also tend to be incentivised by cut-throat competition to look beyond the status quo. As such, there may be no group more likely to pick up new tools than the uber-rich and hyper-competitive hedge-fund industry.

This rule appears to hold for artificial intelligence (ai) and machine learning, which were first employed by hedge funds decades ago, well before the recent hype. First came the “quants”, or quantitative investors, who use data and algorithms to pick stocks and place short-term bets on which assets will rise and fall. Two Sigma, a quant fund in New York, has been experimenting with these techniques since its founding in 2001. Man Group, a British outfit with a big quant arm, launched its first machine-learning fund in 2014. AQR Capital Management, from Greenwich, Connecticut, began using ai at around the same time. Then came the rest of the industry. The hedge funds' experience demonstrates ai's ability to revolutionise business—but also shows that it takes time to do so, and that progress can be interrupted.

Ai and machine-learning funds seemed like the final step in the march of the robots. Cheap index funds, with stocks picked by algorithms, had already swelled in size, with assets under management eclipsing those of traditional active funds in 2019. Exchange-traded funds offered cheap exposure to basic strategies, such as picking growth stocks, with little need for human involvement. The flagship fund of Renaissance Technologies, the first ever quant outfit, established in 1982, earned average annual returns of 66% for decades. In the 2000s fast cables gave rise to high-frequency market makers, including Citadel Securities and Virtu, which were able to trade shares by the nanosecond. Newer quant outfits, like AQR and Two Sigma, beat humans' returns and gobbled up assets.

By the end of 2019, automated algorithms took both sides of trades; more often than not high-frequency traders faced off against quant investors, who had automated their investment processes; algorithms managed a majority of investors' assets in passive index funds; and all of the biggest, most successful hedge funds used quantitative methods, at least to some degree. The traditional types were throwing in the towel. Philippe Jabre, a star investor, blamed computerised models that had “imperceptibly replaced” traditional actors when he closed his fund in 2018. As a result of all this automation, the stock market was more efficient than ever before. The execution was lightning fast and cost next to nothing. Individuals could invest savings for a fraction of a penny on the dollar.

Machine learning held the promise of still greater fruits. The way one investor described it was that quantitative investing started with a hypothesis: that of momentum, or the idea that stocks which have risen faster than the rest of the index would continue to do so. This hypothesis allows individual stocks to be tested against historical data to assess if their value will continue to rise. By contrast, with machine learning, investors could “start with the data and look for a hypothesis”. In other words, the algorithms could decide both what to pick and why to pick it.

Yet automation's great march forward has not continued unabated—humans have fought back. Towards the end of 2019 all the major retail brokers, including Charles Schwab, E-trade and TD, Ameritrade, slashed commissions to zero in the face of competition from a new entrant, Robinhood. A few months later, spurred by pandemic boredom and stimulus cheques, retail trading began to spike. It reached a peak in the frenzied early months of 2021 when day traders, co-ordinating on social media, piled into unloved stocks, causing their prices to spiral higher. At the same time, many quantitative strategies seemed to stall. Most quants underperformed the markets, as well as human hedge funds, in 2020 and early 2021. AQR closed a handful of funds after persistent outflows.

When markets reversed in 2022, many of these trends flipped. Retail's share of trading fell back as losses piled up. The quants came back with a vengeance. AQR's longest-running fund returned a whopping 44%, even as markets shed 20%.

This zigzag, and robots' growing role, holds lessons for other industries. The first is that humans can react in unexpected ways to new technology. The falling cost of trade execution seemed to empower investing machines—until costs went to zero, at which point it fuelled a retail renaissance. Even if retail's share of trading is not at its peak, it remains elevated compared with before 2019. Retail trades now make up a third of trading volumes in stocks (excluding market makers). Their dominance of stock options, a type of derivative bet on shares, is even greater.

The second is that not all technologies make markets more efficient. One of the explanations for Aqr's period of underperformance, argues Cliff Asness, the firm's co-founder, is how extreme valuations became and how long a “bubble in everything” persisted. In part this might be the result of overexuberance among retail investors. “Getting information and getting it quickly does not mean processing it well,” reckons Mr Asness. “I tend to think things like social media make the market less, not more, efficient...People don't hear counter-opinions, they hear their own, and in politics that can lead to some dangerous craziness and in markets that can lead to some really weird price action.”

The third is that robots take time to find their place. Machine-learning funds have been around for a while and appear to outperform human competitors, at least a little. But they have not amassed vast assets, in part because they are a hard sell. After all, few people understand the risks involved. Those who have devoted their careers to machine learning are acutely aware of this. In order to build confidence, “we have invested a lot more in explaining to clients why we think the machine-learning strategies are doing what they are doing,” reports Greg Bond of Man Numeric, Man Group's quantitative arm.

There was a time when everyone thought the quants had figured it out. That is not the perception today. When it comes to the stock market, at least, automation has not been the winner-takes-all event that many fear elsewhere. It is more like a tug-of-war between humans and machines. And though the machines are winning, humans have not let go just yet.

For more expert analysis of the biggest stories in economics, finance and markets, sign up to Money Talks, our weekly subscriber-only newsletter.

© 2023, The Economist Newspaper Limited. All rights reserved. From The Economist, published under licence. The original content can be found on www.economist.com

Source: Hindustan Times
Related Posts:

Comment on Post

Leave a comment

If you have a News HTS user account, your address will be used to display your profile picture.

POPULAR News

icon
Bussiness Petrol and diesel prices In India remained stagnant on Thursday, continuing the year long price stability, that has been seen since May 21 last year, when the previous pan-India revision to fuel rates was carried out. Prices across major cities including New Delhi, Kolkata, Mumbai, Chennai did not r
icon
Bussiness Stocks to Watch: Nifty futures traded 26 points, or 0.13 per cent, higher at 19,816, signaling that Dalal Street was headed for a positive start on Monday. Here's a slew of stocks that will be in focus today for various reasons. Stocks to Watch: Nifty futures traded 26 points, or 0.13 per cent, higher at 1
icon
Bussiness OMG 2, directed by Amit Rai, received a warm welcome from the audience. The film, featuring Pankaj Tripathi, Akshay Kumar, and Yami Gautam, achieved a strong opening at the domestic box office on its first day of release. OMG 2, directed by Amit Rai, received a warm welcome from the audience. The film, f
icon
Bussiness Power trading solutions provider PTC India on Saturday posted a 5.62 per cent year-on-year rise in its consolidated net profit at ₹142.70 crore for the April-June quarter of this fiscal, mainly on the back of higher revenues. Power trading solutions provider PTC India on Saturday posted a 5.62 per ce
icon
Bussiness As the deadline for filing Income Tax Returns (ITR) is just one day away, the department stated that more than 6 crore tax returns have been filed for income earned in the 2022-23 fiscal year as of Sunday evening. A total of 27 lakh ITRs have been received by the income tax department, number which has surp
icon
Bussiness Petrol, and Diesel Prices on August 10: The price of Petrol and Diesel remained constant on Wednesday, August 10 across major cities like New Delhi, Kolkata, Mumbai, and Chennai. The petrol and diesel rates for each day, whether new or constant, are announced at 6 am on the day. These, however, vary fro
icon
Bussiness RBI MPC Meeting 2023 Live Updates: Will Guv Das Hike Repo Rate Or Leave it Unchanged? Updated 1 hour ago
icon
Bussiness LPG Cylinder Rates: Oil marketing companies have cut the price of 19 kg LPG gas cylinders across the country. There has been a reduction of Rs 100 in Delhi. At the same time, a reduction of around Rs 93 has been made in other metros. Now 19 kg cylinder will be available in Delhi for Rs 1680, which was till now a
icon
Bussiness Petrol, and Diesel Prices on July 31: The price of Petrol and Diesel remained constant on Monday, July 31 across major cities like New Delhi, Kolkata, Mumbai, and Chennai. The petrol and diesel rates for each day, whether new or constant, are announced at 6 am on the day. These, however, vary from state t
icon
Bussiness Balrampur Chini Mills posted strong Q1 results on Saturday as their profit jumped a whopping 493% to touch ₹73.5 crore during the quarter ending June 2023. During the same quarter last fiscal, the company posted consolidated net profit of ₹12.38 crore. The revenue of the company rose 28% from ₹1,094.
icon
Bussiness The price of gold marginally dropped on Thursday, with the cost of 1 gram of 22 carat gold declining to ₹5,495 from yesterday's ₹5,505, as per the figures released by Goodreturns. Accordingly, the price of 8 grams of 22 carat gold also decreased to ₹43,960 from the previous figure of ₹44,040, marking a p
icon
Bussiness Reliance Industries Ltd, India's most valuable company, has sought shareholder's approval to give Mukesh Ambani another five-year term as chairman and managing director of the company till 2029 -- a period during which he has opted to draw nil salary.
icon
Bussiness Go First airline, which has been grounded since early May, has announced a further extension of flight cancellations till July 31, the airline announced in a tweet on Sunday. Go First airline, which has been grounded since early May, has announced a further extension of flight cancellations till Jul
icon
Bussiness In order to settle the pending contractual disputes of government and government undertakings, the finance ministry has launched the ‘Vivad se Vishwas II – (Contractual Disputes)' scheme, according to an official statement released on Wednesday. Finance Minister Nirmala Sitharam announced th
icon
Bussiness IT electronics refurbishing firm NewJaisa Technologies's initial public offering (IPO) will be open for subscription on Monday, i.e September 25. The company aims to raise ₹39.93 crore through its IPO. The issue will close for subscription on September 27. The company's IPO had opened for anchor investors on Friday. The fresh issue size is of 84,96,000 equity shares at face value of ₹5 each.
icon
Bussiness The Reserve Bank of India (RBI) has announced the launch of the Pilot Project for Public Tech Platform for Frictionless Credit by Reserve Bank Innovation Hub (RBIH), a wholly-owned subsidiary of the RBI. The Reserve Bank of India (RBI) has announced the launch of the Pilot Project for Public Tech Platform for Frictionless Credit by Reserve Bank Innovation Hub (RBIH), a wholly-owned subsidiary of the RBI.
icon
Bussiness Gogoro In, a global technology leader in battery-swapping ecosystems that enable sustainable mobility solutions for cities, today announced a vehicle partnership with Swiggy, India’s leading on-demand convenience delivery platform. Gogoro In, a global technology leader in battery-swapping ecosystems that enable sustainable mobility solutions for cities, today announced a vehicle partnership with Swiggy, India’s leading on-demand convenience delivery platform.
icon
World Ukrainian President Volodymyr Zelensky arrived in the Netherlands on Sunday aiming to strengthen his country's air power, a day after a “heinous" Russian missile strike killed seven people and wounded 148 in Chernihiv. Ukrainian President Volodymyr Zelensky arrived in the Netherlands on Sunday aiming to strengthen his country's air power, a day after a “heinous" Russian missile strike killed seven people and wounded 148 in Chernihiv.
icon
Bussiness India's foreign exchange reserves jumped $708 million to $602.161 billion for the week ended August 11, the Reserve Bank of India (RBI) said on Friday. This is the first increase in the kitty after declining for three consecutive weeks. In the previous reporting week, the overall reserves had declined $2.417 billion to $601.453 billion.
icon
World China has released a new documentary about the army's preparation to attack Taiwan and showcasing soldiers pledging to give up their lives if needed as Beijing continues to ramp up its rhetoric against the self-ruled island. China has released a new documentary about the army's preparation to attac
icon
Life Style Disha Patani went out for a dinner date with her friends last night. The actor got clicked by the paparazzi outside a restaurant in Mumbai. Known for embracing risqué fashion statements, Disha slayed another look for the outing. She wore a golden mini dress featuring intricately-placed cut-outs. Sc
icon
Latest News Sunny Deol's Gadar 2 craze has truly gripped the nation with fans thronging to cinema halls in large numbers. The Anil Sharma directorial also managed to collect around Rs 39 crore on the day of the release, making it the second highest grosser of the year after Pathaan. Celebrating this tremendous res
icon
Latest News The incident took place on Sunday at the Hawthorne Race Course in Illinois. The incident took place on Sunday at the Hawthorne Race Course in Illinois. The incident took place on Sunday at the Hawthorne Race Course in Illinois. The incident took place on Sunday at the Hawthorne Race Course in Illinois.
icon
Latest News NEW DELHI: Union minister Jitendra Singh on Saturday said, BRICS (Brazil, Russia, India, China and South Africa) should continue to hold global significance for being the most populated marketplace, driven by the knowledge, creativity and innovation economy.
icon
Technology The approach of Digital Public Infrastructure, which has gained global prominence, can also help in the area of climate adaptation and mitigation going forward, Chairman and Co-Founder of Infosys and the founding Chairman of UIDAI, Nandan Nilekani said on Sunday.