HSE Experts Reveal Low Accuracy of Technology Forecasts in Transportation
HSE researchers evaluated the accuracy of technology forecasts in the transportation sector over the past 50 years and found that the average accuracy rate does not exceed 25%, with the lowest accuracy observed in aviation and rail transport. According to the scientists, this is due to limitations of the forecasting method and the inherent complexities of the sector. The study findings have been published in Technological Forecasting and Social Change.
Today, foresight methods are widely used to inform science and technology policies, national strategies, and investment programmes. Delphi surveys are a key forecasting tool; they involve a structured process for reaching consensus among a group of experts through anonymous, multi-round surveys with controlled feedback. However, the question of how accurate such forecasts are—and whether they can reliably inform decision-making—remains open.
A team of scientists from the Foresight Centre at the Institute for Statistical Studies and Economics of Knowledge and the Institute of Transport Economics and Transport Policy Studies of HSE University analysed several rounds of Japan's Delphi surveys on technology foresight in the transportation sector. The analysis included 647 observations across 167 topics, ranging from high-speed rail to autonomous vehicles.
Japan presents a unique case: since the 1970s, the country has regularly conducted large-scale Delphi surveys of experts on the prospects of science and technology, making it possible not only to analyse current expectations but also to compare past forecasts with actual outcomes.
The researchers’ conclusions were unexpected: the accuracy of predictions about technological developments in transport made using the classical Delphi method is only 25%, meaning that three out of four forecasts have not been realised. The scientists suggest that the low accuracy rate may result from both the structural complexities inherent in the sector and the limitations of the Delphi method.
Tatiana Kulakova
'Transport can be described as a system of systems: it consists of numerous heterogeneous infrastructure facilities and different modes of transport that are managed and operated independently, yet together form a unified system that is continuously evolving through innovation,' says Tatiana Kulakova, Director of the Institute for Transport Economics and Transport Policy Studies at the HSE Faculty of Urban and Regional Development.
However, environmental constraints, institutional inertia, and the long lifecycle of transport infrastructure significantly limit the sector’s development and delay the adoption of innovations beyond a reasonable planning horizon.
The second reason for the low accuracy of forecasts is the systemic limitation of the Delphi method. It was found that the second round of a Delphi survey—intended to refine and confirm forecasts—may not bring experts closer to consensus but instead increase the dispersion of their estimates.
Olesia Maibakh
'Traditionally, the Delphi method is regarded as the most reliable expert-based forecasting tool, which creates inflated expectations about the accuracy of its predictions. The observed decrease in accuracy in the second round (23.4% compared to 26.4% in the first round) calls into question one of the method’s key assumptions—that iteration automatically improves the accuracy of estimates,' explains Olesia Maibakh, Head of the Foresight Research Methodology and Organisation Unit at the HSE Foresight Centre, and the study author.
According to Maibakh, in practice, feedback can increase conformist pressure by suppressing unconventional but potentially accurate assessments. 'As an alternative to the classic second round, it may be more effective to hold foresight sessions that discuss disagreements, treating discrepancies in estimates as a resource rather than as noise,' Maibakh suggests.
Another unexpected finding was the 'forecastability pit' effect, where the accuracy of forecasts does not correlate with the stage of a technology’s maturity. Intuitively, one might expect that the closer a technology is to practical deployment, the easier it would be to assess its prospects. However, the scientists observed that technologies in the middle stages—when they are first introduced into practical use or undergoing initial improvements—exhibit the lowest forecasting accuracy. In contrast, forecasts for technologies at earlier stages of research and development, as well as those in later stages of adoption and scale-up, were much more accurate.
Alexey Sukharev
'The low accuracy of medium-term forecasts may reflect the so-called "valley of death" effect, where technologies fail to reach the market for economic rather than technological reasons. The frequent errors made by Delphi survey experts in medium-term predictions may stem from the difficulty of determining which of several similar technological solutions will succeed commercially. For example, predicting the dominance of battery electric vehicles over hydrogen fuel cell vehicles proved challenging,' says Alexey Sukharev, an expert at the Foresight Centre.
According to the authors, improving the accuracy of long-term forecasts requires a reassessment of traditional approaches to expert analysis. Forecasting should primarily focus on industry models that account for sector-specific regulatory and infrastructural constraints. Additionally, it is important to combine multiple foresight methods to improve predictive success. The classical Delphi method should be complemented by big data analysis, system dynamics modelling, and scenario planning to help mitigate experts’ cognitive biases.
See also:
The 'Second Shift' Is Not Why Women Avoid News
Women are more likely than men to avoid political and economic news, but the reasons for this behaviour are linked less to structural inequality or family-related stress than to personal attitudes and the emotional perception of news content. This conclusion was reached by HSE researchers after analysing data from a large-scale survey of more than 10,000 residents across 61 regions of Russia. The study findings have been published in Woman in Russian Society.
Resource Race and Green Transition: Three Unexpected Conclusions from Foresight Centre’s Research on Climate and Poverty
Beneath the surface of green energy—which most people associate with solar panels, electric vehicles, and reduced CO2 emissions—lies a complex web of geopolitical interests, international inequality, and resource constraints. Researchers from the Laboratory for Science and Technology Studies (LST) at the HSE ISSEK Foresight Centre have published a series of articles in leading international journals on hidden and overt conflicts surrounding critically important metals and minerals, as well as related processes in the energy sector.
Immersion in Second Language Environment Influences Bilinguals’ Perception of Emotions
Researchers at the Cognitive Health and Intelligence Centre at the HSE Institute for Cognitive Neuroscience have discovered how bilingual individuals process emotional words in their native (first) and non-native (second) languages. It was found that the link between word meaning and bodily sensations is weaker in a second language than in a first language. However, the more a person is immersed in a language environment, the smaller this difference becomes. The article has been published in Language, Cognition and Neuroscience.
Researchers Find More Effective Approach to Revealing Majorana Zero Modes in Superconductors
An international team of researchers, including physicists from HSE MIEM, has demonstrated that nonmagnetic impurities can help more accurately reveal Majorana zero modes—quantum states considered promising building blocks for quantum computing. The researchers found that these impurities shift the energy levels that typically obscure the Majorana signal, while leaving the mode itself largely unaffected, thereby making its spectral peak more distinct. The study has been published in Research.
New Development by HSE Scientists Helps Design Reliable Electronics Faster at a Lower Cost
Scientists from HSE MIEM have developed a new approach to modelling electrothermal processes in high-power electronic circuits on printed circuit boards (PCB). The method allows engineers to quickly and accurately predict how electronic components heat up during operation, helping prevent overheating and potential failures. The results have been published in Russian Microelectronics.
The Future of Cardiogenetics Lies in Artificial Intelligence
Researchers from the AI and Digital Science Institute at the HSE Faculty of Computer Science have developed a program capable of analysing regions of the human genome that were previously inaccessible for accurate interpretation in genetic testing. The program adapts large generative AI (GenAI) models for cardiogenetics to predict how specific mutations affect the function of individual genes.
HSE Researchers: Young Russians Have Sufficient Knowledge About Money but Lack Money Management Skills
Adolescents and young adults in Russia today are well versed in financial terminology: they know what bank cards, loans, interest rates, and online payments are. However, as researchers at HSE University have found, real money-management skills remain poorly developed among most young people. The study ‘Financial Literacy, Financial Culture, and Financial Autonomy of Youth’ has been published in Monitoring of Public Opinion: Economic and Social Changes.
Why Weaker Competitors Give Up—and How to Keep Them in the Game
Anastasia Antsygina, Assistant Professor at HSE University’s Faculty of Economic Sciences, has developed a prize distribution model that maximises competitor engagement. She proposed revising the traditional ‘winner-takes-all’ approach and, in certain cases, offering a small reward even to those who have lost. According to her, this could increase participant motivation and make the competition more intense. The findings of her research were published in the Economic Theory journal.
HSE Researchers Compile Scientific Database for Studying Children’s Eating Habits
The database created at HSE University can serve as a foundation for studying children’s eating habits. This is outlined in the study ‘The Influence of Age, Gender, and Social-Role Factors on Children’s Compliance with Age-Based Nutritional Norms: An Experimental Study Using the Dish-I-Wish Web Application.’ The work has been carried out as part of the HSE Basic Research Programme and was presented at the XXVI April International Academic Conference named after Evgeny Yasin.
New Foresight Centre Study Identifies the Most Destructive Global Trends for Humankind
A team of researchers from the HSE International Research and Educational Foresight Centre has examined how global trends affect the quality of human life—from life expectancy to professional fulfilment. The findings of the study titled ‘Human Capital Transformation under the Influence of Global Trends’ were published in Foresight.