New Clustering Method Simplifies Analysis of Large Data Sets
Researchers from HSE University and the Institute of Control Sciences of the Russian Academy of Sciences have proposed a new method of data analysis: tunnel clustering. It allows for the rapid identification of groups of similar objects and requires fewer computational resources than traditional methods. Depending on the data configuration, the algorithm can operate dozens of times faster than its counterparts. The study was published in the journal Doklady Rossijskoj Akademii Nauk. Mathematika, Informatika, Processy Upravlenia.
Each year, the volume of information requiring processing continues to grow. Data comes from a variety of sources: scientific research, financial reports, medical examinations, and many others. Clustering methods—which group data based on similar characteristics—are used to detect patterns and organise information within such large datasets. These groupings are known as clusters.
One of the most widely used clustering methods is the k-means algorithm. It divides data into a predetermined number of clusters, initially selecting their centres (centroids). However, this method has a limitation: the number of clusters must be known beforehand, which is not always possible when dealing with complex data. Scientists from HSE University and the V.A. Trapeznikov Institute of Control Sciences have proposed a new approach to simplify this process—tunnel clustering. Unlike the k-means method, this algorithm does not require the number of clusters to be set in advance; it determines the necessary number itself by analysing the data structure.
‘The algorithm forms “tunnels” in the data—regions in multidimensional space where objects with similar characteristics group together,’ explained Fuad Aleskerov, Head of the Department of Mathematics at the HSE Faculty of Economic Sciences. ‘Users can choose from three modes of operation: with fixed cluster boundaries, with adaptive boundaries that adjust to the data structure, or a combined approach. This makes the method flexible and suitable for various types of tasks.’
The method was tested on a synthetic (artificially generated) dataset of 100,000 objects, as well as on real-world tasks in public administration and the banking sector.
The main advantage of the new method is its speed. Unlike classical algorithms that demand significant computational resources, tunnel clustering can, depending on the data configuration, perform the analysis dozens of times faster.
In addition, the researchers introduced the concept of the ‘transition degree’—a parameter indicating how many characteristics of an object must change for it to be classified into a different cluster. This helps assess the clarity of cluster boundaries and identify objects situated at the intersection of different groups.
‘People are generating more and more data, and the pace is only accelerating. According to the latest Digital 2025: Global Overview Report, as of early 2025, there were 5.56 billion internet users—nearly 68% of the global population. Adults spend an average of 6 hours and 38 minutes online each day, communicating, working, watching videos, and consuming content,’ said Alexey Myachin, Senior Research Fellow at the HSE International Centre for Decision Choice and Analysis. ‘Companies that ignore data analysis are losing vast sums of money.’
The authors continue to refine the algorithm, including conducting research into dimensionality reduction, which will help further decrease the time required to identify patterns in data.
The study was carried out with partial support from the Russian Science Foundation.
See also:
Physicists Find a Way to Model Ion Parameters in Plasma in Seconds
Researchers from HSE University and the Moscow Institute of Physics and Technology (MIPT) have developed a set of simple analytical methods for calculating the properties of heavy ions in helium under the influence of a strong electric field. The new approach speeds up calculations of ion mobility and ion–molecule reaction rates by thousands of times while maintaining sufficient accuracy for plasma jet modelling. The findings have been published in the journal Physica Scripta.
Two Years of Growth or Decline: How to Choose an Investment Strategy
Economists from HSE University, together with colleagues from international universities, have analysed stock market movements over almost a century and proposed an investment strategy that could have delivered returns nearly twice as high as the market average. Their research suggests following a momentum strategy during periods of sustained market growth and switching to a value strategy after prolonged market declines. The study has been published in the Journal of Banking and Finance.
Researchers Reveal Link Between Attention and Communication Difficulties in Autism
Researchers at HSE University have examined how communication difficulties in children with autism are related to brain function. The findings show that not only language networks but also attention networks play an important role. The weaker the connections involved in maintaining focus and switching attention, the more pronounced communication difficulties were. The study has been published in European Child & Adolescent Psychiatry.
Scientists Discover Why Some People Wore Masks During COVID-19 While Others Did Not
Why do some people voluntarily follow new rules while others ignore them? Researchers at HSE University have found that the answer lies not so much in people's willingness to cooperate, as previously believed, but in their ability to empathise with others. Empathy proved to be the strongest predictor of whether people chose to wear face masks voluntarily during the COVID-19 pandemic. The findings have been published in Frontiers.
Physicists at HSE University and FIAN Discover Way to 'Photograph' Sound for Testing Materials Used in 6G Communications
Researchers at HSE University, in collaboration with colleagues from the Lebedev Physical Institute of the Russian Academy of Sciences (FIAN), have developed a method for rapidly determining how firmly a film is bonded to a substrate. This is important for the creation of ultrahigh-frequency acoustic filters, which are key components of next-generation 5G and 6G communications. For the first time, researchers have succeeded in measuring the lateral rigidity of the bond between a two-dimensional material film and a substrate in this way. The study results have been published in Applied Physics Letters.
Scientists Create Open Dataset for Studying Concentration
A team of Russian researchers, including scientists from HSE University–St Petersburg, has developed the first open multimodal dataset containing recordings of brain activity, heart function, and video observations to help researchers understand what happens in the human brain during deep concentration. In the future, the dataset could accelerate the development of neural interfaces, rehabilitation technologies, and AI systems. The article has been published in Scientific Data.
Scientists Propose Method for More Efficient Resource Use in Machine Learning
An international group of researchers, including mathematicians from the AI and Digital Science Institute at the HSE Faculty of Computer Science, has provided a theoretical justification for a simple and computationally efficient method of estimating uncertainty in Stochastic Gradient Descent (SGD). The paper has been published on the scientific preprint server arXiv.org and presented at AISTATS 2026.
Team Success: Aligning Means with Objectives
In corporations, sports, and academia, people often face challenges they cannot handle alone. In such cases, selecting the right team is crucial. Tatiana Mayskaya, Associate Professor at the HSE Faculty of Economic Sciences and the International College of Economics and Finance, together with colleagues from foreign universities, examined team characteristics and found that less diverse teams are better suited to objectives where a high average performance is important, whereas more diverse teams are preferable when avoiding failure is critical. The paper has been published in Economic Theory.
Economists Propose More Effective Approach to Reducing Smoking
Economists at HSE University have examined how smokers respond to changes in cigarette prices. When tobacco prices increase, cigarette consumption does not always decline. In fact, spending on tobacco may even rise: according to the researchers, a 1% decrease in cigarette affordability leads to a 0.28% increase in per capita tobacco expenditure. The findings suggest that to reduce smoking rates, tobacco prices must rise faster than household incomes. The study has been published in Voprosy Statistiki.
Biologists Discover Unique Properties of MiR-93-5p MicroRNA in Prostate Cancer
Researchers at the International Laboratory of Microphysiological Systems of the HSE Faculty of Biology and Biotechnology investigated how different isoforms of the same microRNA influence gene function in prostate adenocarcinoma. The study found that in some cases, microRNAs can reinforce each other’s effects by targeting and suppressing the same genes. This finding offers a fresh perspective on the molecular mechanisms underlying tumour development and on the search for disease biomarkers. The results have been published in PeerJ.