Understanding the Different Types of Science and Technology Indicators

How do we measure something as complex as a nation’s scientific progress? You cannot simply weigh it or count it in a single number. Science and technology activity involves money, people, ideas, discoveries, and their long-term effects on society. To make sense of all this, researchers and policymakers use science and technology (S&T) indicators-statistical measures that capture different aspects of scientific and innovative activity. Just as economists use indicators like GDP to assess the health of an economy, scientometricians use S&T indicators to gauge the health of a country’s research ecosystem. But not all indicators measure the same thing or work at the same scale. Understanding the major types helps you read research reports, policy documents, and rankings with a much sharper eye.

What science and technology indicators actually measure 🔗

An S&T indicator is more than a piece of raw data. It is a meaningful measure constructed from statistics about the science and technology system, designed to reveal something about its performance. According to the OECD, these indicators describe a science and innovation system’s strengths, weaknesses, and unique features, allowing countries and institutions to benchmark their performance and shape better policies.

The key word is constructed. A single number, such as the amount of money spent on research, becomes an indicator only when it is placed in a meaningful context, for example as a percentage of national income. The whole field draws heavily on the logic of economics. Scientometrics has followed the trajectory of econometrics in its use of quantitative data, models, and statistical techniques to measure the “health” of scientific and technological activity.

Indicators are usually grouped into pairs of opposites that help analysts decide what to measure and why. The three most important pairs are input versus output, qualitative versus quantitative, and macro versus micro. Each pair answers a different question about the research system.

Input versus output indicators 🔗

The most fundamental distinction is between what goes into the science system and what comes out of it. Think of research as a process: resources flow in, activity happens, and results flow out. Input indicators measure the resources, while output indicators measure the results.

Input indicators: the resources fed into science 🔗

Input indicators are mainly built from financial and human-resource statistics. They tell us how much a country or institution is investing in research. The most widely used input indicator is GERD, or Gross Expenditure on Research and Development, which is the total spending on R&D in a country. To allow fair comparisons between large and small economies, GERD is often expressed as a percentage of GDP, a measure known as R&D intensity.

The other major category of input is manpower, or the human resources devoted to research-the number of scientists, engineers, and technicians working in R&D. In India, the agency responsible for collecting this data is the National Science and Technology Management Information System (NSTMIS) under the Department of Science and Technology. According to NSTMIS data, India’s gross expenditure on R&D nearly tripled between 2008 and 2018, driven mainly by the government sector.

One notable feature of the Indian system is the source of funding. In most leading economies, the corporate sector accounts for roughly two-thirds of national R&D spending. In India, the private sector’s share has historically been much lower, at around 37 percent of gross domestic expenditure on R&D, with the government carrying much of the load. This is exactly the kind of insight that input indicators reveal.

Output indicators: the results science produces 🔗

Output indicators are constructed from the tangible products of research. As the foundational scientometric literature explains, indicators built from research papers, patents, standards, significant innovations, and product announcements are output indicators. They tell us what all that investment has actually produced.

The two most common output indicators are publications and patents. Counts of scientific papers measure the production of new knowledge, while patent counts measure inventive and commercial activity. Output indicators of science have an interesting history-they emerged from the development of the Science Citation Index during the 1950s and 1960s, when the scientific community grew concerned about the rapid expansion of scientific literature and needed tools to track it.

A crucial point is that inputs are generally easier to measure than outputs. The reason is practical: as one review of S&T measurement notes, inputs are easier to measure because some entity is paying for them, which gives us a natural way to aggregate them using money spent. Outputs like new knowledge or social impact are harder to pin down with a single figure.

Beyond inputs and outputs, analysts also speak of outcomes and impacts-the near-term and long-term effects of technology on the economy and society. These are the hardest of all to measure, because the value of an idea may only become clear years later. This is why measurement frameworks often picture a kind of “black box” where inputs are transformed into measurable outputs, with much of the actual process remaining hard to observe.

Qualitative versus quantitative indicators 🔗

The second major distinction concerns the nature of the measurement itself. Is it a number, or is it a judgement?

Quantitative indicators: measuring with numbers 🔗

Quantitative indicators are numerical. They include all the counts and ratios we have already discussed-rupees spent, papers published, patents granted, citations received. Their great strength is that they are objective, comparable, and can be processed at scale. You can compare the publication output of fifty universities in a spreadsheet, something no human committee could do by reading every paper.

Citation-based measures are a sophisticated form of quantitative indicator. Because not all publications contribute equally to knowledge, the OECD uses citation data to approximate the relevance and impact of scientific output, for example by counting how many of a country’s publications fall among the world’s 10 percent most-cited publications. On this measure, the footprint of countries like China and India in top-cited research has been steadily growing.

Qualitative indicators: measuring with expert judgement 🔗

Qualitative indicators rest on human expertise rather than raw numbers. The central method here is peer review, where experts assess the quality, originality, and significance of research. Numbers alone cannot tell you whether a discovery is genuinely groundbreaking or merely well-publicized. Quality control across different disciplines is difficult to justify using counts alone, which is why expert judgement remains essential.

There is an ongoing and lively debate about the right balance between the two. Critics argue that an over-reliance on numbers reduces complex research achievements to mere numbers rather than genuine engagement with the work. The emerging consensus is not to choose one over the other but to combine them. Many evaluators now practise what is called informed peer review, where experts make qualitative judgements supported by quantitative data. As scientometric researchers point out, advanced bibliometric indicators offer much more than “only numbers”-they reveal patterns of influence and scientific communication that inform, rather than replace, expert assessment.

Macro versus micro indicators 🔗

The third distinction is about scale. The same kind of data can be aggregated at very different levels, and the level you choose changes the questions you can answer.

Macro indicators: the national and global picture 🔗

Macro-level indicators describe large units such as entire countries, regions, or broad scientific disciplines. National GERD as a percentage of GDP is a classic macro indicator. So is a country’s total share of the world’s scientific publications. Historically, the development of science indicators began at this macro level, with early work focused on the macro-evaluation of nations and disciplines before attention turned to smaller units.

Macro indicators are the tools of national policy. They answer questions like: Is India investing enough in research compared to its peers? The OECD’s Main Science and Technology Indicators database, for instance, covers a large set of indicators specifically designed to compare the S&T performance of countries over time. India’s official R&D statistics are deliberately aligned with UNESCO and OECD standards precisely so that such international comparisons are possible.

Micro indicators: institutions, groups, and individuals 🔗

Micro-level indicators zoom in on smaller units-a single university, a research group, a laboratory, or even an individual scientist. The h-index, which measures an individual researcher’s productivity and citation impact, is a well-known micro indicator. The evaluation of research using scientometric indicators at the institutional and individual level emerged in the first half of the 1980s, somewhat later than macro-level analysis.

Micro indicators are useful for management decisions inside an organization, such as allocating internal funding or assessing a department’s strengths. However, they must be handled with great care. Citation patterns differ enormously between fields-a heavily cited paper in biology might dwarf the citation counts of an excellent paper in mathematics. At the micro level, where sample sizes are small, a single outlier can distort the picture. This is why micro indicators are most reliable when combined with qualitative peer judgement.

Why these distinctions matter together 🔗

No single indicator gives a complete view. A country might score well on input indicators by spending heavily on R&D, yet lag on output indicators if that money does not translate into publications and patents. A university might have impressive quantitative metrics yet receive a lukewarm qualitative assessment from expert reviewers. A scientist who looks average on macro-level national statistics might be a leading figure when examined with micro-level indicators.

The skill in scientometrics lies in choosing the right combination of indicators for the question at hand and reading them in relation to one another. The international standard for measuring R&D, the OECD’s Frascati Manual, exists precisely to ensure that these measures are defined consistently so they can be compared meaningfully across the world. When you next encounter a science ranking or a government report on research, ask yourself which type of indicator it relies on-and which types it might be quietly leaving out.

What do you think? If you had to evaluate the research strength of your own college or university, which indicators would you trust most-the quantitative counts of papers and funding, or the qualitative judgements of expert reviewers? And do you think India’s heavy reliance on government funding, rather than private-sector investment, is a strength or a weakness for its long-term scientific output?

References

1. https://www.oecd.org/en/topics/science-technology-and-innovation-indicators.html
2. https://ebooks.inflibnet.ac.in/liscp10/chapter/science-indicators/
3. https://dst.gov.in/indias-rd-expenditure-scientific-publications-rise
4. https://www.sanskritiias.com/current-affairs/transforming-indias-rd-statistics
5. https://arxiv.org/pdf/0911.1044
6. https://people.brandeis.edu/~ajaffe/Hall-Jaffe%20HJ12_indicators_final.pdf
7. https://www.socialsciencespace.com/2024/09/research-assessment-scientometrics-and-qualitative-v-quantitative-measures/
8. https://link.springer.com/article/10.1007/BF02129602
9. https://arxiv.org/pdf/0911.3558
10. https://www.oecd.org/en/data/datasets/main-science-and-technology-indicators.html