Every time you type a question into a search box and get instant results, you are using a technology that took decades to develop. Long before search engines became part of daily life, finding information from electronic databases required trained intermediaries, specialised commands, and expensive subscriptions. Online searching is the systematic process of retrieving relevant information from remote databases through a computer network. For students of Library and Information Science, understanding how it works is fundamental, because it sits at the heart of modern reference work and research support.

Table of Contents

What is online searching?

Online searching refers to the process of interacting with a remote database, stored on a host computer, to locate and retrieve information that answers a specific query. Unlike browsing a physical card catalogue, online searching lets a user query vast collections of bibliographic records, full-text articles, and directory information almost instantly. The core idea behind it belongs to the wider field of information retrieval, which is concerned with locating material relevant to a user’s need from large collections of unstructured or semi-structured data.

The term “information retrieval” itself was coined by Calvin Mooers around 1950, but the practice has much older roots in manual cataloguing and indexing. In the pre-digital era, finding information meant working through card catalogues, printed indexes, and abstracting journals by hand. These systems were thorough but slow, and they struggled as collections grew larger.

The shift from manual to electronic systems

The arrival of computers in the mid-twentieth century changed everything. The need for an information retrieval system arises when a collection becomes so large that traditional cataloguing techniques can no longer cope. As digital storage capacity grew rapidly, the only practical way to find relevant items within enormous text databases was through automated search.

Early electronic databases were primarily bibliographic. They stored citations, abstracts, and indexing terms rather than complete documents. A user, often a trained librarian acting on behalf of a researcher, would dial into a host computer and run searches using a precise command language. This was the world of commercial online services that began in the early 1970s.

The Internet and World Wide Web era

The next major transformation came with the Internet and the World Wide Web. The launch of the Mosaic browser in the early 1990s made networked information accessible to ordinary users for the first time. As the number of information sources on the Web grew astronomically within just a few years, a new problem emerged. Most of these sources were unorganised collections of documents, which created an enormous challenge in locating the right material.

This challenge gave rise to web search engines, which index portions of web documents as full-text databases, and web directories, which classify selected documents by subject. Web searching is best understood as a subset of the broader information retrieval methods that came before it. Today, the field continues to evolve through AI-powered systems and large language models that aim to understand the meaning behind a query rather than just matching keywords.

Effective online searching is far more than typing keywords into a box. It is a systematic process, and following a clear sequence of steps produces better results in less time. Whether you are searching a professional database or a general search engine, the underlying logic is the same.

Step 1: Analyse the query and define the need

The first and most important step is to understand exactly what information is required. This means clarifying the purpose of the search, its scope, and its timeframe. Is the user looking for a quick overview or an exhaustive review of the literature? Are recent publications enough, or is historical material needed? A clearly defined need shapes every decision that follows.

Step 2: Select the appropriate database

Once the need is clear, the searcher must choose where to look. A database is a specific resource that provides access to academic and professional research that is far more thorough than a simple internet search. Different databases specialise in different subjects, so a search on medicine would go to a medical database, while a legal query would go to a legal one. At this stage the searcher should understand the nature, content, and structure of the database, including which fields are indexed and therefore searchable.

Step 3: Identify search terms and concepts

Next, the searcher breaks the topic into its key concepts and identifies the terms that represent each one. This often requires consulting dictionaries, subject thesauri, and controlled vocabulary lists to find synonyms, related terms, and the preferred indexing language of the database. Good term selection is the foundation of a precise search.

Step 4: Formulate the search expression

This is the key part of the job. The chosen terms are combined into a logical search statement using a set of standard techniques. Boolean operators form the basis of database logic, connecting terms to either narrow or broaden a search. The three operators are AND, OR, and NOT, and many databases require them in capital letters.

  • AND connects different concepts and narrows the search, because every result must contain all the linked terms. For example, libraries AND automation retrieves only records mentioning both.
  • OR broadens the search by including any of the linked terms, which is ideal for grouping synonyms such as teenager OR adolescent.
  • NOT excludes a term, though it should be used with caution because it can accidentally remove relevant material.

Beyond Boolean logic, several other techniques refine a search expression. Truncation shortens a word to its root using a symbol, usually an asterisk, so that the search creat* retrieves create, creates, creator, creative, and creativity. Wildcards replace single characters within a word to catch spelling variations, such as British and American spellings. Phrase searching, usually with quotation marks, keeps words together as an exact phrase. Proximity operators let you find one word within a set distance of another, on the logic that words appearing close together are more likely to be related. Because proximity syntax differs between platforms, it is always worth checking a database’s help screens.

Step 5: Run the search and review results

With the expression ready, the searcher executes it and examines the results. Most systems allow the user to preview records before retrieving full entries, often through a short keyword-in-context display that shows the search terms within their surrounding text.

Step 6: Refine and identify relevant items

Few searches are perfect on the first attempt. If too many results appear, the searcher narrows the query by adding concepts with AND or applying filters such as date range, language, or peer-reviewed status. If too few appear, the search is broadened with OR or additional synonyms. The final task is to identify the genuinely relevant items and retrieve them in the desired format. Keeping a record of the search strings used is good practice, and it becomes essential for systematic work like literature reviews and dissertations.

DialogWeb and other search tools

While general search engines dominate everyday information seeking, specialised online search services remain vital for serious research. These professional tools offer depth, precision, and reliability that free web searches cannot match. The most famous of these is Dialog.

The story of Dialog

Dialog has been a pioneer of the online information industry since it became commercially available in the 1970s, and its prototype dates back to 1966. It was developed by a team led by Roger Summit, and one of its first major tests involved applying the system to NASA’s collection of aerospace research citations. Dialog has since been described in its own literature as the world’s first online information retrieval system used globally with materially significant databases. In the 1980s, a low-priced dial-up subset called Knowledge Index was marketed to individual users, bringing professional searching to a wider audience. The service is now known as ProQuest Dialog.

Dialog became popular across virtually every business and research sector. Libraries, banks, pharmaceutical firms, engineering companies, government agencies, and patent offices such as the European Patent Office and the US Patent and Trademark Office all relied on its speed, precision, and depth. A key strength was its pioneering use of value-added controlled vocabularies, the metadata and taxonomies that make precise retrieval possible.

DialogWeb and its features

DialogWeb is the web-based interface of this long-established service, replacing the older command-line-only access with a browser-friendly system. It is designed to serve both novice and expert searchers, which is one of its defining strengths.

According to its tutorial documentation, DialogWeb offers a flexible Guided Search mode that does not require knowledge of the Dialog command language, alongside a robust Command Search mode for experienced users who want full control. Command Search is designed for intermediate to advanced searchers who are familiar with Dialog commands, giving them direct access to the full collection of databases.

Several built-in tools make the service powerful. Bluesheets provide detailed descriptions of each database, along with pricing information and search assistance. Database selection tools help a searcher pinpoint the most appropriate databases for a given topic. Results can be displayed in HTML or text formats, and users can choose to view records on screen or have them sent by email.

The DialIndex facility

One of Dialog’s most distinctive features is DialIndex, a master index to most of its databases. As the Indira Gandhi National Open University course material explains, DialIndex allows users to see how many times a given search term occurs across a set of chosen databases. This is extremely useful when a searcher does not know which database to use, or when conducting a comprehensive search that needs to cover everything on a topic. By previewing where the most relevant material lies, the searcher can select the best databases before committing to a full, billable search.

Other professional search tools

Dialog is not the only specialised service. Other commercial online services focus on particular fields, such as LexisNexis for legal information and Bloomberg for financial data. A newer category, known as discovery services, includes systems like EBSCO Discovery Service and Summon. These provide a single search interface across many databases and resources at once, which suits the way most students and researchers prefer to search today. Each tool reflects the same underlying principles of information retrieval, applied to different audiences and content types.

Why these skills still matter

It is tempting to assume that the rise of instant web search has made these structured techniques obsolete. The opposite is true. The principles of query analysis, careful term selection, and Boolean logic transfer directly to academic databases, library catalogues, and even advanced web searching. Information professionals who master systematic searching can find relevant, authoritative material that casual searchers miss entirely. As search technology continues to evolve toward AI-driven and semantic systems, the searcher who understands the logic underneath will always have an advantage.

What do you think? If you compare searching a structured database like DialogWeb with a free search engine, which trade-offs between precision and convenience matter most for your own research? And as AI-powered search becomes more common, do you think the careful, step-by-step search strategy will remain a core skill for information professionals, or will it fade into the background?

How useful was this post?

Click on a star to rate it!

Average rating 0 / 5. Vote count: 0

No votes so far! Be the first to rate this post.

We are sorry that this post was not useful for you!

Let us improve this post!

Tell us how we can improve this post?

References
  1. https://ciir-publications.cs.umass.edu/getpdf.php?id=1066
  2. https://www.science.org/doi/10.1126/science.275.5298.327
  3. https://library.roehampton.ac.uk/studyskills/boolean
  4. https://library.leeds.ac.uk/info/1404/literature_searching/14/literature_searching_explained/4
  5. https://library.nd.edu.au/airs/comprehensive/strategies
  6. https://ethw.org/Milestones:DIALOG_Online_Search_System,_1966
  7. https://en.wikipedia.org/wiki/ProQuest_Dialog
  8. https://www.yumpu.com/en/document/view/11780409/dialogweb-command-search-tutorial-dialog-support
  9. https://gyansanchay.csjmu.ac.in/wp-content/uploads/2021/11/unit-19.pdf

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *

Information Processing & Retrieval

1 Intellectual Organisation of Information

  1. Intellectual Organisation of Information
  2. Meaning of Intellectual Organisation of Information
  3. Why IOI is Necessary?
  4. IOI in Indexing Systems
  5. IOI and Indexing Languages
  6. IOI in User Services
  7. IOI and Content Analysis
  8. Information Retrieval Systems – Changing Environment
  9. Future Trends

2 Indexing Languages–Part I – Concepts and Types, Subject Headings Lists and Thesauri

  1. Indexing and its Types
  2. Indexing Language
  3. Vocabulary Control
  4. Classification Schemes
  5. Subject Headings Lists
  6. Thesaurus
  7. Thesaurofacet
  8. Classaurus
  9. Sears List of Subject Headings
  10. Library of Congress List of Subject Headings

3 Indexing Languages–Part II- Classification Schemes

  1. Dewey Decimal Classification (DDC) Scheme
  2. Universal Decimal Classification (UDC) Scheme
  3. Library of Congress Classification (LCC) Scheme
  4. Colon Classification (CC) Scheme
  5. Bibliographic Classification (BC) Scheme
  6. Library Bibliographical Classification (BBK) Scheme
  7. Broad System of Ordering (BSO) Scheme
  8. Special Classification Systems

4 Indexing Systems and Techniques

  1. Indexing Principles and Process
  2. Pre-Coordinate Indexing Systems
  3. Post-Coordinate Indexing Systems
  4. Automatic Indexing
  5. Non-Conventional Indexing: Citation Indexing
  6. Web Indexing

5 Evaluation of Indexing Systems

  1. Purpose of Evaluation
  2. Levels of Evaluation
  3. Evaluation Criteria
  4. Recall and Precision
  5. Other Performance Measures
  6. Relevance
  7. Evaluation Methodology
  8. Evaluation Experiments

6 Principles and Evolution of Bibliographic Description

  1. Bibliographic Description: An Overview
  2. Scope and Objectives of Bibliographic Description
  3. Evolution of Bibliographic Description
  4. Ranganathan’s Principles
  5. ISBDs
  6. Bibliographic Formats
  7. Electronic Resource Description
  8. Models of Bibliographic Description
  9. Bibliographic Description: Entities, Attributes and Relationships

7 Rules for Bibliographic Description

  1. Bibliographic Description: Its Origin
  2. Development of Anglo-American Code
  3. The International Standard Bibliographic Description (ISBD)
  4. Impact of ISBD on Catalogue Codes
  5. Bibliographic Description for Non-Print Materials
  6. Guidelines for Bibliographic Description of Electronic Resources
  7. Guidelines for Bibliographic Description of Internet Resources
  8. Rules for Description of Electronic Resources in AACR2 Revision 2002

8 Standards for Bibliographic Record Format

  1. International Standard Bibliographic Description (ISBD)
  2. MARC Format
  3. UNIMARC
  4. Common Communication Format (CCF)
  5. Indian Standard

9 Metadata- MARC21-856 Field, Dublin Core, TEI

  1. MARC21 – 856 Field
  2. Dublin Core Metadata Initiative (DCMI)
  3. Text Encoding Initiative (TEI)
  4. Procedure of Electronic Resource Description

10 Norms and Guidelines for Content Development

  1. Introduction
  2. Needs and Guidelines
  3. Standards Related to Electronic Content
  4. W3C Recommendations
  5. Electronic Text Encoding and Interchange
  6. Dynamic Content

11 Introduction to HTML and XML

  1. World Wide Web and Markup Languages
  2. Standard Generalized Markup Language (SGML)
  3. HyperText Markup Language (HTML)
  4. Basic HTML Tags
  5. Linking
  6. URLs
  7. HTML and the Browser
  8. eXtensible Markup Language (XML)
  9. XML Syntax and Semantic Tags
  10. Document Type Definition (DTD)
  11. Implications of XML in Library and Information Activities

12 Web-based Content Development

  1. What can be done with World Wide Web?
  2. Hypertext, Hyperlink, and Hypermedia
  3. Hypertext Markup Language (HTML)
  4. Introduction to Dynamic HTML
  5. Web Interface to Database Linking
  6. Introduction to XML
  7. XML Document Design
  8. Multimedia Web Resources
  9. Web Servers
  10. Website Hosting
  11. Tools for Web Page Designing

13 Multilingual Content Development (Using Unicode)

  1. Character Representation in Computer
  2. American Standard Code for Information Interchange (ASCII)
  3. Indian Scenario and Indian Standard Code for Information Interchange (ISCII)
  4. UNICODE
  5. Web Content Development Through UNICODE
  6. Applications of UNICODE
  7. Applying UNICODE to the Libraries
  8. Problems Associated with UNICODE

14 ISAR Systems- Objectives, Types, Operations and Design

  1. Users and Their Information Needs
  2. Objectives of ISAR Systems
  3. Types of ISAR Systems
  4. Design of ISAR Systems
  5. Evaluation of ISAR Systems

15 Compatibility of ISAR Systems

  1. Need for Compatibility Among ISAR Systems
  2. Scope of Compatibility in ISAR Systems
  3. Areas of Compatibilities in ISAR Systems
  4. Principal Issues of Compatibility in ISAR Systems
  5. Compatibility of Online IR Systems
  6. Approaches Towards Compatibility in ISAR
  7. Quality Control and Compatibility

16 Intelligent Information Retrieval Systems

  1. Introduction
  2. Expert Systems
  3. Expert Systems for Information Processing and Retrieval
  4. Components of Expert Systems
  5. Knowledge Representation
  6. Knowledge Engineering
  7. Artificial Intelligence Based Decision Support Systems (DSS)
  8. Pattern Recognition

17 Information Retrieval Processes and Techniques

  1. Information Retrieval Systems
  2. Databases
  3. Information Retrieval Systems: Purpose, Components, and Functions
  4. Indexing and Information Representation
  5. Vocabulary Control
  6. Searching
  7. Information Seeking and User Interfaces
  8. Web Information Retrieval Systems
  9. Intelligent Information Retrieval

18 Information Retrieval Models and Their Applications

  1. Information Retrieval
  2. Information Retrieval Techniques
  3. Models Based on Input/Output
  4. Models Based on Theories and Tools

19 Search Strategies, Processes and Techinques

  1. Search File – An Essential Component
  2. Search Strategies and Pre-requisites
  3. Search Techniques
  4. The Information Search Process
  5. Online Searching
  6. How the Search Engines Work
  7. Common Search and Retrieval Features of Web Search Engines