arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Information Systems

The Invisible Web

Karen R. Díaz

· Reference & User Services Quarterly

See on the map

Abstract

Navigating the Web outside Traditional Search Engines You've heard the pitch about how big the Web is--some 380 million pages and counting. But did you know that there is a virtual treasure trove of information that is not visible through the traditional search engines? Did you know that there are thousands of databases, archives, and other information sources delivering highly targeted information for a much improved searching experience?--The Invisible Web Catalog the Lycos Network Search engines find Web sites, Web pages, and in some cases, specified types of documents. Some provide more comprehensive results while others provide more precise results. However, what most search engines rarely find are records in Increasingly, valuable sorts of information reside in and remain out of reach of standard search tools. This reality is becoming more apparent and getting increasing press among would-be power searchers. Web sites are popping up to address the issue and point researchers in the right direction. Conferences are offering workshops Invisible What Is the Invisible Web? Plain and simply, the Invisible Web consists of the component parts of the Web that are hard or impossible to find through prominent search engines and directories. While these items remain outside the scope of traditional Web search tools, they still reside on the Web. Generally, the Invisible Web is comprised of records in The term itself is by no means an official term or one that is used by everyone addressing the issue. Other terminology used includes searchable databases or special databases. Why Use Databases? Databases can be used for many purposes. The readers of Reference & User Services Quarterly are overwhelmingly likely to understand this point. Consider your own reference habits. When you want to know if your library has a book, you consult your online catalog, a database, via the Web. If you are trying to verify a bibliographic citation, you consult one of a variety of bibliographic to which your library has access. If you want to find a phone number for someone across the country, you consult a Web database (such as Who Where? or 411.com) of phone numbers. Your reference habits are such that you likely already have considered, either consciously or unconsciously, the notion of compartmentalized information the Web. The reasons for using can be summed up as follows: 1. Use a database to get the exact type of information you need quickly. For example, to find the address of Microsoft, do a quick search in a business database. You would waste a lot of time going through hundreds of hits (news releases, articles, personal Web sites, etc.) to locate an address via a search engine. 2. Some information the Web is only available in a database. A Web index might find a database site for you, but may not find the contents of the database made available within that site. Sometimes there are riches below the surface of the Web. 3. Use a database to get expected results. Databases will search a defined, understandable, and (hopefully) logical collection of items. There are times you are pleased with serendipitous and unexpected results, and times you are not. 4. Use a database to get to information more quickly or to information that is more current than what is available in traditional print resources. Examples of that can meet this need include FedStats and the Universal Currency Convertor. FedStats (www. fedstats.gov) provides access to statistics maintained by various agencies of the federal government. You only need to know your topic; FedStats will find where the statistics are reported regardless of agency. The Universal Currency Converter (www.xe.net/ucc) updates rates once per minute, which is certainly more current than yesterday's newspaper. …

More like this