Learning resources in federated environments: a broken link checker based on URL similarity. (1st January 2013)

• Record Type: Journal Article
• Authors: Le, Tien-Dung
• Is Part Of: International journal of metadata, semantics and ontologies. Volume 8:Number 1(2013)
• Page Start: 3
• Page End: 12
• Publication Date: 2013-01-01
• Subjects: availability -- broken links -- heuristic algorithms -- learning resources -- metadata -- URLs; Metadata -- Periodicals; Semantic Web -- Periodicals; Ontologies (Information retrieval) -- Periodicals; Data structures (Computer science) -- Periodicals; Information theory -- Periodicals; 005.74
• Languages: English
• ISSNs: 1744-2621

Abstract

In a large federation of learning resource repositories metadata can become out of date, especially when resources are moved or deleted, frustrating users and making it critical to assure the availability of resources in any learning environment. Regularly checking all of URLs in a federation with thousands of resources negatively impacts content providers causing poor system performance, heavy network traffic and impoliteness. This paper describes a solution that ensures a balance between the number of resources and the number of checking requests performed. It uses a heuristic algorithm to select a group of resources to verify. Depending on the results, the system either stops checking or continues with a new selection of links constructed from URLs that are similar to the broken links in the previous round. To reach the global optimisation, the selection process also randomly picks other resources with a small probability of error.