Structured I/O streams in Clive: a toolbox approach for wide area network computing. Issue 1 (December 2017)

• Record Type: Journal Article
• Authors: Ballesteros, Francisco
• Is Part Of: Journal of internet services and applications. Volume 8:Issue 1(2017)
• Page Start: 1
• Page End: 16
• Publication Date: 2017-12
• Subjects: Streams -- Input/Output -- Operating system -- Distributed systems -- Cloud computing; TCP/IP (Computer network protocol) -- Periodicals; Internet -- Periodicals; Internet -- Security measures -- Periodicals; 004.678
• DOI: 10.1186/s13174-016-0054-8
• Languages: English
• ISSNs: 1867-4828

Abstract

Abstract Most distributed applications and tools used in wide area networks and Cloud computing environments use the UNIX I/O framework. In this framework, processes use file descriptors for standard I/O and file access, with the traditionalopen /close /read /write interface. Although this design has proven to be excellent since the 1970s, it is not appropriate for today wide-area systems because of the implied RPCs and network latency. There are systems relying on message streams that perform well in such environments, but they depart from the toolbox approach embraced by UNIX, making it harder to combine existing programs to solve new tasks. In this paper we describe the design, implementation, and usage of a new I/O framework, built to enable the construction of services in environments with high latency, while preserving the programmability of the system as a whole and making it convenient to combine existing tools and programs. The framework relies on named channels for I/O. Each channel carries a stream of typed data including directory entries, raw bytes, and other application-specific data. Separate commands using the framework may be combined as in UNIX, but still tolerate high latencies as found in distributed and Cloud computing environments, enabling a toolbox approach in such environments.