N. C. Shu
Abstract
EXPRESS is an experimental prototype data translation system which can access a wide variety of data and restructure it for new uses. The system is driven by two very high level nonprocedural languages: DEFINE for data description and CONVERT for data restructuring. Program generation and cooperating process techniques are used to achieve efficient operation.
This paper describes the design and implementation of EXPRESS. DEFINE and CONVERT are summarized and the implementation architecture presented.
The DEFINE description is compiled into a customized PL/1 program for accessing source data. The restructuring specified in CONVERT is compiled into a set of customized PL/1 procedures to derive multiple target files from multiple input files. Job steps and job control statements are generated automatically. During execution, the generated procedures run under control of a process supervisor, which coordinates buffer management and handles file allocation, deallocation, and all input/output requests.
The architecture of EXPRESS allows efficiency in execution by avoiding unnecessary secondary storage references while at the same time allowing the individual procedures to be independent of each other. Its modular structure permits the system to be extended or transferred to another environment easily.
- 1 BAKKOM, D.E., ANI) BEHYMER, J.A. Implementation of a prototype generalized file translator. Proc. 1975 ACM SIGMOD Int. Conf. on Management of Data, San Jose, Calif., 1975, pp. 99-110. Google Scholar
Digital Library
- 2 BIRSS, E.W., AND Far, J.P. Generalized software for translating data. Proc. AFIPS 1976 NCC, AFIPS Press, Montvale, N.J., pp. 889-899.Google Scholar
- 3 DEPPE, M., LEWIS, K., AND SWARTWOUT, D. Operational software for restructuring network data bases. Working Paper DT 3.2, Data Translation Proj., U. of Michigan, Ann Arbor, Mich., 1976.Google Scholar
- 4 FRy, J.P., FRANK, R.L., AND HERSHEY, E.S. III. A developmental model for data translation. Proc. 1972 SIGFIDET Workshop on Data Description, Access and Control, Denver, Colo., pp. 77-105. Google ScholarDigital Library
- 5 FRY, J.P., S~ITH, D.P., AND TAYLOR, R.W. An approach to stored data definition and translation. ACM 1972 SIGFIDET Workshop on Data Description, Accesz and Control, Denver, Colo., pp. 13-55. Google ScholarDigital Library
- 6 FRY, J.P., SMITH, D.C.P., TAYLOR, R.W., FRANK, R.L., LUM, V.Y., BEHYMER, J.A., AND SHNEID~.R~AN, B. Stored-data description and data translation: A model and language. Inform. Syst. 2, 3 (1977), 95-160.Google Scholar
- 7 HousEL, B.C., LuM, V.Y., AND SHY, N.C. Architecture to An Interactive Migration System (AIMS). Proc. ACM SIGMOD Workshop on Data Description, Access and Control, Ann Arbor, Mich., May 1974, pp. 157-169. Google ScholarDigital Library
- 8 HOUSEL, B.C., AND SHy, N.C. A high-level data manipulation language for hierarchical data structures. Proc. Conf. on Data Abstraction, Definition and Structure, Salt Lake City, Utah, March 1976, pp. 155-168. Google ScholarDigital Library
- 9 HOUSEL, B.C., SMITH, D.P., SHU, N.C., AND LuM, V.Y. DEFINE--A nonprocedural data description language for de/ining information easily. Proc. ACM Pacific 75, San Francisco, Calif., April 1975, pp. 62-70.Google Scholar
- 10 IBM CORP. Information Management System, General Information Manual. IBM: Pub. No. GH20-1260, IBM Corp., White Plains, N.Y., 1975.Google Scholar
- 11 LooMIs, M.E. Resource-constrained scheduling of tasks with precedence relationships. Res. Rep. No. RJ 1746, IBM Res. Lab., San Jose, Calif., 1976.Google Scholar
- 12 Lug, V.Y., SHU, N.C., AND HOVSEL, B.C. A general methodology for data conversion and restructuring. IBM J. Res. and Develop. 20, 5 (1976), 483--497.Google Scholar
- 13 MEaTEN, A.G., AND FRY, J.P. A data description language approach to file translation. Proc. ACM SIGMOD Workshop on Data Description, Access and Control, Ann Arbor, Mich., May 1974, pp. 191-205. Google ScholarDigital Library
- 14 NAVATHS, S.B., AND FRY, j.P. Restructuring for large databases: Three levels of abstraction. ACM Trans. Database Syst. 1, 2 (June 1976), 138-158. Google ScholarDigital Library
- 15 RAMIR~.Z, J.A. Automalic Generation of Data Conversion Programs Using a Dala Description Language (DDL), Vols. 1, H. U. of Pennsylvania, Philadelphia, Pa., May 1973.Google Scholar
- 16 RA~IREZ, J.A., RIN, N.A., AND PRAWES, N.S. Automatic generation of data conversion programs using a data description language. Proc. ACM SIGMOD Workshop on Data Description, Access and Control, Ann Arbor, Mich., May 1974, pp. 207-225. Google ScholarDigital Library
- 17 SCHNEIDER, G.M., AND DESAUTELS, E.J. Design of a file translation language for networks. Inform. Syst. 1, 1 (Jan. 1975), 23-31.Google ScholarCross Ref
- 18 SI~S~.ID~RMAN, B., XND SHAPIRO, S.C. Towards a theory of encoded data structures and data translation. Int. J. Comptr. Inform. Sci. 5, 1 (1976), 33-43.Google Scholar
- 19 SHOSHANI, A. A logical-level approach to database conversion. Proc. 1975 ACM SIGMOD Conf. Management of Data, San Jose, Calif., pp. 112-122. Google ScholarDigital Library
- 20 SHOSHANI, A., AND BRANDON, K. On the implementation of a logical data base converter. Proc. Int. Conf. on Very Large Data Bases, Framingham, Mass., Sept. 1975, pp. 529-531.Google ScholarDigital Library
- 21 SHU, N.C., ttOUSEL, B.C., AND LUM, V.Y. CONVERT: A high level translation definition language for data conversion. Comm. ACM 18, 10 (Oct. 1975), 557-567. Google ScholarDigital Library
- 22 SIBLEY, E.H., AND TAYLOB, R.W. A data definition and mapping language. Comm. ACM 16, 12 (Dec. 1973), 750-759, Google ScholarDigital Library
- 23 SmTn, D.P. An approach to data description and conversion. Ph.D. Diss., U. of Pennsylvania, Philadelphia, Pa., 1971.Google Scholar
- 24 SMITH, D.P. A method for data translation using the stored data definition and translation task group languages. ACM 1972 SIGFIDET Workshop on Data Description, Access and Control, Denver, Colo., pp. 107-124. Google ScholarDigital Library
- 25 TAYLOR, R.W. Generalized data base management system data structures and their mapping to physical storages. Ph.D. Diss., U. of Michigan, Ann Arbor, Mich., 1971. Google ScholarDigital Library
- 26 WINTERS, E.W., AND DICKEY, A.F. A business application of data translation. Proc. 1976 ACM SIGMOD Conf., Washington, D.C., June 1976, pp. 189-196.Google Scholar
Index Terms
- EXPRESS: a data EXtraction, Processing, and Restructuring System
Recommendations
CONVERT: a high level translation definition language for data conversion
This paper describes a high level and nonprocedural translation definition language, CONVERT, which provides very powerful and highly flexible data restructuring capabilities. Its design is based on the simple underlying concept of a form which enables ...
Compilation of Nonprocedural Specifications into Computer Programs
The paper describes the compilation of a program specification, written in the very high level nonprocedural MODEL language, into an object, PL/1 or Cobol, procedural language program. Nonprocedural programming languages are descriptive and devoid of ...
Architecture to an interactive migration system (AIMS)
SIGFIDET '74: Proceedings of the 1974 ACM SIGFIDET (now SIGMOD) workshop on Data description, access and controlGrowth in the computer industry produces a need to convert data and/or programs from one system to another from time to time. While this process has been going on for years, the techniques used to execute this task have been ad hoc and expensive. Very ...
Comments