Seeding and adjoining zero-halo partitioned parallel scientific codes. (3rd May 2020)

• Record Type: Journal Article
• Authors: Mohanamuraly, P.; Hascoët, L.; Müller, J.-D.
• Is Part Of: Optimization methods and software. Volume 35:Number 3(2020)
• Page Start: 618
• Page End: 637
• Publication Date: 2020-05-03
• Subjects: Algorithmic differentiation -- adjoint source transformation -- parallel reverse mode -- gradient-based optimization -- fixed-point iteration -- computational fluid dynamics (CFD) -- message passing; Mathematical optimization -- Periodicals; Algorithms -- Periodicals; 519.7
• DOI: 10.1080/10556788.2019.1591404
• Languages: English
• ISSNs: 1055-6788

Abstract

ABSTRACT: Algorithmic differentiation tools can automate the adjoint transformation of parallel message-passing codes [J. Utke, L. Hascoët, P. Heimbach, C. Hill, P. Hovland, and U. Naumann, Toward Adjoinable MPI, in 2009 IEEE International Symposium on Parallel & Distributed Processing, May, IEEE, 2009, pp. 1–8] using the AMPI library. Nevertheless, a non-trivial and manual step after the differentiation is the initialization of the seed and retrieval of the output values from the differentiated code. Ambiguities in seeding occur in programs where the user is unable to expose the complete program flow with a single entry and single exit point to the AD tool. We present the ambiguities associated with seed initialization and output retrieval for adjoint transformation of halo and zero-halo partitioned MPI programs. We introduce a general framework to eliminate ambiguities in seeding and retrieval for shared-node reduction over +, and * operators using a conceptual master-worker model. The model shows the need for new MPI calls for retrieval and eliminate MPI calls for seed initialization. Different implementations for seeding manually assembled adjoints were inferred from the model, namely, partial and unique seeding. We successfully applied the seeding techniques to a 3D zero-halo partitioned unstructured compressible discrete adjoint solver and highlight the merits and demerits of each strategy.