Piecewise Holistic Autotuning of Parallel Programs with CERE

Abstract : Current architecture complexity requires fine tuning of compiler and runtime parameters to achieve best performance. Autotuning substantially improves default parameters in many scenarios but it is a costly process requiring long iterative evaluations. We propose an automatic piecewise autotuner based on CERE (Codelet Extractor and REplayer). CERE decomposes applications into small pieces called codelets: each codelet maps to a loop or to an OpenMP parallel region and can be replayed as a standalone program.Codelet autotuning achieves better speedups at a lower tuning cost. By grouping codelet invocations with the same performance behavior, CERE reduces the number of loops or OpenMP regions to be evaluated. Moreover unlike whole-program tuning, CERE customizes the set of best parameters for each specific OpenMP region or loop. We demonstrate the CERE tuning of compiler optimizations, number of hreads, thread affinity, and scheduling policy on both NUMA and heterogeneous architectures. Over the NAS benchmarks, we achieve an average speedup of1.08x after tuning. Tuning a codelet is 13x cheaper than whole-program evaluation and predicts the tuning impact with a 94.7% accuracy. Similarly, exploring thread configurations and scheduling policies for a Black-Scholes solver on an heterogeneous big.LITTLE architecture is over 40x faster using CERE.
Type de document :
Article dans une revue
Concurrency and Computation: Practice and Experience, Wiley, 2017, 29 (15), pp.e4190. 〈10.1002/cpe.4190〉
Liste complète des métadonnées

Littérature citée [40 références]  Voir  Masquer  Télécharger

Contributeur : Mihail Popov <>
Soumis le : mardi 28 novembre 2017 - 18:19:27
Dernière modification le : mardi 6 mars 2018 - 12:16:01


Fichiers produits par l'(les) auteur(s)


Copyright (Tous droits réservés)




Mihail Popov, Chadi Akel, Yohan Chatelain, William Jalby, Pablo De Oliveira Castro. Piecewise Holistic Autotuning of Parallel Programs with CERE. Concurrency and Computation: Practice and Experience, Wiley, 2017, 29 (15), pp.e4190. 〈10.1002/cpe.4190〉. 〈hal-01542912v2〉



Consultations de la notice


Téléchargements de fichiers