Imperial College London


Faculty of EngineeringDepartment of Aeronautics

Reader in Aeronautics



+44 (0)20 7594 1975p.vincent




211City and Guilds BuildingSouth Kensington Campus






BibTex format

@article{Witherden and Vermeire and Vincent:2015:10.1016/j.compfluid.2015.07.016,
author = {Witherden and Vermeire and Vincent, PE},
doi = {10.1016/j.compfluid.2015.07.016},
journal = {Computers & Fluids},
pages = {173--186},
title = {Heterogeneous computing on mixed unstructured grids with PyFR},
url = {},
volume = {120},
year = {2015}

RIS format (EndNote, RefMan)

AB - PyFR is an open-source high-order accurate computational fluid dynamics solver for unstructured grids. In this paper we detail how PyFR has been extended to run on mixed element meshes, and a range of hardware platforms, including heterogeneous multi-node systems. Performance of our implementation is benchmarked using pure hexahedral and mixed prismatic-tetrahedral meshes of the void space around a circular cylinder. Specifically, for each mesh performance is assessed at various orders of accuracy on three different hardware platforms; an NVIDIA Tesla K40c GPU, an Intel Xeon E5-2697 v2 CPU, and an AMD FirePro W9100 GPU. Performance is then assessed on a heterogeneous multi-node system constructed from a mix of the aforementioned hardware. Results demonstrate that PyFR achieves performance portability across various hardware platforms. In particular, the ability of PyFR to target individual platforms with their ‘native’ language leads to significantly enhanced performance cf. targeting each platform with OpenCL alone. PyFR is also found to be performant on the heterogeneous multi-node system, achieving a significant fraction of the available FLOP/s. Finally, each mesh is used to undertake nominally fifth-order accurate long-time simulations of unsteady flow over a circular cylinder at a Reynolds number of 3900 using a cluster of NVIDIA K20c GPUs. Long-time dynamics of the wake are studied in detail, and results are found to be in excellent agreement with previous experimental/numerical data. All results were obtained with PyFR v0.2.2, which is freely available under a 3-Clause New Style BSD license (see
AU - Witherden
AU - Vermeire
AU - Vincent,PE
DO - 10.1016/j.compfluid.2015.07.016
EP - 186
PY - 2015///
SN - 0045-7930
SP - 173
TI - Heterogeneous computing on mixed unstructured grids with PyFR
T2 - Computers & Fluids
UR -
UR -
VL - 120
ER -