Power-Optimal Mapping of CNN Applications to Cloud-Based Multi-FPGA Platforms

Shan, Junnan; Lazarescu, Mihai T.; Cortadella, Jordi; Lavagno, Luciano; Casu, Mario R.

doi:10.1109/TCSII.2020.2998284

Multi-FPGA platforms like Amazon Web Services F1 are perfect to accelerate multi-kernel pipelined applications, like Convolutional Neural Networks (CNNs). To reduce energy consumption, we propose to upload at runtime the best power-optimized CNN implementation for a given throughput constraint. Our design method gives the best number of parallel instances of each kernel, their allocation to the FPGAs, the number of powered-on FPGAs and their clock frequency. This is obtained by solving a mixed-integer, non-linear optimization problem that models power and performance of each component, as well as the duration of the computation phases—data transfer between a host CPU and the FPGA memory (typically DDR), data transfer between DDR and FPGA, and FPGA computation. The results show that the power saved compared to simply clock gating the fastest implementation is obviously very high, but it is also much more significant than simply scaling the frequency of the fastest implementation or replicating the slowest implementation on multiple FPGAs.

Power-Optimal Mapping of CNN Applications to Cloud-Based Multi-FPGA Platforms / Shan, Junnan; Lazarescu, Mihai T.; Cortadella, Jordi; Lavagno, Luciano; Casu, Mario R.. - In: IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS. II, EXPRESS BRIEFS. - ISSN 1549-7747. - ELETTRONICO. - 67:12(2020), pp. 3073-3077. [10.1109/TCSII.2020.2998284]

Titolo:	Power-Optimal Mapping of CNN Applications to Cloud-Based Multi-FPGA Platforms
Autori:	SHAN, JUNNAN LAZARESCU, MIHAI TEODOR Cortadella, Jordi LAVAGNO, Luciano CASU, MARIO ROBERTO mostra contributor esterni nascondi contributor esterni
Data di pubblicazione:	2020
Rivista:	IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS. II, EXPRESS BRIEFS
Digital Object Identifier (DOI):	http://dx.doi.org/10.1109/TCSII.2020.2998284
Appare nelle tipologie:	1.1 Articolo in rivista

File in questo prodotto:

File	Descrizione	Tipologia	Licenza
upload.pdf	Main article	2. Post-print / Author's Accepted Manuscript	PUBBLICO - Tutti i diritti riservati	Visibile a tuttiVisualizza/Apri
09103067.pdf	Article.	2a Post-print versione editoriale / Version of Record	Non Pubblico - Accesso privato/ristretto	Administrator Richiedi una copia

Utilizza questo identificativo per citare o creare un link a questo documento:
http://hdl.handle.net/11583/2837760

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

PORTO @ Archivio Istituzionale della Ricerca

File in questo prodotto: