Skip to main navigation Skip to search Skip to main content

NeuCODEX: Edge-Cloud Co-Inference with Spike-Driven Compression and Dynamic Early-Exit

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Spiking Neural Networks (SNNs) offer significant potential for enabling energy-efficient intelligence at the edge. However, performing full SNN inference at the edge can be challenging due to the latency and energy constraints arising from fixed and high timestep overheads. Edge-cloud co-inference systems present a promising solution, but their deployment is often hindered by high latency and feature transmission costs. To address these issues, we introduce NeuCODEX, a neuromorphic co-inference architecture that jointly optimizes both spatial and temporal redundancy. NeuCODEX incorporates a learned spike-driven compression module to reduce data transmission and employs a dynamic early-exit mechanism to adaptively terminate inference based on output confidence. We evaluated NeuCODEX on both static images (CIFAR10 and Caltech) and neuromorphic event streams (CIFAR10-DVS and N-Caltech). To demonstrate practicality, we prototyped NeuCODEX on ResNet-18 and VGG-16 backbones in a real edge-to-cloud testbed. Our proposed system reduces data transfer by up to 2048x and edge energy consumption by over 90%, while reducing end-to-end latency by up to 3× compared to edge-only inference, all with a negligible accuracy drop of less than 2%. In doing so, NeuCODEX enables practical, high-performance SNN deployment in resource-constrained environments.

Original languageEnglish
Title of host publicationProceedings - 2025 24th International Conference on Machine Learning and Applications, ICMLA 2025
EditorsM. Arif Wani, Taghi M. Khoshgoftaar, Huanjing Wang, Kehan Gao, Safak Kayikci
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages784-789
Number of pages6
ISBN (Electronic)9798331559809
DOIs
Publication statusPublished - 2025
Event24th International Conference on Machine Learning and Applications, ICMLA 2025 - Boca Raton, United States
Duration: 3 Dec 20255 Dec 2025

Publication series

NameProceedings - 2025 24th International Conference on Machine Learning and Applications, ICMLA 2025

Conference

Conference24th International Conference on Machine Learning and Applications, ICMLA 2025
Country/TerritoryUnited States
CityBoca Raton
Period3/12/255/12/25

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 7 - Affordable and Clean Energy
    SDG 7 Affordable and Clean Energy

Keywords

  • Co-Inference
  • Early-Exit
  • Edge Computing
  • Feature Compression
  • Neuromorphic Computing
  • Spiking Neural Networks (SNNs)

Fingerprint

Dive into the research topics of 'NeuCODEX: Edge-Cloud Co-Inference with Spike-Driven Compression and Dynamic Early-Exit'. Together they form a unique fingerprint.

Cite this