NeurIPS 2026

A new scale
for learning network structure.

Cannistraci-Hebb Channel-wise Dynamic Sparse Training of Convolutional Neural Networks with Contextual Modulation

Organizing topology around channels

The study represents convolutional channels as network nodes and combines channel-wise dynamic sparse training with lightweight contextual modulation, reducing the complexity of element-wise topology modeling.

Fewer parameters, comparable task performance

The official abstract reports performance comparable to dense training using 30% of the parameters, based on ResNet and VGG experiments on CIFAR-10, CIFAR-100 and Tiny-ImageNet, alongside improved robustness to noise.

Extending the paradigm to vision

The approach extends CHT to channel-level organization, opening a research direction for structural efficiency in vision models.

Based on the official conference abstract; consult the paper for experimental configurations and figures.