{"id":57,"date":"2019-05-26T15:52:45","date_gmt":"2019-05-26T15:52:45","guid":{"rendered":"https:\/\/beta.research.ece.ncsu.edu\/ivmcl\/?page_id=57"},"modified":"2026-10-02T02:16:23","modified_gmt":"2026-10-02T02:16:23","slug":"publications","status":"publish","type":"page","link":"https:\/\/research.ece.ncsu.edu\/ivmcl\/publications\/","title":{"rendered":"Re-se-arch"},"content":{"rendered":"\n<p class=\"has-slightly-larger-font-size wp-block-paragraph\"><em>Re-se-arch<\/em>: arch, search and re-search, the three layers of research.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Intelligent systems work by putting parts together: objects into scenes, lines and planes into 3D structure, modules into networks, evidence into decisions. Whatever the system, three operations recur. It must <strong>compose<\/strong> parts into wholes, <strong>select<\/strong> among alternatives (including choosing none), and <strong>remember<\/strong> what it has learned while it keeps learning. We study these operations through grammars of parts, alternatives and compositions (the And-Or graphs we have developed since 2011) and through learning methods that infer such structure from data instead of fixing it by hand.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Each research area below is one chapter of that story, tagged with the operation it studies. <strong>Compose:<\/strong> how structure is built, in network architectures, in the geometry of scenes and in generated images. <strong>Select:<\/strong> how a model chooses, and how that choice can be steered or protected, from a classifier&#8217;s ranked predictions to the relations a graph network trusts. <strong>Remember:<\/strong> how a model keeps what it has learned while it adapts to new tasks. The question that ties them together, and drives our current work, is how to keep composition, selection and memory reliable as models scale and their tasks grow longer: what we call <strong>coherent computing<\/strong>.<\/p>\n\n\n\n<h2 class=\"wp-block-heading has-bio-indigo-color has-text-color\">Research areas<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li><span class=\"ivmcl-role ivmcl-role-compose\">Compose<\/span> <a href=\"#compositional\">Compositional and grammar-guided models<\/a>: Can the structure of a model (which parts, which connections, which groupings) be learned from data instead of fixed by hand?<\/li>\n\n\n<li><span class=\"ivmcl-role ivmcl-role-compose\">Compose<\/span> <a href=\"#geometry\">Structured geometry: wireframes, planes and 3D<\/a>: How can a network that predicts dense pixel maps reliably recover sparse geometric structure, such as line segments, wireframes, planes and 3D boxes, from images?<\/li>\n\n\n<li><span class=\"ivmcl-role ivmcl-role-compose\">Compose<\/span> <a href=\"#generation\">Controllable generation<\/a>: How can a generator be told where each object goes and what each one looks like, so a user can move, relabel or restyle one object while the rest of the image stays fixed?<\/li>\n\n\n<li><span class=\"ivmcl-role ivmcl-role-select\">Select<\/span> <a href=\"#robustness\">Adversarial attack and robustness<\/a>: How much control can a tiny, carefully chosen change to an image give an attacker over a classifier, down to dictating its whole ranked list of top predictions, and what do such attacks reveal about what the model has learned?<\/li>\n\n\n<li><span class=\"ivmcl-role ivmcl-role-select\">Select<\/span> <a href=\"#graphs\">Graph neural networks and self-supervised learning<\/a>: How can a graph neural network learn useful node representations when the edges cannot be fully trusted, because connected nodes are often unlike each other or the observed edges are noisy and incomplete?<\/li>\n\n\n<li><span class=\"ivmcl-role ivmcl-role-remember\">Remember<\/span> <a href=\"#continual\">Continual and efficient adaptation<\/a>: When a network must learn new tasks one after another, how should it decide which parts to reuse, which to adjust cheaply and which to add, without forgetting earlier tasks or wasting parameters?<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Our research has been generously supported by ARO, NSF, IARPA, the Laboratory for Analytic Sciences (LAS), Sony and Salesforce (see <a href=\"#sponsors\">Sponsors<\/a>).<\/p>\n\n\n\n<h2 id=\"compositional\" class=\"wp-block-heading has-bio-indigo-color has-text-color\">Compositional and grammar-guided models<\/h2>\n\n\n\n<p class=\"has-slightly-larger-font-size wp-block-paragraph\"><span class=\"ivmcl-role ivmcl-role-compose\">Compose<\/span> <em>Can the structure of a model (which parts, which connections, which groupings) be learned from data instead of fixed by hand?<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">An <strong>And-Or Graph (AOG)<\/strong> stores a huge space of possible structures as one compact graph: an <em>And<\/em>-node composes parts, an <em>Or<\/em>-node chooses among alternative decompositions, and terminal nodes ground the parts in image data. Because sub-parts are shared, the best structure is found by exact dynamic programming rather than search; for example, a 10\u00d712 grid with 2\u00d72 parts encodes about 3.9 billion part configurations with only 5,209 And-nodes.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We first used AOGs to represent object parts, context and occlusion, then carried the same grammar into deep networks: over channel groups (AOGNets, where And means concatenate and Or means sum), over region-of-interest cells (iRCNN, so a detection comes with its parse tree), and, in reverse, as structure that <em>emerges<\/em> inside a generator under sparsity. A related line makes normalization and attention instance-specific: Attentive Normalization learns a mixture of affine transforms weighted per input, and Patch-to-Cluster attention (PaCa) lets image patches attend to a few learned clusters instead of to every other patch.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1600\" height=\"773\" src=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/aognets.jpg\" alt=\"Overview slide of AOGNets. Left: an AOG building block with AND-nodes, OR-nodes and terminal nodes over the channels of an input feature map, and the node operations (splitting, concatenation, summation). Center: ImageNet top-1 accuracy against number of parameters for AOGNets, ResNets, ResNeXts, DenseNets and DPNs. Right: number of unique detectors per concept category from network dissection. Bottom left: activation heatmaps of ResNet and AOGNet models on example images.\" class=\"wp-image-638\" srcset=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/aognets.jpg 1600w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/aognets-300x145.jpg 300w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/aognets-1024x495.jpg 1024w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/aognets-768x371.jpg 768w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/aognets-1536x742.jpg 1536w\" sizes=\"auto, (max-width: 1600px) 100vw, 1600px\" \/><figcaption class=\"wp-element-caption\">AOGNets at a glance. The building block (left) composes channel groups with AND-nodes (concatenation) and OR-nodes (summation); the plot (center) shows ImageNet accuracy against model size, where AOGNets reach a given accuracy with fewer parameters. From our CVPR 2019 paper and its presentation slides.<\/figcaption><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">How the idea developed<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>2016 \u00b7 <a href=\"https:\/\/doi.org\/10.1109\/TPAMI.2015.2497699\">And-Or car model<\/a><\/strong> <em>(IEEE TPAMI)<\/em>: an AOG that represents context and occlusion for car detection and viewpoint estimation.<\/li>\n\n\n<li><strong>2017 \u00b7 <a href=\"https:\/\/doi.org\/10.1109\/TPAMI.2016.2644963\">AOGTracker<\/a><\/strong> <em>(IEEE TPAMI)<\/em>: a full-structure AOG over part layouts, learned online while tracking, with a self-monitoring signal that triggers re-learning.<\/li>\n\n\n<li><strong>2019 \u00b7 <a href=\"http:\/\/openaccess.thecvf.com\/content_CVPR_2019\/html\/Li_AOGNets_Compositional_Grammatical_Architectures_for_Deep_Learning_CVPR_2019_paper.html\">AOGNets<\/a><\/strong> <em>(CVPR)<\/em>: the same grammar over channel groups; one generated building block contains ResNet, DenseNet, ResNeXt and DPN blocks as special cases.<\/li>\n\n\n<li><strong>2019 \u00b7 <a href=\"https:\/\/doi.org\/10.1109\/ICCV.2019.00613\">iRCNN<\/a><\/strong> <em>(ICCV)<\/em>: an AOG over the RoI grid, so each detection is explained by the parse tree that produced it.<\/li>\n\n\n<li><strong>2020 \u00b7 <a href=\"https:\/\/openaccess.thecvf.com\/content_CVPR_2020\/html\/Xing_Inducing_Hierarchical_Compositional_Model_by_Sparsifying_Generator_Network_CVPR_2020_paper.html\">Sparsified generator<\/a><\/strong> <em>(CVPR)<\/em>: AND-OR structure is induced inside a generator by top-k sparsity rather than constructed.<\/li>\n\n\n<li><strong>2020 \u00b7 <a href=\"https:\/\/doi.org\/10.1007\/978-3-030-58520-4_5\">Attentive Normalization<\/a><\/strong> <em>(ECCV)<\/em>: replaces the single affine transform of a normalization layer with a per-input mixture, unifying normalization with channel attention.<\/li>\n\n\n<li><strong>2023 \u00b7 <a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2023\/papers\/Grainger_PaCa-ViT_Learning_Patch-to-Cluster_Attention_in_Vision_Transformers_CVPR_2023_paper.pdf\">PaCa-ViT<\/a><\/strong> <em>(CVPR)<\/em>: patch-to-cluster attention in vision Transformers, with cost linear in the number of patches and cluster heatmaps as a by-product.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">What it achieved<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>AOGNets:<\/strong> 22.28% ImageNet top-1 error with 11.9M parameters, against 23.0% for ResNet-152 with 60.2M. The saving is in parameters; at the largest model sizes the FLOPs are comparable to or above those of competing networks.<\/li>\n\n\n<li><strong>Attentive Normalization:<\/strong> reduces ResNet-50&#8217;s ImageNet top-1 error from 23.01% to 21.59% for 0.2M extra parameters and the same 4.09 GFLOPs, compared with 22.10% for Squeeze-and-Excitation.<\/li>\n\n\n<li><strong>AOGTracker:<\/strong> 60.10 one-pass success on the TB-100 benchmark against 46.17 for STRUCK, the best of the 29 trackers in that benchmark at the time.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">More highlights<\/h3>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1600\" height=\"756\" src=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/paca-teaser.jpg\" alt=\"Overview slide of PaCa-ViT: patch-to-patch, patch-to-reduced-patch and patch-to-cluster attention compared, cluster heatmaps on example images, and three take-away points.\" class=\"wp-image-650\" srcset=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/paca-teaser.jpg 1600w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/paca-teaser-300x142.jpg 300w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/paca-teaser-1024x484.jpg 1024w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/paca-teaser-768x363.jpg 768w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/paca-teaser-1536x726.jpg 1536w\" sizes=\"auto, (max-width: 1600px) 100vw, 1600px\" \/><figcaption class=\"wp-element-caption\">PaCa-ViT at a glance: image patches attend to a few learned clusters, whose heatmaps can be inspected directly. From our CVPR 2023 paper.<\/figcaption><\/figure>\n\n\n\n<h2 id=\"geometry\" class=\"wp-block-heading has-bio-indigo-color has-text-color\">Structured geometry: wireframes, planes and 3D<\/h2>\n\n\n\n<p class=\"has-slightly-larger-font-size wp-block-paragraph\"><span class=\"ivmcl-role ivmcl-role-compose\">Compose<\/span> <em>How can a network that predicts dense pixel maps reliably recover sparse geometric structure, such as line segments, wireframes, planes and 3D boxes, from images?<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Segmentation networks are very good at predicting a value for every pixel, but line segments are sparse. The <strong>attraction field<\/strong> bridges the two: every pixel near a segment stores a small vector from which the segment can be recovered, so line detection becomes a dense regression problem. The first version (AFM) stored a 2D displacement, which pins down the line but not its endpoints; the <strong>holistic attraction field<\/strong> of HAWP stores four numbers that map each pixel into a segment-local frame, which recovers the segment exactly and makes its length irrelevant. That representation has stayed unchanged from 2020 to 2025 and was later lifted into 3D.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The same habit of finding a representation in which geometry becomes easy to predict runs through our work on planes and 3D objects: line segments become tokens that guide plane recovery, a single plane correspondence becomes a camera-pose hypothesis, and 3D detectors learn from auxiliary signals that are free at training time and discarded at inference. Much of this line is a long-running collaboration with Nan Xue (visiting PhD student in iVMCL, 2018\u20132020) and Gui-Song Xia&#8217;s group at Wuhan University.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1600\" height=\"723\" src=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/hawp.jpg\" alt=\"Overview slide of HAWP. Top left: a line segment mapped into the local frame of a pixel by translation, rotation and scaling. Bottom left: an indoor image, its junction and line-segment proposals, and the parsed wireframe. Right: wireframes from AFM++, F-Clip, LETR and HAWP on building photos, and line detections from LSD, SOLD\u00b2 and HAWPv3 on aerial images outside the training data.\" class=\"wp-image-645\" srcset=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/hawp.jpg 1600w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/hawp-300x136.jpg 300w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/hawp-1024x463.jpg 1024w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/hawp-768x347.jpg 768w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/hawp-1536x694.jpg 1536w\" sizes=\"auto, (max-width: 1600px) 100vw, 1600px\" \/><figcaption class=\"wp-element-caption\">HAWP at a glance. Each line segment is encoded by a closed-form 4D vector in the local frame of nearby pixels (top left), which turns wireframe parsing into an end-to-end trainable holistic attraction field (bottom left); the right side compares wireframes with other methods and shows HAWPv3 applied to images unlike its training data. From our HAWP papers (CVPR 2020, TPAMI 2023) and their presentation slides.<\/figcaption><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">How the idea developed<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>2019 \u00b7 <a href=\"http:\/\/openaccess.thecvf.com\/content_CVPR_2019\/html\/Xue_Learning_Attraction_Field_Representation_for_Robust_Line_Segment_Detection_CVPR_2019_paper.html\">AFM<\/a><\/strong> <em>(CVPR)<\/em>: the 2D attraction field: line segment detection recast as dense region coloring.<\/li>\n\n\n<li><strong>2020 \u00b7 <a href=\"https:\/\/openaccess.thecvf.com\/content_CVPR_2020\/html\/Xue_Holistically-Attracted_Wireframe_Parsing_CVPR_2020_paper.html\">HAWP<\/a><\/strong> <em>(CVPR)<\/em>: the exact 4D holistic attraction field, with segments bound to junctions.<\/li>\n\n\n<li><strong>2021 \u00b7 <a href=\"https:\/\/doi.org\/10.1109\/ICCV48922.2021.00415\">PlaneTR<\/a><\/strong> <em>(ICCV)<\/em>: detected line segments become tokens that guide a Transformer recovering 3D planes.<\/li>\n\n\n<li><strong>2022 \u00b7 <a href=\"https:\/\/doi.org\/10.1609\/aaai.v36i2.20074\">MonoCon<\/a><\/strong> <em>(AAAI)<\/em>: monocular 3D detection trained with projected 2D auxiliary contexts that are dropped at inference.<\/li>\n\n\n<li><strong>2022 \u00b7 <a href=\"https:\/\/doi.org\/10.1109\/3DV57658.2022.00070\">HoW-3D<\/a><\/strong> <em>(3DV)<\/em>: a new task and dataset: recover the full 3D wireframe of an object, including its hidden part, from one image.<\/li>\n\n\n<li><strong>2023 \u00b7 <a href=\"https:\/\/doi.org\/10.1109\/TPAMI.2023.3312749\">HAWPv2\/v3<\/a><\/strong> <em>(IEEE TPAMI)<\/em>: a stronger detector and a self-supervised version of the attraction field.<\/li>\n\n\n<li><strong>2023 \u00b7 <a href=\"https:\/\/doi.org\/10.1109\/TPAMI.2023.3314745\">NOPE-SAC<\/a><\/strong> <em>(IEEE TPAMI)<\/em>: one plane correspondence per pose hypothesis, inside a RANSAC-style loop, for two-view planar reconstruction.<\/li>\n\n\n<li><strong>2023 \u00b7 <a href=\"https:\/\/openaccess.thecvf.com\/content\/ICCV2023\/papers\/Liu_Monocular_3D_Object_Detection_with_Bounding_Box_Denoising_in_3D_ICCV_2023_paper.pdf\">MonoXiver<\/a><\/strong> <em>(ICCV)<\/em>: an oracle study shows that choosing among 3D proposals, not regressing them, is the bottleneck; a second stage re-selects.<\/li>\n\n\n<li><strong>2024 \u00b7 <a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2024\/papers\/Xue_NEAT_Distilling_3D_Wireframes_from_Neural_Attraction_Fields_CVPR_2024_paper.pdf\">NEAT<\/a><\/strong> <em>(CVPR)<\/em>: the attraction field lifted into a 3D neural field, giving multi-view wireframe reconstruction without feature matching.<\/li>\n\n\n<li><strong>2024 \u00b7 <a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2024\/papers\/Liu_Multi-View_Attentive_Contextualization_for_Multi-View_3D_Object_Detection_CVPR_2024_paper.pdf\">MvACon<\/a><\/strong> <em>(CVPR)<\/em>: cluster-based context (from PaCa) added to 2D features before they are lifted to 3D in multi-view detectors.<\/li>\n\n\n<li><strong>2025 \u00b7 <a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2025\/papers\/Ke_ScaleLSD_Scalable_Deep_Line_Segment_Detection_Streamlined_CVPR_2025_paper.pdf\">ScaleLSD<\/a><\/strong> <em>(CVPR)<\/em>: self-supervised line detection scaled to 10 million unlabeled images.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">What it achieved<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>The representation is what matters:<\/strong> in HAWP, replacing the holistic attraction field with the earlier 2D field drops structural AP (sAP<sup>5<\/sup>) from 58.7 to 30.9 with everything else fixed. With it, HAWP reaches 65.7 msAP against 62.9 for a re-trained L-CNN, at 29.5 vs. 15.6 frames per second.<\/li>\n\n\n<li><strong>ScaleLSD:<\/strong> zero-shot structural repeatability (Rep-5) of 0.725 on YorkUrban and 0.666 on COCO, against 0.711 and 0.462 for HAWPv3 and 0.419 and 0.456 for the classical LSD detector.<\/li>\n\n\n<li><strong>MonoCon:<\/strong> 16.46 AP<sub>3D<\/sub> on KITTI cars (moderate) at 25.8 ms per image, 1.44 points above GUPNet; the auxiliary contexts account for 8.49 points in ablation.<\/li>\n\n\n<li><strong>MvACon:<\/strong> on BEVFormer, local context changes NDS by \u22120.2 and global pooling by +0.3, while cluster context adds +1.1: the structure of the context, not context as such, is what helps.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">More highlights<\/h3>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1600\" height=\"757\" src=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/mvacon-teaser.jpg\" alt=\"Overview slide of MvACon: detections on nuScenes by BEVFormer and by BEVFormer with MvACon, the multi-view 3D detection pipeline with MvACon between the 2D backbone and 2D-to-3D lifting, and three take-away points.\" class=\"wp-image-648\" srcset=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/mvacon-teaser.jpg 1600w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/mvacon-teaser-300x142.jpg 300w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/mvacon-teaser-1024x484.jpg 1024w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/mvacon-teaser-768x363.jpg 768w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/mvacon-teaser-1536x727.jpg 1536w\" sizes=\"auto, (max-width: 1600px) 100vw, 1600px\" \/><figcaption class=\"wp-element-caption\">MvACon at a glance: cluster-based context added to 2D features before lifting improves query-based multi-view 3D detectors. From our CVPR 2024 paper.<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1600\" height=\"765\" src=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/neat-teaser.jpg\" alt=\"Overview slide of NEAT: 3D wireframes reconstructed on DTU and BlendedMVS scenes, the NEAT field and junction distillation framework, and three take-away points.\" class=\"wp-image-649\" srcset=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/neat-teaser.jpg 1600w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/neat-teaser-300x143.jpg 300w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/neat-teaser-1024x490.jpg 1024w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/neat-teaser-768x367.jpg 768w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/neat-teaser-1536x734.jpg 1536w\" sizes=\"auto, (max-width: 1600px) 100vw, 1600px\" \/><figcaption class=\"wp-element-caption\">NEAT at a glance: the attraction field lifted into a 3D neural field reconstructs 3D wireframes without cross-view matching. From our CVPR 2024 paper.<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1600\" height=\"757\" src=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/scalelsd-teaser.jpg\" alt=\"Overview slide of ScaleLSD: line segments detected by LSD, HAWPv3, DeepLSD and ScaleLSD on diverse images, the architecture and pseudo-label pipeline, and three take-away points.\" class=\"wp-image-653\" srcset=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/scalelsd-teaser.jpg 1600w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/scalelsd-teaser-300x142.jpg 300w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/scalelsd-teaser-1024x484.jpg 1024w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/scalelsd-teaser-768x363.jpg 768w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/scalelsd-teaser-1536x727.jpg 1536w\" sizes=\"auto, (max-width: 1600px) 100vw, 1600px\" \/><figcaption class=\"wp-element-caption\">ScaleLSD at a glance: self-supervised line detection trained on about 10 million unlabeled images. From our CVPR 2025 paper.<\/figcaption><\/figure>\n\n\n\n<h2 id=\"generation\" class=\"wp-block-heading has-bio-indigo-color has-text-color\">Controllable generation<\/h2>\n\n\n\n<p class=\"has-slightly-larger-font-size wp-block-paragraph\"><span class=\"ivmcl-role ivmcl-role-compose\">Compose<\/span> <em>How can a generator be told where each object goes and what each one looks like, so a user can move, relabel or restyle one object while the rest of the image stays fixed?<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A layout of labeled boxes is cheap to draw but too coarse to paint from directly. LostGAN factorizes generation as layout \u2192 per-object mask \u2192 image. Its <strong>instance-sensitive, layout-aware normalization (ISLA-Norm)<\/strong> gives every object its own normalization scale and shift, computed from the object&#8217;s class and its own style code, and places them in the image through that object&#8217;s predicted soft mask; the masks are learned without any mask labels. Because each object has its own style code and its own footprint, changing one object&#8217;s code or box changes only that object. Our later work applies the same principle inside excitation layers: a channel-only gate cannot say <em>where<\/em>, so spatially-adaptive modules output a full spatial modulation from separate &#8220;what&#8221; and &#8220;where&#8221; branches.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The results below are from the GAN era; diffusion models have since raised the bar for image quality, and the ideas of per-object normalization and learned layout masks carry over to them.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1600\" height=\"762\" src=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/lostgan.jpg\" alt=\"Overview slide of LostGAN. Top: a layout of labeled boxes (sky, snow, mountain, tree, person, skis) plus a style code is synthesized into an image. Bottom left: the layout-to-mask-to-image generator with ISLA-Norm. Right: snow scenes generated as object boxes are added one by one and as the person&apos;s box is moved, with three style codes per layout.\" class=\"wp-image-647\" srcset=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/lostgan.jpg 1600w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/lostgan-300x143.jpg 300w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/lostgan-1024x488.jpg 1024w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/lostgan-768x366.jpg 768w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/lostgan-1536x732.jpg 1536w\" sizes=\"auto, (max-width: 1600px) 100vw, 1600px\" \/><figcaption class=\"wp-element-caption\">LostGAN at a glance. A layout says where to place what, and per-object style codes say how each object looks; the layout-to-mask-to-image generator with ISLA-Norm (bottom left) turns them into an image. On the right, adding boxes or moving the person&#8217;s box changes only those objects. From our LostGAN papers (ICCV 2019, TPAMI 2022) and their presentation slides.<\/figcaption><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">How the idea developed<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>2019 \u00b7 <a href=\"https:\/\/doi.org\/10.1109\/ICCV.2019.01063\">LostGAN<\/a><\/strong> <em>(ICCV)<\/em>: layout \u2192 mask \u2192 image with ISLA-Norm and per-object style codes; reconfigurable layout and style.<\/li>\n\n\n<li><strong>2021 \u00b7 <a href=\"https:\/\/arxiv.org\/abs\/2103.08475\">Deep Consensus Learning<\/a><\/strong> <em>(arXiv:2103.08475)<\/em>: adds a segmentation network as a third player trained on the generator&#8217;s own masks, closing the loop between synthesis and recognition (preprint).<\/li>\n\n\n<li><strong>2022 \u00b7 <a href=\"https:\/\/doi.org\/10.1109\/TPAMI.2021.3078577\">LostGAN-V2<\/a><\/strong> <em>(IEEE TPAMI)<\/em>: multi-stage mask refinement, 256\u00d7256 and 512\u00d7512 images, and training with box labels on only half of the images.<\/li>\n\n\n<li><strong>2023 \u00b7 <a href=\"https:\/\/doi.org\/10.1109\/ICIP49359.2023.10222483\">SASM<\/a><\/strong> <em>(ICIP)<\/em>: separate appearance and layout branches for generation from a single image.<\/li>\n\n\n<li><strong>2023 \u00b7 <a href=\"https:\/\/doi.org\/10.1109\/ICIP49359.2023.10222248\">SASE<\/a><\/strong> <em>(ICIP)<\/em>: spatially-adaptive squeeze-excitation for generators trained on 100 to 1,000 images.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">What it achieved<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>LostGAN (2019, COCO-Stuff 64\u00d764):<\/strong> diversity score 0.35 against 0.15 for Layout2Im, with better image quality (FID 34.31 vs. 38.14).<\/li>\n\n\n<li><strong>LostGAN-V2 (COCO-Stuff 256\u00d7256):<\/strong> FID 42.55 against 65.95 for Grid2Im, which needs ground-truth masks. A detector finds objects in our generated images with 34.9 AP, against 32.3 for Grid2Im and 44.7 on real images.<\/li>\n\n\n<li><strong>SASE:<\/strong> as a drop-in module in FastGAN it improves FID on all 12 low-shot datasets tested (FFHQ: 44.3 \u2192 39.59) with fewer parameters (28.5M vs. 29.1M), and the gain holds under a different augmentation scheme.<\/li>\n<\/ul>\n\n\n\n<h2 id=\"robustness\" class=\"wp-block-heading has-bio-indigo-color has-text-color\">Adversarial attack and robustness<\/h2>\n\n\n\n<p class=\"has-slightly-larger-font-size wp-block-paragraph\"><span class=\"ivmcl-role ivmcl-role-select\">Select<\/span> <em>How much control can a tiny, carefully chosen change to an image give an attacker over a classifier, down to dictating its whole ranked list of top predictions, and what do such attacks reveal about what the model has learned?<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Most attacks only flip the top-1 label. We ask for more: make the model rank chosen classes t<sub>1<\/sub> &gt; t<sub>2<\/sub> &gt; \u2026 &gt; t<sub>K<\/sub> above all others. That requirement is a set of linear inequalities on the model&#8217;s outputs, so the smallest perturbation that satisfies it can be found by <strong>constrained optimization<\/strong> rather than a hand-tuned loss. QuadAttacK solves it as a quadratic program on the network&#8217;s features; RisingAttacK solves it in image space by sequential quadratic programming, where each step combines the right singular vectors of the Jacobian from image to logits. When gradients are not available, our black-box attacks follow the geometry of the decision boundary instead: CGBA searches along a semicircle rather than a line, which still works when the boundary is curved. Attacks are also a diagnostic: an attack that preserves the matching cue still breaks stereo networks, which shows they were not really matching.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1600\" height=\"757\" src=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/risingattack-teaser.jpg\" alt=\"Overview slide of RisingAttacK. Left top: workflow of ordered top-K attacks, one constrained objective solved three ways (RisingAttacK in image space, QuadAttacK in feature space, AdvDistill with a surrogate loss). Left bottom: a redshank image attacked on ResNet-50 for top-K from 1 to 30, with the perturbation for each K. Right: three take-away points.\" class=\"wp-image-652\" srcset=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/risingattack-teaser.jpg 1600w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/risingattack-teaser-300x142.jpg 300w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/risingattack-teaser-1024x484.jpg 1024w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/risingattack-teaser-768x363.jpg 768w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/risingattack-teaser-1536x727.jpg 1536w\" sizes=\"auto, (max-width: 1600px) 100vw, 1600px\" \/><figcaption class=\"wp-element-caption\">RisingAttacK at a glance. Every ordered top-K attack minimizes the perturbation subject to the same linear constraints on the logits; RisingAttacK solves them directly in image space. Below, the attacked images look unchanged while the required perturbation grows with K. From our ICML 2025 paper.<\/figcaption><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">How the idea developed<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>2020 \u00b7 <a href=\"https:\/\/openaccess.thecvf.com\/content_CVPRW_2020\/html\/w47\/Zhang_Learning_Ordered_Top-k_Adversarial_Attacks_via_Adversarial_Distillation_CVPRW_2020_paper.html\">Adversarial distillation<\/a><\/strong> <em>(CVPR Workshops)<\/em>: defines ordered top-K targeted attacks and a first method for them.<\/li>\n\n\n<li><strong>2022 \u00b7 <a href=\"http:\/\/papers.nips.cc\/paper_files\/paper\/2022\/hash\/6794f555524c9069e26970a408d353cc-Abstract-Conference.html\">Robust stereo<\/a><\/strong> <em>(NeurIPS)<\/em>: uses a cue-preserving attack as a probe, then builds stereo matching on a non-learned matching cost that resists it.<\/li>\n\n\n<li><strong>2023 \u00b7 <a href=\"https:\/\/openaccess.thecvf.com\/content\/ICCV2023\/papers\/Reza_CGBA_Curvature-aware_Geometric_Black-box_Attack_ICCV_2023_paper.pdf\">CGBA<\/a><\/strong> <em>(ICCV)<\/em>: a label-only black-box attack that searches the boundary along a semicircle.<\/li>\n\n\n<li><strong>2023 \u00b7 <a href=\"http:\/\/papers.nips.cc\/paper_files\/paper\/2023\/hash\/9902a53031ebbbab73898028073d4790-Abstract-Conference.html\">QuadAttacK<\/a><\/strong> <em>(NeurIPS)<\/em>: ordered top-K attacks as a quadratic program in feature space; K up to 20.<\/li>\n\n\n<li><strong>2025 \u00b7 <a href=\"https:\/\/openreview.net\/forum?id=htX7AoHyln\">GSBA<sup>K<\/sup><\/a><\/strong> <em>(ICLR)<\/em>: the first score-based black-box attack on top-K predictions (unordered sets).<\/li>\n\n\n<li><strong>2025 \u00b7 <a href=\"https:\/\/openreview.net\/pdf?id=3q6T4hQ4Dy\">RisingAttacK<\/a><\/strong> <em>(ICML)<\/em>: ordered top-K attacks solved directly in image space; K up to 30 on ResNet, DenseNet and vision Transformers.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">What it achieved<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>RisingAttacK:<\/strong> across K \u2208 {1, 5, \u2026, 30} on four ImageNet models, its figure of merit is more than twice QuadAttacK&#8217;s in most cases, and it succeeds at K = 30 where QuadAttacK fails on DenseNet-121, ViT-B and DeiT-B.<\/li>\n\n\n<li><strong>CGBA:<\/strong> median \u2113<sub>2<\/sub> perturbation of 0.86 on ResNet-50\/ImageNet after 10,000 queries (untargeted), against 1.58 for SurFree and 2.49 for HSJA.<\/li>\n\n\n<li><strong>GSBA<sup>K<\/sup>:<\/strong> 78.8% success for targeted top-3 attacks on ResNet-50 with 40,000 queries, against 31.8% for the previous score-based top-K attack.<\/li>\n\n\n<li><strong>Robust stereo:<\/strong> trained on synthetic data only, its error on KITTI 2015 (Bad-1.0) is 25.95 against 42.12 for GANet, and under attack its end-point error moves from 0.36 to 0.88 while PSMNet&#8217;s moves from 0.28 to 29.05.<\/li>\n<\/ul>\n\n\n\n<h2 id=\"graphs\" class=\"wp-block-heading has-bio-indigo-color has-text-color\">Graph neural networks and self-supervised learning<\/h2>\n\n\n\n<p class=\"has-slightly-larger-font-size wp-block-paragraph\"><span class=\"ivmcl-role ivmcl-role-select\">Select<\/span> <em>How can a graph neural network learn useful node representations when the edges cannot be fully trusted, because connected nodes are often unlike each other or the observed edges are noisy and incomplete?<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Most graph neural networks assume <em>homophily<\/em>: connected nodes are similar, so averaging over neighbors helps. Many real graphs are <em>heterophilic<\/em>, and most mix both. <strong>HarmonyGNNs<\/strong> lets each node decide how much to trust its neighborhood: it encodes every node as a few tokens (its own features, and features aggregated over one and over several hops) and a small Transformer weighs them per node. It learns without labels, from a student network that sees a masked graph and predicts the embeddings of a slowly updated teacher. <strong>ReCoG<\/strong> goes one step further and learns the graph itself: in multimodal graphs, where nodes carry text and images, it re-scores and adds edges from cross-modal evidence, and refines the graph and the node representations jointly, so a better graph yields better embeddings and vice versa.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1600\" height=\"773\" src=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/recog-teaser.jpg\" alt=\"Overview slide of ReCoG. Left top: the framework, a multimodal graph refined from text and image evidence while cross-modal message passing updates text and vision features, trained end to end. Left bottom: similarity distributions on RedditM showing that edges added by the refiner are far more similar than disconnected node pairs. Right: three take-away points.\" class=\"wp-image-651\" srcset=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/recog-teaser.jpg 1600w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/recog-teaser-300x145.jpg 300w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/recog-teaser-1024x495.jpg 1024w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/recog-teaser-768x371.jpg 768w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/recog-teaser-1536x742.jpg 1536w\" sizes=\"auto, (max-width: 1600px) 100vw, 1600px\" \/><figcaption class=\"wp-element-caption\">ReCoG at a glance. The graph and the node representations are refined together, and the edges the refiner adds connect nodes whose text and images agree. From our ReCoG preprint (arXiv:2608.22786).<\/figcaption><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">How the idea developed<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>2026 \u00b7 <a href=\"https:\/\/openreview.net\/forum?id=mGxtoQY3GA\">HarmonyGNNs<\/a><\/strong> <em>(ICLR)<\/em>: self-supervised node representations that work across homophilic and heterophilic graphs without being told which kind of graph it is.<\/li>\n\n\n<li><strong>2026 \u00b7 <a href=\"https:\/\/arxiv.org\/abs\/2608.22786\">ReCoG<\/a><\/strong> <em>(arXiv:2608.22786)<\/em>: graph structure and multimodal node representations learned jointly, end to end (preprint).<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">What it achieved<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>HarmonyGNNs (linear probing):<\/strong> 75.86% on Roman-Empire against 66.26% for MUSE, and 93.24% on Texas against 86.12% for S3GCL, while matching the best self-supervised methods on homophilic graphs such as Cora (84.82% vs. 84.20%).<\/li>\n\n\n<li><strong>ReCoG:<\/strong> 90.98% node-classification accuracy on Goodreads against 84.16% for PLANET. On Ele-Fashion, removing the graph refiner drops accuracy from 88.56% to 87.09%, and removing cross-modal message passing drops it to 86.83%: the two parts are complementary.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">More highlights<\/h3>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1600\" height=\"759\" src=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/harmonygnns-teaser.jpg\" alt=\"Overview slide of HarmonyGNNs: the teacher-student framework with joint structural node encoding, a bar chart of GCN, GAT and MLP accuracy on heterophilic and homophilic synthetic graphs, and three take-away points.\" class=\"wp-image-644\" srcset=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/harmonygnns-teaser.jpg 1600w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/harmonygnns-teaser-300x142.jpg 300w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/harmonygnns-teaser-1024x486.jpg 1024w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/harmonygnns-teaser-768x364.jpg 768w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/harmonygnns-teaser-1536x729.jpg 1536w\" sizes=\"auto, (max-width: 1600px) 100vw, 1600px\" \/><figcaption class=\"wp-element-caption\">HarmonyGNNs at a glance: each node decides how much to trust its neighborhood, learned without labels. From our ICLR 2026 paper.<\/figcaption><\/figure>\n\n\n\n<h2 id=\"continual\" class=\"wp-block-heading has-bio-indigo-color has-text-color\">Continual and efficient adaptation<\/h2>\n\n\n\n<p class=\"has-slightly-larger-font-size wp-block-paragraph\"><span class=\"ivmcl-role ivmcl-role-remember\">Remember<\/span> <em>When a network must learn new tasks one after another, how should it decide which parts to reuse, which to adjust cheaply and which to add, without forgetting earlier tasks or wasting parameters?<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We treat a network&#8217;s <strong>structure<\/strong> and its <strong>parameters<\/strong> as separate decisions. For each layer and each new task, a search chooses whether to <em>reuse<\/em> the layer as is, <em>adapt<\/em> it with a small add-on, add a <em>new<\/em> layer, or (in CHEEM) <em>skip<\/em> the block, with a penalty on added parameters or compute. Reused layers stay frozen, so earlier tasks are protected by construction rather than by a penalty term. For adapting large pretrained models cheaply, WeGeFT generates the weight update from the pretrained weights themselves through two small matrices shared across layers, so adaptation needs very few new parameters while keeping the compute and memory cost of LoRA.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1600\" height=\"756\" src=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/cheem-teaser.jpg\" alt=\"Overview slide of CHEEM. Left: the method, a Vision Transformer whose blocks are reused, adapted, newly added or skipped for each task, with an external memory of task centroids that infers the task at test time. Right top: the models learned for four tasks on ViT-Base. Right bottom: three take-away points.\" class=\"wp-image-639\" srcset=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/cheem-teaser.jpg 1600w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/cheem-teaser-300x142.jpg 300w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/cheem-teaser-1024x484.jpg 1024w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/cheem-teaser-768x363.jpg 768w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/cheem-teaser-1536x726.jpg 1536w\" sizes=\"auto, (max-width: 1600px) 100vw, 1600px\" \/><figcaption class=\"wp-element-caption\">CHEEM at a glance. For each new task, CHEEM searches over four operations per block, so tasks close to ImageNet reuse most of the network and distant tasks adapt and add more. From our CVPR 2026 paper.<\/figcaption><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">How the idea developed<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>2019 \u00b7 <a href=\"http:\/\/proceedings.mlr.press\/v97\/li19m.html\">Learn to Grow<\/a><\/strong> <em>(ICML)<\/em>: per-layer reuse \/ adapt \/ new, chosen by differentiable architecture search, for convolutional networks.<\/li>\n\n\n<li><strong>2025 \u00b7 <a href=\"https:\/\/openreview.net\/pdf?id=K0sv5T2usb\">WeGeFT<\/a><\/strong> <em>(ICML)<\/em>: fine-tuning updates generated from the pretrained weights, for large language models and vision Transformers.<\/li>\n\n\n<li><strong>2026 \u00b7 <a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2026\/papers\/Savadikar_CHEEM_Continual_Learning_by_Reuse_New_Adapt_and_Skip_-_CVPR_2026_paper.pdf\">CHEEM<\/a><\/strong> <em>(CVPR)<\/em>: adds Skip and a task-similarity-guided search, for Vision Transformers in exemplar-free class-incremental learning.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">What it achieved<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Learn to Grow:<\/strong> 77.68% average accuracy over the 10 tasks of the Visual Domain Decathlon with 14.46M parameters, against 76.02% for residual adapters (12.50M) and 71.70% for ten separate models (58.96M).<\/li>\n\n\n<li><strong>CHEEM:<\/strong> 85.9% average accuracy over 12 tasks (MTIL, ImageNet-pretrained ViT-Base) with 1.7% forgetting, against 81.6% for S-Prompts, the strongest prompting baseline, and 88.1% for fine-tuning a separate model per task.<\/li>\n\n\n<li><strong>WeGeFT:<\/strong> fine-tuning Llama 2 (7B) for math reasoning, 54.89% on GSM8K while training 0.068% of the parameters, on par with full fine-tuning (54.20%) and above LoRA-GA (53.60%, 0.297%) and DoRA (53.07%, 0.317%).<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">More highlights<\/h3>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1600\" height=\"762\" src=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/wegeft-teaser.jpg\" alt=\"Overview slide of WeGeFT: LoRA and WeGeFT compared as diagrams, accuracy against trainable parameters on commonsense, code and math tasks, and three take-away points.\" class=\"wp-image-656\" srcset=\"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/wegeft-teaser.jpg 1600w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/wegeft-teaser-300x143.jpg 300w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/wegeft-teaser-1024x488.jpg 1024w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/wegeft-teaser-768x366.jpg 768w, https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-content\/uploads\/sites\/20\/2026\/10\/wegeft-teaser-1536x732.jpg 1536w\" sizes=\"auto, (max-width: 1600px) 100vw, 1600px\" \/><figcaption class=\"wp-element-caption\">WeGeFT at a glance: fine-tuning updates generated from the pretrained weights, with very few trainable parameters. From our ICML 2025 paper.<\/figcaption><\/figure>\n\n\n\n<h2 id=\"publications\" class=\"wp-block-heading has-bio-indigo-color has-text-color\">Publications<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">2026<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Conceal, Reconstruct, Jailbreak: Exploiting the Reconstruction\u2013Concealment Tradeoff in MLLMs<\/strong>. Md Farhamdur Reza, Richeng Jin, Tianfu Wu and Huaiyu Dai. <em>NeurIPS<\/em>, 2026.<\/li>\n\n\n<li><strong>AI-Based Reverberation Detection to Enhance HIFU Delivery Safety Based on B-Mode Ultrasound Images with Overlays<\/strong>. Ralf Seip, Tianfu Wu, Xiangming Xue, Xiaoning Jiang, Patrick Fitzgerald, Darrel May, Narendra Sanghvi and Richard Yang. <em>IUS<\/em>, 2026.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2026\/papers\/Savadikar_CHEEM_Continual_Learning_by_Reuse_New_Adapt_and_Skip_-_CVPR_2026_paper.pdf\">CHEEM: Continual Learning by Reuse, New, Adapt and Skip\u2013 A Hierarchical Exploration-Exploitation Approach<\/a><\/strong>. Chinmay Savadikar, Michelle Dai and Tianfu Wu. <em>CVPR<\/em>, 2026.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openreview.net\/forum?id=mGxtoQY3GA\">HarmonyGNNs: Harmonizing Heterophily and Homophily in GNNs via Joint Structural Node Encoding and Self-Supervised Learning<\/a><\/strong>. Rui Xue and Tianfu Wu. <em>ICLR<\/em>, 2026.<\/li>\n\n\n<li><strong><a href=\"https:\/\/arxiv.org\/abs\/2608.22786\">ReCoG: Reciprocal Co-Evolution for Multimodal Graph Learning<\/a><\/strong>. Rui Xue and Tianfu Wu. <em>arXiv:2608.22786<\/em>, 2026.<\/li>\n\n\n<li><strong>ROPE-MLA: Row-Access Optimized Processing Element Machine Learning Accelerator<\/strong>. Prasanth Prabu Ravichandiran, Paul Franzon, William Davis, Franc Brglez and Tianfu Wu. <em>3DIC<\/em>, 2026.<\/li>\n\n\n<li><strong>ShopGym: An Integrated Framework for Realistic Simulation and Scalable Benchmarking of E-Commerce Web Agents<\/strong>. Yuanzheng Zhu, Mingyu Zhao, Chinmay Savadikar, Han Li, Shuang Xie, Alberto Castelo, Tianfu Wu and Lingyun Wang. <em>NeurIPS Evaluations and Datasets<\/em>, 2026.<\/li>\n\n\n<li><strong>ShopGym: An Integrated Framework for Realistic Simulation and Scalable Benchmarking of E-Commerce Web Agents<\/strong>. Chinmay Savadikar, Mingyu Zhao, Yuanzheng Zhu, Han Li, Shuang Xie, Alberto Castelo, Tianfu Wu and Lingyun Wang. <em>COLM Learning from Situated and Embodied Interaction Workshop<\/em>, 2026.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">2025<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong><a href=\"https:\/\/openreview.net\/pdf?id=3q6T4hQ4Dy\">Adversarial Perturbations Are Formed by Iteratively Learning Linear Combinations of the Right Singular Vectors of the Adversarial Jacobian<\/a><\/strong>. Thomas Paniagua, Chinmay Savadikar and Tianfu Wu. <em>ICML<\/em>, 2025.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/WACV61041.2025.00479\">DiffMesh: A Motion-Aware Diffusion Framework for Human Mesh Recovery from Videos<\/a><\/strong>. Ce Zheng, Xianpeng Liu, Qucheng Peng, Tianfu Wu, Pu Wang and Chen Chen. <em>WACV<\/em>, 2025.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/TNNLS.2023.3345367\">Sign-Based Gradient Descent With Heterogeneous Data: Convergence and Byzantine Resilience<\/a><\/strong>. Richeng Jin, Yuding Liu, Yufan Huang, Xiaofan He, Tianfu Wu and Huaiyu Dai. <em>IEEE TNNLS<\/em>, 2025.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openreview.net\/pdf?id=K0sv5T2usb\">WeGeFT: Weight-Generative Fine-Tuning for Multi-Faceted Efficient Adaptation of Large Models<\/a><\/strong>. Chinmay Savadikar, Xi Song and Tianfu Wu. <em>ICML<\/em>, 2025.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openreview.net\/forum?id=htX7AoHyln\">GSBA<sup>K<\/sup>: top-K Geometric Score-based Black-box Attack<\/a><\/strong>. Md Farhamdur Reza, Richeng Jin, Tianfu Wu and Huaiyu Dai. <em>ICLR<\/em>, 2025.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2025\/papers\/Ke_ScaleLSD_Scalable_Deep_Line_Segment_Detection_Streamlined_CVPR_2025_paper.pdf\">ScaleLSD: Scalable Deep Line Segment Detection Streamlined<\/a><\/strong>. Zeran Ke, Bin Tan, Xianwei Zheng, Yujun Shen, Tianfu Wu and Nan Xue. <em>CVPR<\/em>, 2025.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">2024<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong><a href=\"https:\/\/doi.org\/10.48550\/arXiv.2405.20310\">A Pixel Is Worth More Than One 3D Gaussians in Single-View 3D Reconstruction<\/a><\/strong>. Jianghao Shen, Nan Xue and Tianfu Wu. <em>arXiv:2405.20310<\/em>, 2024.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/ICCWorkshops59551.2024.10615843\">Enhancing Approximate Message Passing via Diffusion Models Towards On-Device Intelligence<\/a><\/strong>. Philip Dai, Kai Yue, Richeng Jin, Matt Tianfu Wu and Kaiqi Xiong. <em>ICC Workshops<\/em>, 2024.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/MDTS61600.2024.10570127\">High-Speed Receiver Transient Modeling with Generative Adversarial Networks<\/a><\/strong>. Priyank Kashyap, Andries Deroo, Dror Baron, Chau-Wai Wong, Tianfu Wu and Paul D. Franzon. <em>MDTS<\/em>, 2024.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2024\/papers\/Liu_Multi-View_Attentive_Contextualization_for_Multi-View_3D_Object_Detection_CVPR_2024_paper.pdf\">Multi-View Attentive Contextualization for Multi-View 3D Object Detection<\/a><\/strong>. Xianpeng Liu, Ce Zheng, Ming Qian, Nan Xue, Chen Chen, Zhebin Zhang, Chen Li and Tianfu Wu. <em>CVPR<\/em>, 2024.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2024\/papers\/Xue_NEAT_Distilling_3D_Wireframes_from_Neural_Attraction_Fields_CVPR_2024_paper.pdf\">NEAT: Distilling 3D Wireframes from Neural Attraction Fields<\/a><\/strong>. Nan Xue, Bin Tan, Yuxi Xiao, Liang Dong, Gui-Song Xia, Tianfu Wu and Yujun Shen. <em>CVPR<\/em>, 2024.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">2023<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/TPAMI.2023.3312749\">Holistically-Attracted Wireframe Parsing: From Supervised to Self-Supervised Learning<\/a><\/strong>. Nan Xue, Tianfu Wu, Song Bai, Fu-Dong Wang, Gui-Song Xia, Liangpei Zhang and Philip H. S. Torr. <em>IEEE TPAMI<\/em>, 2023.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/ICASSP49357.2023.10096599\">Implicit Bayes Adaptation: A Collaborative Transport Approach<\/a><\/strong>. Bo Jiang, Hamid Krim, Tianfu Wu and Derya Cansever. <em>Signal Processing<\/em>, 2023.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/ICIP49359.2023.10222248\">Learning Spatially-Adaptive Squeeze-Excitation Networks for Few Shot Image Synthesis<\/a><\/strong>. Jianghao Shen and Tianfu Wu. <em>ICIP<\/em>, 2023.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/ICIP49359.2023.10222483\">Learning Spatially-Adaptive Style-Modulation Networks for Single Image Synthesis<\/a><\/strong>. Jianghao Shen and Tianfu Wu. <em>ICIP<\/em>, 2023.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/CVPR52729.2023.01650\">Level-S<sup>2<\/sup>fM: Structure from Motion on Neural Level Set of Implicit Surfaces<\/a><\/strong>. Yuxi Xiao, Nan Xue, Tianfu Wu and Gui-Song Xia. <em>CVPR<\/em>, 2023.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openaccess.thecvf.com\/content\/ICCV2023\/papers\/Liu_Monocular_3D_Object_Detection_with_Bounding_Box_Denoising_in_3D_ICCV_2023_paper.pdf\">Monocular 3D Object Detection with Bounding Box Denoising in 3D by Perceiver<\/a><\/strong>. Xianpeng Liu, Ce Zheng, Kelvin Cheng, Nan Xue, Guo-Jun Qi and Tianfu Wu. <em>ICCV<\/em>, 2023.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2023\/papers\/Grainger_PaCa-ViT_Learning_Patch-to-Cluster_Attention_in_Vision_Transformers_CVPR_2023_paper.pdf\">PaCa-ViT: Learning Patch-to-Cluster Attention in Vision Transformers<\/a><\/strong>. Ryan Grainger, Thomas Paniagua, Xi Song, Naresh Cuntoor, Mun Wai Lee and Tianfu Wu. <em>CVPR<\/em>, 2023.<\/li>\n\n\n<li><strong><a href=\"http:\/\/papers.nips.cc\/paper_files\/paper\/2023\/hash\/9902a53031ebbbab73898028073d4790-Abstract-Conference.html\">QuadAttacK: A Quadratic Programming Approach to Learning Ordered Top-K Adversarial Attacks<\/a><\/strong>. Thomas Paniagua, Ryan Grainger and Tianfu Wu. <em>NeurIPS<\/em>, 2023.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/3DIC57175.2023.10154977\">Thermal Estimation for 3D-ICs Through Generative Networks<\/a><\/strong>. Priyank Kashyap, Prasanth Prabu Ravichandiran, Lee Wang, Dror Baron, Chau-Wai Wong, Tianfu Wu and Paul D. Franzon. <em>3DIC<\/em>, 2023.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openaccess.thecvf.com\/content\/ICCV2023\/papers\/Reza_CGBA_Curvature-aware_Geometric_Black-box_Attack_ICCV_2023_paper.pdf\">CGBA: Curvature-aware Geometric Black-box Attack<\/a><\/strong>. Md Farhamdur Reza, Ali Rahmati, Tianfu Wu and Huaiyu Dai. <em>ICCV<\/em>, 2023.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/TPAMI.2023.3314745\">NOPE-SAC: Neural One-Plane RANSAC for Sparse-View Planar 3D Reconstruction<\/a><\/strong>. Bin Tan, Nan Xue, Tianfu Wu and Gui-Song Xia. <em>IEEE TPAMI<\/em>, 2023.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">2022<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/3DV57658.2022.00070\">HoW-3D: Holistic 3D Wireframe Perception from a Single Image<\/a><\/strong>. Wenchao Ma, Bin Tan, Nan Xue, Tianfu Wu, Xianwei Zheng and Gui-Song Xia. <em>3DV<\/em>, 2022.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1609\/aaai.v36i2.20074\">Learning Auxiliary Monocular Contexts Helps Monocular 3D Object Detection<\/a><\/strong>. Xianpeng Liu, Nan Xue and Tianfu Wu. <em>AAAI<\/em>, 2022.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/TPAMI.2021.3078577\">Learning Layout and Style Reconfigurable GANs for Controllable Image Synthesis<\/a><\/strong>. Wei Sun and Tianfu Wu. <em>IEEE TPAMI<\/em>, 2022.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2022\/papers\/Xue_Learning_Local-Global_Contextual_Adaptation_for_Multi-Person_Pose_Estimation_CVPR_2022_paper.pdf\">Learning Local-Global Contextual Adaptation for Multi-Person Pose Estimation<\/a><\/strong>. Nan Xue, Tianfu Wu, Gui-Song Xia and Liangpei Zhang. <em>CVPR<\/em>, 2022.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.3390\/s22197631\">Preliminary Evaluation of a System with On-Body and Aerial Sensors for Monitoring Working Dogs<\/a><\/strong>. Marc Foster, Tianfu Wu, David L. Roberts and Alper Bozkurt. <em>Sensors<\/em>, 2022.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/ICIP46576.2022.9897745\">Refining Self-Supervised Learning in Imaging: Beyond Linear Metric<\/a><\/strong>. Bo Jiang, Hamid Krim, Tianfu Wu and Derya Cansever. <em>ICIP<\/em>, 2022.<\/li>\n\n\n<li><strong><a href=\"http:\/\/papers.nips.cc\/paper_files\/paper\/2022\/hash\/6794f555524c9069e26970a408d353cc-Abstract-Conference.html\">Revisiting Non-Parametric Matching Cost Volumes for Robust and Generalizable Stereo Matching<\/a><\/strong>. Kelvin Cheng, Tianfu Wu and Christopher G. Healey. <em>NeurIPS<\/em>, 2022.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1145\/3551901.3556480\">RxGAN: Modeling High-Speed Receiver through Generative Adversarial Networks<\/a><\/strong>. Priyank Kashyap, Archit Gajjar, Yongjin Choi, Chau-Wai Wong, Dror Baron, Tianfu Wu, Chris Cheng and Paul D. Franzon. <em>MLCAD<\/em>, 2022.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">2021<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/TMM.2020.2978623\">A Bottom-Up and Top-Down Integration Framework for Online Object Tracking<\/a><\/strong>. Meihui Li, Lingbing Peng, Tianfu Wu and Zhenming Peng. <em>IEEE TMM<\/em>, 2021.<\/li>\n\n\n<li><strong><a href=\"https:\/\/arxiv.org\/abs\/2103.08475\">Deep Consensus Learning<\/a><\/strong>. Wei Sun and Tianfu Wu. <em>arXiv:2103.08475<\/em>, 2021.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1016\/j.sigpro.2021.108241\">Event driven sensor fusion<\/a><\/strong>. Siddharth Roheda, Hamid Krim, Zhi-Quan Luo and Tianfu Wu. <em>Signal Processing<\/em>, 2021.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/TPAMI.2019.2958642\">Learning Regional Attraction for Line Segment Detection<\/a><\/strong>. Nan Xue, Song Bai, Fu-Dong Wang, Gui-Song Xia, Tianfu Wu, Liangpei Zhang and Philip H. S. Torr. <em>IEEE TPAMI<\/em>, 2021.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/ICCV48922.2021.00415\">PlaneTR: Structure-Guided Transformers for 3D Plane Recovery<\/a><\/strong>. Bin Tan, Nan Xue, Song Bai, Tianfu Wu and Gui-Song Xia. <em>ICCV<\/em>, 2021.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">2020<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong><a href=\"https:\/\/doi.org\/10.1007\/978-3-030-58520-4_5\">Attentive Normalization<\/a><\/strong>. Xilai Li, Wei Sun and Tianfu Wu. <em>ECCV<\/em>, 2020.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openaccess.thecvf.com\/content_CVPR_2020\/html\/Xue_Holistically-Attracted_Wireframe_Parsing_CVPR_2020_paper.html\">Holistically-Attracted Wireframe Parsing<\/a><\/strong>. Nan Xue, Tianfu Wu, Song Bai, Fudong Wang, Gui-Song Xia, Liangpei Zhang and Philip H. S. Torr. <em>CVPR<\/em>, 2020.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openaccess.thecvf.com\/content_CVPR_2020\/html\/Xing_Inducing_Hierarchical_Compositional_Model_by_Sparsifying_Generator_Network_CVPR_2020_paper.html\">Inducing Hierarchical Compositional Model by Sparsifying Generator Network<\/a><\/strong>. Xianglei Xing, Tianfu Wu, Song-Chun Zhu and Ying Nian Wu. <em>CVPR<\/em>, 2020.<\/li>\n\n\n<li><strong><a href=\"https:\/\/openaccess.thecvf.com\/content_CVPRW_2020\/html\/w47\/Zhang_Learning_Ordered_Top-k_Adversarial_Attacks_via_Adversarial_Distillation_CVPRW_2020_paper.html\">Learning Ordered Top-k Adversarial Attacks via Adversarial Distillation<\/a><\/strong>. Zekun Zhang and Tianfu Wu. <em>CVPR Workshops<\/em>, 2020.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/ICPR48806.2021.9412469\">Local Clustering with Mean Teacher for Semi-supervised learning<\/a><\/strong>. Zexi Chen, Benjamin Dutton, Bharathkumar Ramachandra, Tianfu Wu and Ranga Raju Vatsavai. <em>ICPR<\/em>, 2020.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">2019<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong><a href=\"http:\/\/openaccess.thecvf.com\/content_CVPR_2019\/html\/Li_AOGNets_Compositional_Grammatical_Architectures_for_Deep_Learning_CVPR_2019_paper.html\">AOGNets: Compositional Grammatical Architectures for Deep Learning<\/a><\/strong>. Xilai Li, Xi Song and Tianfu Wu. <em>CVPR<\/em>, 2019.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/ICCV.2019.01063\">Image Synthesis From Reconfigurable Layout and Style<\/a><\/strong>. Wei Sun and Tianfu Wu. <em>ICCV<\/em>, 2019.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1016\/j.jvcir.2019.01.006\">Jointly social grouping and identification in visual dynamics with causality-induced hierarchical Bayesian model<\/a><\/strong>. Zhao Xie, Tianfu Wu, Xingming Yang, Luming Zhang and Kewei Wu. <em>JVCIR<\/em>, 2019.<\/li>\n\n\n<li><strong><a href=\"http:\/\/proceedings.mlr.press\/v97\/li19m.html\">Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting<\/a><\/strong>. Xilai Li, Yingbo Zhou, Tianfu Wu, Richard Socher and Caiming Xiong. <em>ICML<\/em>, 2019.<\/li>\n\n\n<li><strong><a href=\"http:\/\/openaccess.thecvf.com\/content_CVPR_2019\/html\/Xue_Learning_Attraction_Field_Representation_for_Robust_Line_Segment_Detection_CVPR_2019_paper.html\">Learning Attraction Field Representation for Robust Line Segment Detection<\/a><\/strong>. Nan Xue, Song Bai, Fudong Wang, Gui-Song Xia, Tianfu Wu and Liangpei Zhang. <em>CVPR<\/em>, 2019.<\/li>\n\n\n<li><strong><a href=\"http:\/\/arxiv.org\/abs\/1901.06322\">Learning Spatial Pyramid Attentive Pooling in Image Synthesis and Image-to-Image Translation<\/a><\/strong>. Wei Sun and Tianfu Wu. <em>arXiv:1901.06322<\/em>, 2019.<\/li>\n\n\n<li><strong><a href=\"http:\/\/arxiv.org\/abs\/1906.07251\">Pose Guided Fashion Image Synthesis Using Deep Generative Model<\/a><\/strong>. Wei Sun, Jawadul H. Bappy, Shanglin Yang, Yi Xu, Tianfu Wu and Hui Zhou. <em>arXiv:1906.07251<\/em>, 2019.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/ICCV.2019.00613\">Towards Interpretable Object Detection by Unfolding Latent Structures<\/a><\/strong>. Tianfu Wu and Xi Song. <em>ICCV<\/em>, 2019.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">2018<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong><a href=\"http:\/\/arxiv.org\/abs\/1807.02842\">Auto-Context R-CNN<\/a><\/strong>. Bo Li, Tianfu Wu, Lun Zhang and Rufeng Chu. <em>arXiv:1807.02842<\/em>, 2018.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.23919\/EUSIPCO.2018.8553412\">Decision Level Fusion: An Event Driven Approach<\/a><\/strong>. Siddharth Roheda, Hamid Krim, Zhi-Quan Luo and Tianfu Wu. <em>Signal Processing<\/em>, 2018.<\/li>\n\n\n<li><strong><a href=\"http:\/\/arxiv.org\/abs\/1801.07632\">High Resolution Face Completion with Multiple Controllable Attributes via Fully End-to-End Progressive Generative Adversarial Networks<\/a><\/strong>. Zeyuan Chen, Shaoliang Nie, Tianfu Wu and Christopher G. Healey. <em>arXiv:1801.07632<\/em>, 2018.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1007\/978-3-030-20890-5_14\">Neural Abstract Style Transfer for Chinese Traditional Painting<\/a><\/strong>. Bo Li, Caiming Xiong, Tianfu Wu, Yu Zhou, Lun Zhang and Rufeng Chu. <em>ACCV<\/em>, 2018.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1609\/aaai.v32i1.12256\">Scene-Centric Joint Parsing of Cross-View Videos<\/a><\/strong>. Hang Qi, Yuanlu Xu, Tao Yuan, Tianfu Wu and Song-Chun Zhu. <em>AAAI<\/em>, 2018.<\/li>\n\n\n<li><strong><a href=\"http:\/\/arxiv.org\/abs\/1809.02070\">ARCHER: Aggressive Rewards to Counter bias in Hindsight Experience Replay<\/a><\/strong>. Sameera Lanka and Tianfu Wu. <em>arXiv:1809.02070<\/em>, 2018.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">2017<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong><a href=\"http:\/\/arxiv.org\/abs\/1709.05436\">Joint Parsing of Cross-view Scenes with Spatio-temporal Semantic Parse Graphs<\/a><\/strong>. Hang Qi, Yuanlu Xu, Tao Yuan, Tianfu Wu and Song-Chun Zhu. <em>arXiv:1709.05436<\/em>, 2017.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/TPAMI.2016.2644963\">Online Object Tracking, Learning and Parsing with And-Or Graphs<\/a><\/strong>. Tianfu Wu, Yang Lu and Song-Chun Zhu. <em>IEEE TPAMI<\/em>, 2017.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/ICCVW.2017.310\">Zero-Shot Learning Posed as a Missing Data Problem<\/a><\/strong>. Bo Zhao, Botong Wu, Tianfu Wu and Yizhou Wang. <em>ICCV Workshops<\/em>, 2017.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">2016<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong><a href=\"https:\/\/doi.org\/10.1155\/2016\/7954154\">Deep Learning for Remote Sensing Image Understanding<\/a><\/strong>. Liangpei Zhang, Gui-Song Xia, Tianfu Wu, Liang Lin and Xue-Cheng Tai. <em>Journal of Sensors<\/em>, 2016.<\/li>\n\n\n<li><strong><a href=\"https:\/\/arxiv.org\/abs\/1606.00850\">Face Detection with End-to-End Integration of a ConvNet and a 3D Model<\/a><\/strong>. Yunzhu Li, Benyuan Sun, Tianfu Wu and Yizhou Wang. <em>ECCV<\/em>, 2016.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/TPAMI.2015.2497699\">Learning And-Or Model to Represent Context and Occlusion for Car Detection and Viewpoint Estimation<\/a><\/strong>. Tianfu Wu, Bo Li and Song-Chun Zhu. <em>IEEE TPAMI<\/em>, 2016.<\/li>\n\n\n<li><strong><a href=\"https:\/\/doi.org\/10.1109\/MIS.2015.94\">Monocular Depth-Ordering Reasoning with Occlusion Edge Detection and Couple Layers Inference<\/a><\/strong>. Anlong Ming, Tianfu Wu, Jianxiang Ma, Fang Sun and Yu Zhou. <em>IEEE Intelligent Systems<\/em>, 2016.<\/li>\n<\/ul>\n\n\n\n<h2 id=\"sponsors\" class=\"wp-block-heading has-bio-indigo-color has-text-color\">Sponsors<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">We gratefully acknowledge the sponsors of our research. Each award is listed with the number of papers above that acknowledge it.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>U.S. National Science Foundation (NSF)<\/strong>: <a href=\"https:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=1909644\">IIS-1909644<\/a> (30 papers); <a href=\"https:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=2013451\">IUSE-2013451<\/a> (20 papers); <a href=\"https:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=2024688\">CMMI-2024688<\/a> (19 papers); <a href=\"https:\/\/www.nsf.gov\/awardsearch\/showAward?AWD_ID=1822477\">IIS-1822477<\/a> (18 papers)<\/li>\n\n\n<li><strong>U.S. Army Research Office (ARO)<\/strong>: W911NF1810295 (30 papers); W911NF2210010 (12 papers); DURIP W911NF1810209 (7 papers); W911NF1910202 (2 papers)<\/li>\n\n\n<li><strong>U.S. Department of Health and Human Services, Administration for Community Living<\/strong>: 90IFDV0017-01-00 (8 papers)<\/li>\n\n\n<li><strong>Office of the Director of National Intelligence (ODNI), Intelligence Advanced Research Projects Activity (IARPA)<\/strong>: Contract No. 2021-21040700003 (1 paper)<\/li>\n\n\n<li><strong>Salesforce<\/strong>: Inaugural Deep Learning Research Grant (2018) (2 papers)<\/li>\n<\/ul>\n\n","protected":false},"excerpt":{"rendered":"<p>Re-se-arch: arch, search and re-search, the three layers of research. Intelligent systems work by putting parts together: objects into scenes, lines and planes into 3D&#8230;<\/p>\n","protected":false},"author":92,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-fullwidth.php","meta":{"_acf_changed":false,"footnotes":""},"class_list":["post-57","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-json\/wp\/v2\/pages\/57","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-json\/wp\/v2\/users\/92"}],"replies":[{"embeddable":true,"href":"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-json\/wp\/v2\/comments?post=57"}],"version-history":[{"count":66,"href":"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-json\/wp\/v2\/pages\/57\/revisions"}],"predecessor-version":[{"id":661,"href":"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-json\/wp\/v2\/pages\/57\/revisions\/661"}],"wp:attachment":[{"href":"https:\/\/research.ece.ncsu.edu\/ivmcl\/wp-json\/wp\/v2\/media?parent=57"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}