Due to the similar characteristics between event-based visual data and point
clouds, recent studies have emerged that treat event data as event clouds to
learn based on point cloud analysis. Additionally, some works approach point
clouds from the perspective of event vision, employing Spiking Neural Network
(SNN) due to their asynchronous nature. However, these contributions are often
domain-specific, making it difficult to extend their applicability to other
intersecting fields. Moreover, while SNN-based visual tasks have seen
significant growth, the conventional timestep-wise iterative activation
strategy largely limits their real-world applications by large timesteps,
resulting in significant delays and increased computational costs. Although
some innovative methods achieve good performance with short timesteps (<10),
few have fundamentally restructured the update strategy of spiking neurons to
completely overcome the limitations of timesteps. In response to these
concerns, we propose a novel and general activation strategy for spiking
neurons called Activation-wise Membrane Potential Propagation (AMP2). This
approach extends the concept of timesteps from a manually crafted parameter
within the activation function to any existing network structure. In
experiments on common point cloud tasks (classification, object, and scene
segmentation) and event cloud tasks (action recognition), we found that AMP2
stabilizes SNN training, maintains competitive performance, and reduces latency
compared to the traditional timestep-wise activation paradigm.
In the context of Omni-Directional Image (ODI) Super-Resolution (SR), the
unique challenge arises from the non-uniform oversampling characteristics
caused by EquiRectangular Projection (ERP). Considerable efforts in designing
complex spherical convolutions or polyhedron reprojection offer significant
performance improvements but at the expense of cumbersome processing procedures
and slower inference speeds. Under these circumstances, this paper proposes a
new ODI-SR model characterized by its capacity to perform Fast and
Arbitrary-scale ODI-SR processes, denoted as FAOR. The key innovation lies in
adapting the implicit image function from the planar image domain to the ERP
image domain by incorporating spherical geometric priors at both the latent
representation and image reconstruction stages, in a low-overhead manner.
Specifically, at the latent representation stage, we adopt a pair of pixel-wise
and semantic-wise sphere-to-planar distortion maps to perform affine
transformations on the latent representation, thereby incorporating it with
spherical properties. Moreover, during the image reconstruction stage, we
introduce a geodesic-based resampling strategy, aligning the implicit image
function with spherical geometrics without introducing additional parameters.
As a result, the proposed FAOR outperforms the state-of-the-art ODI-SR models
with a much faster inference speed. Extensive experimental results and ablation
studies have demonstrated the effectiveness of our design.
Authors' comments: 9 pages, 4 figures, AAAI 2025
KV cache quantization can improve Large Language Models (LLMs) inference
throughput and latency in long contexts and large batch-size scenarios while
preserving LLMs effectiveness. However, current methods have three unsolved
issues: overlooking layer-wise sensitivity to KV cache quantization, high
overhead of online fine-grained decision-making, and low flexibility to
different LLMs and constraints. Therefore, we thoroughly analyze the inherent
correlation of layer-wise transformer attention patterns to KV cache
quantization errors and study why key cache is more important than value cache
for quantization error reduction. We further propose a simple yet effective
framework KVTuner to adaptively search for the optimal hardware-friendly
layer-wise KV quantization precision pairs for coarse-grained KV cache with
multi-objective optimization and directly utilize the offline searched
configurations during online inference. To reduce the computational cost of
offline calibration, we utilize the intra-layer KV precision pair pruning and
inter-layer clustering to reduce the search space. Experimental results show
that we can achieve nearly lossless 3.25-bit mixed precision KV cache
quantization for LLMs like Llama-3.1-8B-Instruct and 4.0-bit for sensitive
models like Qwen2.5-7B-Instruct on mathematical reasoning tasks. The maximum
inference throughput can be improved by 38.3% compared with KV8 quantization
over various context lengths. Our code and searched configurations are
available at https://github.com/cmd2001/KVTuner.
Authors' comments: 36 pages. Code: https://github.com/cmd2001/KVTuner
Surface parametrization is a crucial part in various fields, having
applications in computer graphic, medical imaging, scientific computing and
computational engineering. The majority of surface parametrization approaches
are performed on triangular meshes. On the contrary, the theories and methods
of point cloud surface parametrization are less researched, despite its rising
significance. In this work, we compute surface parametrization in an
optimization approach using neural networks, with novel loss functions
introduced without extrinsic information, together with theoretical analyses.
Based on the theory, we develop an optimization algorithm to improve the
parametrization quality. Using our methods, general open surfaces can be
parametrized in either free-boundary manner or with arbitrary domain
constraints. Landmark matching can also be enforced under our framework.
Numerical experiments are conducted and presented, along with applications
including surface reconstruction and boundary detection.
We study the renormalized Nelson model for a scalar matter particle in a
continuous confining potential interacting with a possibly massless quantized
radiation field. When the radiation field is massless we impose a mild infrared
regularization ensuring that the Nelson Hamiltonian has a non-degenerate ground
state in all considered cases. Employing Feynman-Kac representations, we derive
lower bounds on the point-wise spatial decay of the partial Fock space norms of
ground state eigenvectors. Here the exponential rate function governing the
decay is given by the Agmon distance familiar from the analysis of
Schr\"{o}dinger operators. For a large class of confining potentials, our lower
bounds on the decay of ground state eigenvectors match asymptotically with the
upper bounds implied by previous work of the present authors.
Authors' comments: 16 pages
Doubling measure was introduced by Beurling and Ahlfors in 1956 and now it
becomes a basic concept in analysis on metric space. In this paper, for a
measure which is not doubling, we introduce a notion of point-wise doubling
index, and calculate the point-wise doubling indices of uniform Bernoulli
measures on Bedford-McMullen carpets. As an application, we show that, except a
small class of Bedford-McMullen carpets, if two Bedford-McMullen carpets are
bi-Lipschitz equivalent, then they have the same fiber sequence up to a
permutation.
We conduct a comprehensive density functional theory (DFT) study to explore
the intricate magnetic properties of frustrated Mn monolayer on the Ag(111)
surface. Spin-polarized scanning tunneling microscopy demonstrates that a
N\'eel magnetic state characterizes such an interface, which contradicts
systematic ab-initio predictions made in the last two decades indicating that
the ground state is collinear row-wise antiferromagnetic (RW-AFM) state. Here,
we employ the all-electron full-potential Korringa-Kohn-Rostoker Green function
(KKR) method and find that the ground state is a chiral magnetic N\'eel state,
with magnetic moments rotating in the surface plane following a unique sense of
rotation, as dictated by the underlying in-plane magnetic anisotropy and
Dzyaloshinskii-Moriya interaction. Once allowing disordered magnetic states, as
described within the disordered local moment (DLM) approach, we reveal the
possibility of stabilization of a RW-AFM state. We conjecture that at low
temperatures, the chiral N\'eel state prevails, while at higher temperatures,
the magnetic exchange interactions are modified by magnetic disorder, which can
then induce a transition towards a RW-AFM state. Our work addresses a long term
experimental-theoretical controversy and provides significant insights into the
magnetic interactions and stability of Mn films on noble metal substrates,
contributing to the broader understanding of the different magnetic facets of
frustrated magnetism in thin films.
Recent advancement in deep-neural network performance led to the development
of new state-of-the-art approaches in numerous areas. However, the black-box
nature of neural networks often prohibits their use in areas where model
explainability and model transparency are crucial. Over the years, researchers
proposed many algorithms to aid neural network understanding and provide
additional information to the human expert. One of the most popular methods
being Layer-Wise Relevance Propagation (LRP). This method assigns local
relevance based on the pixel-wise decomposition of nonlinear classifiers. With
the rise of attribution method research, there has emerged a pressing need to
assess and evaluate their performance. Numerous metrics have been proposed,
each assessing an individual property of attribution methods such as
faithfulness, robustness or localization. Unfortunately, no single metric is
deemed optimal for every case, and researchers often use several metrics to
test the quality of the attribution maps. In this work, we address the
shortcomings of the current LRP formulations and introduce a novel method for
determining the relevance of input neurons through layer-wise relevance
propagation. Furthermore, we apply this approach to the recently developed
Vision Transformer architecture and evaluate its performance against existing
methods on two image classification datasets, namely ImageNet and PascalVOC.
Our results clearly demonstrate the advantage of our proposed method.
Furthermore, we discuss the insufficiencies of current evaluation metrics for
attribution-based explainability and propose a new evaluation metric that
combines the notions of faithfulness, robustness and contrastiveness. We
utilize this new metric to evaluate the performance of various
attribution-based methods. Our code is available at:
https://github.com/davor10105/relative-absolute-magnitude-propagation
Authors' comments: 30 pages, 16 figures, 13 tables, ACM Transactions on Intelligence
Systems and Technology
As large language models (LLMs) continue to advance, the demand for higher
quality and faster processing of long contexts across various applications is
growing. KV cache is widely adopted as it stores previously generated key and
value tokens, effectively reducing redundant computations during inference.
However, as memory overhead becomes a significant concern, efficient
compression of KV cache has gained increasing attention. Most existing methods
perform compression from two perspectives: identifying important tokens and
designing compression strategies. However, these approaches often produce
biased distributions of important tokens due to the influence of accumulated
attention scores or positional encoding. Furthermore, they overlook the
sparsity and redundancy across different heads, which leads to difficulties in
preserving the most effective information at the head level. To this end, we
propose EMS to overcome these limitations, while achieving better KV cache
compression under extreme compression ratios. Specifically, we introduce a
Global-Local score that combines accumulated attention scores from both global
and local KV tokens to better identify the token importance. For the
compression strategy, we design an adaptive and unified Evict-then-Merge
framework that accounts for the sparsity and redundancy of KV tokens across
different heads. Additionally, we implement the head-wise parallel compression
through a zero-class mechanism to enhance efficiency. Extensive experiments
demonstrate our SOTA performance even under extreme compression ratios. EMS
consistently achieves the lowest perplexity, improves scores by over 1.28
points across four LLMs on LongBench under a 256 cache budget, and preserves
95% retrieval accuracy with a cache budget less than 2% of the context length
in the Needle-in-a-Haystack task.
We present the analysis of a comprehensive sample of 352 early-type galaxies
using public data, to investigate the correlations between CO luminosities and
mid-infrared luminosities observed by \textit{Wide-field Infrared Survey
Explorer} (\textit{WISE}). We find strong correlations between both CO (1-0)
and CO (2-1) luminosities and 12 \micron\ luminosity, boasting a correlation
coefficient greater than 0.9 and an intrinsic scatter smaller than 0.1 dex. The
consistent slopes observed for the relationships of CO (1-0) and CO (2-1)
suggest that the line ratio R21 lacks correlation with mid-infrared emission in
early-type galaxies, which is significantly different from star-forming
galaxies. Moreover, the slopes of $L_{\rm CO (1-0)}$--$L_{\mbox{12\micron}}$
and $L_{\rm CO (2-1)}$--$L_{\mbox{12\micron}}$ relations in early-type galaxies
are steeper than those observed in star-forming galaxies. Given the absence of
correlation with color, morphology or sSFR, the correlation between deviations
and the molecular gas mass surface density could be eliminated by correcting
the possible 12 \micron\ emission from old stars or adopting a systematically
different $\alpha_{\rm CO}$. The latter, on average, is equivalent to adding an
constant CO brightness density, specifically
${2.8{_{-0.6}}\!\!\!\!\!\!\!\!\!^{+0.8}}~[\mathrm{K~km~s^{-1}}]$ and
${4.4{_{-1.4}}\!\!\!\!\!\!\!\!\!^{+2.2}}~[\mathrm{K~km~s^{-1}}]$ for CO (1-0)
and (2-1) respectively. These explorations will serve as useful tools for
estimating the molecular gas content in gas-poor galaxies and understanding
associated quenching processes.
Authors' comments: 20 pages, 6 figures, accepted for publication in ApJ
Cardinal functions provide valuable insight into the topological properties
of spaces, helping to analyze and compare spaces in terms of their covering,
convergence and separation properties. This paper focuses on investigating
cardinal functions like network weight, Lindel\"of degree, tightness, weak
covering, pseudocharacter, and $i$-weight, for the spaces $Q_{P}(X)$ and
$Q_{P}(X,Y)$ of quasi-continuous functions under the topology of point-wise
convergence. In addition to these, we also investigate properties of
restriction and induced maps associated with the spaces $Q_{P}(X)$ and
$Q_{P}(X,Y)$.
Differentiable rendering techniques have recently shown promising results for
free-viewpoint video synthesis of characters. However, such methods, either
Gaussian Splatting or neural implicit rendering, typically necessitate
per-subject optimization which does not meet the requirement of real-time
rendering in an interactive application. We propose a generalizable Gaussian
Splatting approach for high-resolution image rendering under a sparse-view
camera setting. To this end, we introduce Gaussian parameter maps defined on
the source views and directly regress Gaussian properties for instant novel
view synthesis without any fine-tuning or optimization. We train our Gaussian
parameter regression module on human-only data or human-scene data, jointly
with a depth estimation module to lift 2D parameter maps to 3D space. The
proposed framework is fully differentiable with both depth and rendering
supervision or with only rendering supervision. We further introduce a
regularization term and an epipolar attention mechanism to preserve geometry
consistency between two source views, especially when neglecting depth
supervision. Experiments on several datasets demonstrate that our method
outperforms state-of-the-art methods while achieving an exceeding rendering
speed.
Authors' comments: Journal extension of CVPR 2024,Project
page:https://yaourtb.github.io/GPS-Gaussian+
Fine-tuning large language models (LLMs) poses significant memory challenges,
as the back-propagation process demands extensive resources, especially with
growing model sizes. Recent work, MeZO, addresses this issue using a
zeroth-order (ZO) optimization method, which reduces memory consumption by
matching the usage to the inference phase. However, MeZO experiences slow
convergence due to varying curvatures across model parameters. To overcome this
limitation, we introduce HELENE, a novel scalable and memory-efficient
optimizer that integrates annealed A-GNB gradients with a diagonal Hessian
estimation and layer-wise clipping, serving as a second-order pre-conditioner.
This combination allows for faster and more stable convergence. Our theoretical
analysis demonstrates that HELENE improves convergence rates, particularly for
models with heterogeneous layer dimensions, by reducing the dependency on the
total parameter space dimension. Instead, the method scales with the largest
layer dimension, making it highly suitable for modern LLM architectures.
Experimental results on RoBERTa-large and OPT-1.3B across multiple tasks show
that HELENE achieves up to a 20x speedup compared to MeZO, with average
accuracy improvements of 1.5%. Furthermore, HELENE remains compatible with both
full parameter tuning and parameter-efficient fine-tuning (PEFT), outperforming
several state-of-the-art optimizers. The codes will be released after
reviewing.
Hyperspectral imaging (HSI) holds significant potential for transforming the
field of computational pathology. However, there is currently a shortage of
pixel-wise annotated HSI data necessary for training deep learning (DL) models.
Additionally, the number of HSI-based research studies remains limited, and in
many cases, the advantages of HSI over traditional RGB imaging have not been
conclusively demonstrated, particularly for specimens collected
intraoperatively. To address these challenges we present a database consisted
of 27 HSIs of hematoxylin-eosin stained frozen sections, collected from 14
patients with colon adenocarcinoma metastasized to the liver. It is aimed to
validate pixel-wise classification for intraoperative tumor resection. The HSIs
were acquired in the spectral range of 450 to 800 nm, with a resolution of 1
nm, resulting in images of 1384x1035 pixels. Pixel-wise annotations were
performed by three pathologists. To overcome challenges such as experimental
variability and the lack of annotated data, we combined label-propagation-based
semi-supervised learning (SSL) with spectral-spatial features extracted by: the
multiscale principle of relevant information (MPRI) method and tensor singular
spectrum analysis method. Using only 1% of labeled pixels per class the
SSL-MPRI method achieved a micro balanced accuracy (BACC) of 0.9313 and a micro
F1-score of 0.9235 on the HSI dataset. The performance on corresponding RGB
images was lower, with a micro BACC of 0.8809 and a micro F1-score of 0.8688.
These improvements are statistically significant. The SSL-MPRI approach
outperformed six DL architectures trained with 63% of labeled pixels. Data and
code are available at: https://github.com/ikopriva/ColonCancerHSI.
Authors' comments: 12 pages, 5 figures, 5 tables
The structure and kinematics of the Milky Way disk are largely inferred from
the solar vicinity. To gain a comprehensive understanding, it is essential to
find reliable tracers in less-explored regions like the bulge and the far side
of the disk. Mira variables, which are well-studied and bright standard
candles, offer an excellent opportunity to trace intermediate and old
populations in these complex regions. We aim to isolate a clean sample of Miras
in the Vista Variables in the V\'ia L\'actea survey using Gaussian process
algorithms. This sample will be used to study intermediate and old age
populations in the Galactic bulge and far disk. Near- and mid-infrared
time-series photometry were processed using Gaussian Process algorithms to
identify Mira variables and model their light curves. We calibrated selection
criteria with a visually inspected sample to create a high-purity sample of
Miras, integrating multi-band photometry and kinematic data from proper
motions. We present a catalog of 3602 Mira variables. By analyzing photometry,
we classify them by O-rich or C-rich surface chemistry and derive
selective-to-total extinction ratios of $A_{K_{s}}/E(J - K_{s}) = 0.471 \pm
0.01$ and $A_{K_{s}}/E(H - K_{s}) = 1.320 \pm 0.020$. Using the Mira period-age
relation, we find evidence supporting the inside-out formation of the Milky Way
disk. The distribution of proper motions and distances aligns with the Galactic
rotation curve and disk kinematics. We extend the rotation curve up to R$_{\rm
GC} \sim 17 \ \rm{kpc}$ and find no strong evidence of the nuclear stellar disk
in our Mira sample. This study constitutes the largest catalog of variable
stars on the far side of the Galactic disk to date.
Authors' comments: 20 pages, 19 figures, Accepted in A&A
Developing accurate and efficient detectors for drone imagery is challenging
due to the inherent complexity of aerial scenes. While some existing methods
aim to achieve high accuracy by utilizing larger models, their computational
cost is prohibitive for drones. Recently, Knowledge Distillation (KD) has shown
promising potential for maintaining satisfactory accuracy while significantly
compressing models in general object detection. Considering the advantages of
KD, this paper presents the first attempt to adapt it to object detection on
drone imagery and addresses two intrinsic issues: (1) low foreground-background
ratio and (2) small instances and complex backgrounds, which lead to inadequate
training, resulting insufficient distillation. Therefore, we propose a
task-wise Lightweight Mutual Lifting (Light-ML) module with a Centerness-based
Instance-aware Distillation (CID) strategy. The Light-ML module mutually
harmonizes the classification and localization branches by channel shuffling
and convolution, integrating teacher supervision across different tasks during
back-propagation, thus facilitating training the student model. The CID
strategy extracts valuable regions surrounding instances through the centerness
of proposals, enhancing distillation efficacy. Experiments on the VisDrone,
UAVDT, and COCO benchmarks demonstrate that the proposed approach promotes the
accuracies of existing state-of-the-art KD methods with comparable
computational requirements. Codes will be available upon acceptance.
Compute-in-memory (CIM) accelerators for spiking neural networks (SNNs) are
promising solutions to enable $\mu$s-level inference latency and ultra-low
energy in edge vision applications. Yet, their current lack of flexibility at
both the circuit and system levels prevents their deployment in a wide range of
real-life scenarios. In this work, we propose a novel digital CIM macro that
supports arbitrary operand resolution and shape, with a unified CIM storage for
weights and membrane potentials. These circuit-level techniques enable a hybrid
weight- and output-stationary dataflow at the system level to maximize operand
reuse, thereby minimizing costly on- and off-chip data movements during the SNN
execution. Measurement results of a fabricated FlexSpIM prototype in 40-nm CMOS
demonstrate a 2$\times$ increase in bit-normalized energy efficiency compared
to prior fixed-precision digital CIM-SNNs, while providing resolution
reconfiguration with bitwise granularity. Our approach can save up to 90%
energy in large-scale systems, while reaching a state-of-the-art classification
accuracy of 95.8% on the IBM DVS gesture dataset.
Authors' comments: 5 pages, 7 figures, submitted to IEEE ISCAS 2025
We study the channel estimation problem for a reconfigurable intelligent
surface (RIS)-assisted millimeter-wave (mmWave) multi-user multiple-input
multiple-output (MU-MIMO) system. In particular, it is assumed that the channel
between a RIS and a base station (BS) exhibits a near-field line-of-sight (LoS)
channel, which is a dominant signal path in mmWave communication systems. Due
to the high-rankness and non-sparsity of the RIS-BS channel matrix in our
system, the state-of-the-art (SOTA) methods, which are constructed based on
far-field or near-field non-LoS (NLoS) channel, cannot provide attractive
estimation performances. We for the first time propose an efficient near-field
LoS/NLoS channel estimation method for RIS-assisted MU-MIMO systems by means of
a piece-wise low-rank approximation. Specifically, an effective channel (to be
estimated) is partitioned into piece-wise effective channels containing
low-rank structures and then, they are estimated via collaborative low-rank
approximation. The proposed method is named PW-CLRA. Via simulations, we verify
the effectiveness of the proposed PW-CLRA.
Authors' comments: Submitted to the IEEE Transactions on Wireless Communications, 12
pages, 8 figures
Parameter-Efficient Fine-Tuning (PEFT) methods have gained significant
popularity for adapting pre-trained Large Language Models (LLMs) to downstream
tasks, primarily due to their potential to significantly reduce memory and
computational overheads. However, a common limitation in most PEFT approaches
is their application of a uniform architectural design across all layers. This
uniformity involves identical trainable modules and ignores the varying
importance of each layer, leading to sub-optimal fine-tuning results. To
overcome the above limitation and obtain better performance, we develop a novel
approach, Importance-aware Sparse Tuning (IST), to fully utilize the inherent
sparsity and select the most important subset of full layers with effective
layer-wise importance scoring. The proposed IST is a versatile and
plug-and-play technique compatible with various PEFT methods that operate on a
per-layer basis. By leveraging the estimated importance scores, IST dynamically
updates these selected layers in PEFT modules, leading to reduced memory
demands. We further provide theoretical proof of convergence and empirical
evidence of superior performance to demonstrate the advantages of IST over
uniform updating strategies. Extensive experiments on a range of LLMs, PEFTs,
and downstream tasks substantiate the effectiveness of our proposed method,
showcasing IST's capacity to enhance existing layer-based PEFT methods. Our
code is available at https://github.com/Kaiseem/IST.
Authors' comments: EMNLP 2024
This study addresses a design of distributed controllers for discrete-time
systems using linear matrix inequalities (LMIs). Sparsity constraints on
control gains of distributed controllers result in conservatism via the
convexification of the existing methods such as the extended LMI method. In
order to mitigate the conservatism, we introduce a novel LMI formulation for
this problem, utilizing the clique-wise decomposition method from our previous
work on continuous-time systems. By reformulating the sparsity constraint on
the gain matrix within cliques, this method achieves a broader solution set.
Also, the analytical superiority of our method is confirmed through numerical
examples.
