An empirical forward-modeling framework is developed to interpret the
multiwavelength properties of Active Galactic Nuclei (AGN) and provide insights
into the overlap and incompleteness of samples selected at different parts of
the electromagnetic spectrum. The core of the model are observationally derived
probabilites on the occupation of galaxies by X-ray selected AGN. These are
used to seed mock galaxies drawn from stellar-mass functions with accretion
events and then associate them with spectral energy distributions that describe
both the stellar and AGN emission components. This approach is used to study
the complementarity between X-ray and WISE mid-infrared AGN selection methods.
We first show that the basic observational properties of the X-ray and WISE AGN
(magnitude, redshift distributions) are adequately reproduced by the model. We
then infer the level of contamination of the WISE selection and show that this
is dominated by non-AGN at redshifts z < 0.5. These are star-forming galaxies
that scatter into the WISE AGN selection wedge because of photometric
uncertainties affecting their colours. Our baseline model shows a sharp drop in
the number density of heavily obscured AGN above the Compton thick limit in the
WISE bands. The model also overpredicts by a factor of 1.5 the fraction of
X-ray associations in the WISE AGN selection box compared to observations. This
suggests a population of X-ray faint sources that is not reproduced by the
model. This discrepancy is discussed in the context of either heavily obscured
or intrinsically X-ray weak AGN. Evidence is found in favour of the latter.
Authors' comments: MNRAS accepted, 22 pages, 25 figures, the mock AGN samples used in
this paper are available at https://zenodo.org/record/3906341
The real human attention is an interactive activity between our visual system
and our brain, using both low-level visual stimulus and high-level semantic
information. Previous image salient object detection (SOD) works conduct their
saliency predictions in a multi-task manner, i.e., performing pixel-wise
saliency regression and segmentation-like saliency refinement at the same time,
which degenerates their feature backbones in revealing semantic information.
However, given an image, we tend to pay more attention to those regions which
are semantically salient even in the case that these regions are perceptually
not the most salient ones at first glance. In this paper, we divide the SOD
problem into two sequential tasks: 1) we propose a lightweight, weakly
supervised deep network to coarsely locate those semantically salient regions
first; 2) then, as a post-processing procedure, we selectively fuse multiple
off-the-shelf deep models on these semantically salient regions as the
pixel-wise saliency refinement. In sharp contrast to the state-of-the-art
(SOTA) methods that focus on learning pixel-wise saliency in "single image"
using perceptual clues mainly, our method has investigated the "object-level
semantic ranks between multiple images", of which the methodology is more
consistent with the real human attention mechanism. Our method is simple yet
effective, which is the first attempt to consider the salient object detection
mainly as an object-level semantic re-ranking problem.
Short-term origin-destination (OD) flow prediction in urban rail transit
(URT) plays a crucial role in smart and real-time URT operation and management.
Different from other short-term traffic forecasting methods, the short-term OD
flow prediction possesses three unique characteristics: (1) data availability:
real-time OD flow is not available during the prediction; (2) data
dimensionality: the dimension of the OD flow is much higher than the
cardinality of transportation networks; (3) data sparsity: URT OD flow is
spatiotemporally sparse. There is a great need to develop novel OD flow
forecasting method that explicitly considers the unique characteristics of the
URT system. To this end, a channel-wise attentive split-convolutional neural
network (CAS-CNN) is proposed. The proposed model consists of many novel
components such as the channel-wise attention mechanism and split CNN. In
particular, an inflow/outflow-gated mechanism is innovatively introduced to
address the data availability issue. We further originally propose a masked
loss function to solve the data dimensionality and data sparsity issues. The
model interpretability is also discussed in detail. The CAS-CNN model is tested
on two large-scale real-world datasets from Beijing Subway, and it outperforms
the rest of benchmarking methods. The proposed model contributes to the
development of short-term OD flow prediction, and it also lays the foundations
of real-time URT operation and management.
Authors' comments: This paper has been accepted by the Transportation Research Part C:
Emerging Technologies as a regular paper
We investigate the space-time regularity of the local time associated to
Volterra-L\'evy processes, including Volterra processes driven by
$\alpha$-stable processes for $\alpha\in(0,2]$. We show that the spatial
regularity of the local time for Volterra-L\'evy process is $P$-a.s. inverse
proportionally to the singularity of the associated Volterra kernel. We apply
our results to the investigation of path-wise regularizing effects obtained by
perturba\Ption of ODEs by a Volterra-L\'evy process which has sufficiently
regular local time. Following along the lines of [15], we show existence,
uniqueness and differentiablility of the flow associated to such equations.
Authors' comments: 24 pages
Background and Objective:Currently, the whole world is facing a pandemic
disease, novel Coronavirus also known as COVID-19, which spread in more than
200 countries with around 3.3 million active cases and 4.4 lakh deaths
approximately. Due to rapid increase in number of cases and limited supply of
testing kits, availability of alternative diagnostic method is necessary for
containing the spread of COVID-19 cases at an early stage and reducing the
death count. For making available an alternative diagnostic method, we proposed
a deep neural network based diagnostic method which can be easily integrated
with mobile devices for detection of COVID-19 and viral pneumonia using Chest
X-rays (CXR) images. Methods:In this study, we have proposed a method named
COVIDLite, which is a combination of white balance followed by Contrast Limited
Adaptive Histogram Equalization (CLAHE) and depth-wise separable convolutional
neural network (DSCNN). In this method, white balance followed by CLAHE is used
as an image preprocessing step for enhancing the visibility of CXR images and
DSCNN trained using sparse cross entropy is used for image classification with
lesser parameters and significantly lighter in size, i.e., 8.4 MB without
quantization. Results:The proposed COVIDLite method resulted in improved
performance in comparison to vanilla DSCNN with no pre-processing. The proposed
method achieved higher accuracy of 99.58% for binary classification, whereas
96.43% for multiclass classification and out-performed various state-of-the-art
methods. Conclusion:Our proposed method, COVIDLite achieved exceptional results
on various performance metrics. With detailed model interpretations, COVIDLite
can assist radiologists in detecting COVID-19 patients from CXR images and can
reduce the diagnosis time significantly.
2926.
InteractionNet: Modeling and Explaining of Noncovalent Protein-Ligand
Interactions with Noncovalent Graph Neural Network and Layer-Wise Relevance
Propagation
Expanding the scope of graph-based, deep-learning models to noncovalent
protein-ligand interactions has earned increasing attention in structure-based
drug design. Modeling the protein-ligand interactions with graph neural
networks (GNNs) has experienced difficulties in the conversion of
protein-ligand complex structures into the graph representation and left
questions regarding whether the trained models properly learn the appropriate
noncovalent interactions. Here, we proposed a GNN architecture, denoted as
InteractionNet, which learns two separated molecular graphs, being covalent and
noncovalent, through distinct convolution layers. We also analyzed the
InteractionNet model with an explainability technique, i.e., layer-wise
relevance propagation, for examination of the chemical relevance of the model's
predictions. Separation of the covalent and noncovalent convolutional steps
made it possible to evaluate the contribution of each step independently and
analyze the graph-building strategy for noncovalent interactions. We applied
InteractionNet to the prediction of protein-ligand binding affinity and showed
that our model successfully predicted the noncovalent interactions in both
performance and relevance in chemical interpretation.
A deep convolutional neural network (CNN) has been widely used in image
classification and gives better classification accuracy than the other
techniques. The softmax cross-entropy loss function is often used for
classification tasks. There are some works to introduce the additional terms in
the objective function for training to make the features of the output layer
more discriminative. The neuron-wise discriminant criterion makes the input
feature of each neuron in the output layer discriminative by introducing the
discriminant criterion to each of the features. Similarly, the center loss was
introduced to the features before the softmax activation function for face
recognition to make the deep features discriminative. The ReLU function is
often used for the network as an active function in the hidden layers of the
CNN. However, it is observed that the deep features trained by using the ReLU
function are not discriminative enough and show elongated shapes. In this
paper, we propose to use the neuron-wise discriminant criterion at the output
layer and the center-loss at the hidden layer. Also, we introduce the online
computation of the means of each class with the exponential forgetting. We
named them adaptive neuron-wise discriminant criterion and adaptive center
loss, respectively. The effectiveness of the integration of the adaptive
neuron-wise discriminant criterion and the adaptive center loss is shown by the
experiments with MNSIT, FashionMNIST, CIFAR10, CIFAR100, and STL10. Source code
is at https://github.com/i13abe/Adaptive-discriminant-and-center
Authors' comments: Accepted to IJCNN 2020
The Massive and Distant Clusters of WISE Survey (MaDCoWS) provides a catalog
of high-redshift ($0.7\lesssim z\lesssim 1.5$) infrared-selected galaxy
clusters. However, the verification of the ionized intracluster medium,
indicative of a collapsed and nearly virialized system, is made challenging by
the high redshifts of the sample members. The main goal of this work is to test
the capabilities of the Atacama Compact Array (ACA; also known as the Morita
Array) Band 3 observations, centered at about 97.5 GHz, to provide robust
validation of cluster detections via the thermal Sunyaev-Zeldovich (SZ) effect.
Using a pilot sample that comprises ten MaDCoWS galaxy clusters, accessible to
ACA and representative of the median sample richness, we infer the masses of
the selected galaxy clusters and respective detection significance by means of
a Bayesian analysis of the interferometric data. Our test of the "Verification
with the ACA - Localization and Cluster Analysis" (VACA LoCA) program
demonstrates that the ACA can robustly confirm the presence of the virialized
intracluster medium in galaxy clusters previously identified in full-sky
surveys. In particular, we obtain a significant detection of the SZ effect for
seven out of the ten VACA LoCA clusters. We note that this result is
independent of the assumed pressure profile. However, the limited angular
dynamic range of the ACA in Band 3 alone, short observational integration
times, and possible contamination from unresolved sources limit the detailed
characterization of the cluster properties and the inference of the cluster
masses within scales appropriate for the robust calibration of mass-richness
scaling relations.
Authors' comments: 19 pages (including appendices), 14 figures, and 4 tables; accepted
for publication in A&A
Dental panoramic X-ray imaging is a popular diagnostic method owing to its
very small dose of radiation. For an automated computer-aided diagnosis system
in dental clinics, automatic detection and identification of individual teeth
from panoramic X-ray images are critical prerequisites. In this study, we
propose a point-wise tooth localization neural network by introducing a spatial
distance regularization loss. The proposed network initially performs center
point regression for all the anatomical teeth (i.e., 32 points), which
automatically identifies each tooth. A novel distance regularization penalty is
employed on the 32 points by considering $L_2$ regularization loss of Laplacian
on spatial distances. Subsequently, teeth boxes are individually localized
using a cascaded neural network on a patch basis. A multitask offset training
is employed on the final output to improve the localization accuracy. Our
method successfully localizes not only the existing teeth but also missing
teeth; consequently, highly accurate detection and identification are achieved.
The experimental results demonstrate that the proposed algorithm outperforms
state-of-the-art approaches by increasing the average precision of teeth
detection by 15.71% compared to the best performing method. The accuracy of
identification achieved a precision of 0.997 and recall value of 0.972.
Moreover, the proposed network does not require any additional identification
algorithm owing to the preceding regression of the fixed 32 points regardless
of the existence of the teeth.
Authors' comments: 10 pages, 7 figures
Past studies of compact active galactic nuclei (AGNs), the dominant
population at high radio frequencies, selected them using flat spectral index
criteria. This biases the sample due to the steepening of AGN spectra at high
radio frequencies. We improve upon this by selecting 3610 compact AGNs using
their angular size information ($\sim$0.15 arcsec scale) from the Australia
Telescope 20 GHz (AT20G) high-angular-resolution catalogue. We cross-match
these against the Wide-field Infrared Survey Explorer All-WISE catalogue and
present a catalogue with 3300 (91%) matches, 91 (3%) rejects and 219 (6%)
nondetections that are excellent high redshift candidates. Of the matched
compact AGNs, 92% exhibit QSO mid-infrared colours (W1-W2>0.5). Therefore, our
sample of high frequency compact sources has a very high rate of identification
with mid-infrared QSOs. We find counterparts for 88% of 387 compact
steep-spectrum (CSS) sources in the AT20G survey, 82%$\pm$5% of which exhibit
QSO mid-infrared colours and have moderate redshifts (median redshift = 0.82),
while those dominated by host galaxy colours in mid-infrared have lower
redshifts (median redshift = 0.13). The latter classified into late- and
early-type galaxies using their mid-infrared colours shows a majority
(68%$\pm$4%) have colours characteristic of late-type galaxies. Thus, we find
that a larger fraction of these CSS sources are embedded in hosts with higher
gas densities than average early-type galaxies. We compare mid-infrared colours
of our AGNs against those reported for AGNs primarily selected using non-radio
techniques. This shows that mid-infrared SED of high frequency selected compact
radio AGN is comparatively less red, possibly due to contributions from their
hosts.
Authors' comments: Accepted for publication in MNRAS. 21 pages, 18 figures
The slice-wise multiplication of two tensors is required in a variety of
tensor decompositions (including PARAFAC2 and PARATUCK2) and is encountered in
many applications, including the analysis of multidimensional biomedical data
(EEG, MEG, etc.) or multi-carrier MIMO systems. In this paper, we propose a new
tensor representation that is not based on a slice-wise (matrix) description,
but can be represented by a double contraction of two tensors. Such a double
contraction of two tensors can be efficiently calculated via generalized
unfoldings. It leads to new tensor models of the investigated system that do
not depend on the chosen unfolding and reveal the tensor structure of the data
model (such that all possible unfoldings can be seen at the same time). As an
example, we apply this new concept to the design of new receivers for
multi-carrier MIMO systems in wireless communications. In particular, we
consider MIMO OFDM systems with and without Khatri-Rao coding. The proposed
receivers exploit the channel correlation between adjacent subcarriers, require
the same amount of training symbols as traditional OFDM techniques, but have an
improved performance in terms of the symbol error rate. Furthermore, we show
that the spectral efficiency of the Khatri-Rao coded MIMO-OFDM can be increased
by introducing "random coding" such that the "coding matrix" also contains
useful information symbols. Considering this transmission technique, we derive
a tensor model and two types of receivers for randomly coded MIMO-OFDM systems
using the double contraction of two tensors.
Deep neural networks have been used in various machine learning applications
and achieved tremendous empirical successes. However, training deep neural
networks is a challenging task. Many alternatives have been proposed in place
of end-to-end back-propagation. Layer-wise training is one of them, which
trains a single layer at a time, rather than trains the whole layers
simultaneously. In this paper, we study a layer-wise training using a block
coordinate gradient descent (BCGD) for deep linear networks. We establish a
general convergence analysis of BCGD and found the optimal learning rate, which
results in the fastest decrease in the loss. More importantly, the optimal
learning rate can directly be applied in practice, as it does not require any
prior knowledge. Thus, tuning the learning rate is not needed at all. Also, we
identify the effects of depth, width, and initialization in the training
process. We show that when the orthogonal-like initialization is employed, the
width of intermediate layers plays no role in gradient-based training, as long
as the width is greater than or equal to both the input and output dimensions.
We show that under some conditions, the deeper the network is, the faster the
convergence is guaranteed. This implies that in an extreme case, the global
optimum is achieved after updating each weight matrix only once. Besides, we
found that the use of deep networks could drastically accelerate convergence
when it is compared to those of a depth 1 network, even when the computational
cost is considered. Numerical examples are provided to justify our theoretical
findings and demonstrate the performance of layer-wise training by BCGD.
The study of pattern emergence together with exploration of the exemplar
Turing model is enjoying a renaissance both from theoretical and experimental
perspective. Here, we implement a stability analysis of spatially dependent
reaction kinetics by exploring the effect of a jump discontinuity within
piece-wise constant kinetic parameters, using various methods to identify and
confirm the diffusion-driven instability conditions. Essentially, the presence
of stability or instability in Turing models is a local property for piece-wise
constant kinetic parameters and, as such, may be analysed locally. In
particular, a local assessment of whether parameters are within the Turing
space provides a strong indication that for a large enough region with these
parameters, an instability can be excited.
Authors' comments: 26 pages, 4 figures
The study of the extragalactic background light (EBL) in the optical and near
infrared has received a lot of attention in the last decade, especially near a
wavelength of $\lambda\approx 3.4\operatorname{\mu m}$, with remaining tension
among different techniques for estimating the background. In this paper we
present a measurement of the contribution of galaxies to the EBL at
$3.4\operatorname{\mu m}$ that is based on the measurement of the luminosity
function (LF) in Lake et al. (2018) and the mean spectral energy distribution
of galaxies in Lake & Wright (2016). The mean and standard deviation of our
most reliable Bayesian posterior chain gives a $3.4\operatorname{\mu m}$
background of $I_\nu = 9.0\pm0.5 \operatorname{kJy} \operatorname{sr}^{-1}$
($\nu I_\nu = 8.0\pm0.4 \operatorname{nW} \operatorname{m}^{-2}
\operatorname{sr}^{-1} e\operatorname{-fold}^{-1}$), with systematic
uncertainties unlikely to be greater than $2\operatorname{kJy}
\operatorname{sr}^{-1}$. This result is higher than most previous efforts to
measure the contribution of galaxies to the $3.4\operatorname{\mu m}$ EBL, but
is consistent with the upper limits placed by blazars and the most recent
direct measurements of the total $3.4\operatorname{\mu m}$ EBL.
Authors' comments: 14 pages, 8 figures, 2 tables, submitted to ApJ. Table 1 data to be
available from figshare under DOI 10.6084/m9.figshare.4245443, Table 2 under
DOI 10.6084/m9.figshare.8142284, and the data behind Figure 5 under
10.6084/m9.figshare.4757131
Recently, visual encoding based on functional magnetic resonance imaging
(fMRI) have realized many achievements with the rapid development of deep
network computation. Visual encoding model is aimed at predicting brain
activity in response to presented image stimuli. Currently, visual encoding is
accomplished mainly by firstly extracting image features through convolutional
neural network (CNN) model pre-trained on computer vision task, and secondly
training a linear regression model to map specific layer of CNN features to
each voxel, namely voxel-wise encoding. However, the two-step manner model,
essentially, is hard to determine which kind of well features are well linearly
matched for beforehand unknown fMRI data with little understanding of human
visual representation. Analogizing computer vision mostly related human vision,
we proposed the end-to-end convolution regression model (ETECRM) in the region
of interest (ROI)-wise manner to accomplish effective and efficient visual
encoding. The end-to-end manner was introduced to make the model automatically
learn better matching features to improve encoding performance. The ROI-wise
manner was used to improve the encoding efficiency for many voxels. In
addition, we designed the selective optimization including self-adapting weight
learning and weighted correlation loss, noise regularization to avoid
interfering of ineffective voxels in ROI-wise encoding. Experiment demonstrated
that the proposed model obtained better predicting accuracy than the two-step
manner of encoding models. Comparative analysis implied that end-to-end manner
and large volume of fMRI data may drive the future development of visual
encoding.
Authors' comments: under review in Computational Intelligence and Neuroscience
Machine learning-based imaging diagnostics has recently reached or even
superseded the level of clinical experts in several clinical domains. However,
classification decisions of a trained machine learning system are typically
non-transparent, a major hindrance for clinical integration, error tracking or
knowledge discovery. In this study, we present a transparent deep learning
framework relying on convolutional neural networks (CNNs) and layer-wise
relevance propagation (LRP) for diagnosing multiple sclerosis (MS). MS is
commonly diagnosed utilizing a combination of clinical presentation and
conventional magnetic resonance imaging (MRI), specifically the occurrence and
presentation of white matter lesions in T2-weighted images. We hypothesized
that using LRP in a naive predictive model would enable us to uncover relevant
image features that a trained CNN uses for decision-making. Since imaging
markers in MS are well-established this would enable us to validate the
respective CNN model. First, we pre-trained a CNN on MRI data from the
Alzheimer's Disease Neuroimaging Initiative (n = 921), afterwards specializing
the CNN to discriminate between MS patients and healthy controls (n = 147).
Using LRP, we then produced a heatmap for each subject in the holdout set
depicting the voxel-wise relevance for a particular classification decision.
The resulting CNN model resulted in a balanced accuracy of 87.04% and an area
under the curve of 96.08% in a receiver operating characteristic curve. The
subsequent LRP visualization revealed that the CNN model focuses indeed on
individual lesions, but also incorporates additional information such as lesion
location, non-lesional white matter or gray matter areas such as the thalamus,
which are established conventional and advanced MRI markers in MS. We conclude
that LRP and the proposed framework have the capability to make diagnostic
decisions of...
X-ray baggage security screening is widely used to maintain aviation and
transport security. Of particular interest is the focus on automated security
X-ray analysis for particular classes of object such as electronics, electrical
items, and liquids. However, manual inspection of such items is challenging
when dealing with potentially anomalous items. Here we present a dual
convolutional neural network (CNN) architecture for automatic anomaly detection
within complex security X-ray imagery. We leverage recent advances in
region-based (R-CNN), mask-based CNN (Mask R-CNN) and detection architectures
such as RetinaNet to provide object localisation variants for specific object
classes of interest. Subsequently, leveraging a range of established CNN object
and fine-grained category classification approaches we formulate within object
anomaly detection as a two-class problem (anomalous or benign). While the best
performing object localisation method is able to perform with 97.9% mean
average precision (mAP) over a six-class X-ray object detection problem,
subsequent two-class anomaly/benign classification is able to achieve 66%
performance for within object anomaly detection. Overall, this performance
illustrates both the challenge and promise of object-wise anomaly detection
within the context of cluttered X-ray security imagery.
Authors' comments: IJCNN 2019
Cases have shown that WENO schemes usually behave robustly on problems
containing shocks with high pressure ratios when uniformed or smooth grids are
present, while nonlinear schemes based on WENO interpolations might relatively
be liable to numerical instability. In the meanwhile, the latter have
manifested their advantages in computations on grids of bad quality, because
the free-stream preservation is easily realized there, and what is more
flux-splitting schemes with low dissipations can be engaged inherently as well.
Targeting at above dissatisfactions, a method by hybridizing WENO
implementations of interpolation and reconstruction-wise operation for
upwind-biased schemes with flux splitting employed is proposed and
corresponding third-, fifth- and seventh-order upwind-biased schemes are
proposed. Based on the understandings of [Q. Li, et al. Commun. Comput. Phys.
22 (2017) 64-94], the free-stream preservation of proposed schemes is achieved
with incorporation of frozen grid metrics in WENO reconstructions-wise
operations on split fluxes. In proposed schemes, flux-splitting schemes with
low dissipation can also be applied for the flux on a cell edge. As a
byproduct, an implementation of WENO scheme with free-stream preservation is
obtained. Numerical examples are provided as following with the third- and
fifth-order schemes being tested. In tests of free-stream preservation, the
property is achieved as expected (including two implementations of WENO). The
computation of 1-D Sod problem shows the capability of proposed schemes on
solving ordinary shock discontinuity. 2-D vortex preservation and double Mach
reflection are tested on uniformed and randomized grids. The accomplishment by
proposed schemes manifests their capability and robustness on solving problems
under rigorous circumstances.
We present the results from a pilot study with the Karl G. Jansky Very Large
Array (JVLA) to determine the radio morphologies of extended radio sources and
the properties of their host-galaxies in 10 massive galaxy clusters at z~1, an
epoch in which clusters are assembling rapidly. These clusters are drawn from a
parent sample of WISE-selected galaxy clusters that were cross-correlated with
the VLA Faint Images of the Radio Sky at Twenty-Centimeters survey (FIRST) to
identify extended radio sources within 1$^{\prime}$ of the cluster centers. Out
of the ten targeted sources, six are FR II sources, one is an FR I source, and
three sources have undetermined morphologies. Eight radio sources have
associated Spitzer data, 75% presenting infrared counterparts. A majority of
these counterparts are consistent with being massive galaxies. The angular
extent of the FR sources exhibits a strong correlation with the cluster-centric
radius, which warrants further investigation with a larger sample.
Authors' comments: accepted to ApJ
We present a pixel-specific, measurement-driven correction that effectively
minimizes errors in detector response that give rise to the ring artifacts
commonly seen in X-ray computed tomography (CT) scans. This correction is easy
to implement, suppresses CT artifacts significantly, and is effective enough
for use with both absorption and phase contrast imaging. It can be used as a
standalone correction or in conjunction with existing ring artifact removal
algorithms to further improve image quality. We validate this method using two
X-ray CT data sets, showing post-correction signal-to-noise increases of up to
55%, and we define an image quality metric to use specifically for the
assessment of ring artifact suppression.
Authors' comments: 11 pages, 7 figures, and 1 ancillary file; questions and comments are
welcome
