Recent advances in deep generative models have shown promising potential in
image inpanting, which refers to the task of predicting missing pixel values of
an incomplete image using the known context. However, existing methods can be
slow or generate unsatisfying results with easily detectable flaws. In
addition, there is often perceivable discontinuity near the holes and require
further post-processing to blend the results. We present a new approach to
address the difficulty of training a very deep generative model to synthesize
high-quality photo-realistic inpainting. Our model uses conditional generative
adversarial networks (conditional GANs) as the backbone, and we introduce a
novel block-wise procedural training scheme to stabilize the training while we
increase the network depth. We also propose a new strategy called adversarial
loss annealing to reduce the artifacts. We further describe several losses
specifically designed for inpainting and show their effectiveness. Extensive
experiments and user-study show that our approach outperforms existing methods
in several tasks such as inpainting, face completion and image harmonization.
Finally, we show our framework can be easily used as a tool for interactive
guided inpainting, demonstrating its practical value to solve common real-world
challenges.
We present the discovery of new star clusters in the central plane region
($|l|<30\deg$ and $|b|<6\deg$) of the Milky Way. In order to overcome the
extinction problem and the spatial limit of previous surveys, we use the
Wide-field Infrared Survey Explorer (WISE) data to find clusters. We also use
other infrared survey data in the archive for additional analysis. We find 923
new clusters, of which 202 clusters are embedded clusters. These clusters are
concentrated toward the Galactic plane and show a symmetric distribution with
respect to the Galactic latitude. The embedded clusters show a stronger
concentration to the Galactic plane than the non-embedded clusters. The new
clusters are found more in the first Galactic quadrant, while previously known
clusters are found more in the fourth Galactic quadrant. The spatial
distribution of the combined sample of known clusters and new clusters is
approximately symmetric with respect to the Galactic longitude. We estimate
reddenings, distances, and relative ages of the 15 class A clusters using
theoretical isochrones. Ten of them are relatively old (age $>800$ Myr) and
five are young (age $\approx4$ Myr).
Authors' comments: 29 pages, 16 figures, accepted to ApJ
Until recently, deep steganalyzers in spatial domain have been all designed
for gray-scale images. In this paper, we propose WISERNet (the wider
separate-then-reunion network) for steganalysis of color images. We provide
theoretical rationale to claim that the summation in normal convolution is one
sort of "linear collusion attack" which reserves strong correlated patterns
while impairs uncorrelated noises. Therefore in the bottom convolutional layer
which aims at suppressing correlated image contents, we adopt separate
channel-wise convolution without summation instead. Conversely, in the upper
convolutional layers we believe that the summation in normal convolution is
beneficial. Therefore we adopt united normal convolution in those layers and
make them remarkably wider to reinforce the effect of "linear collusion
attack". As a result, our proposed wide-and-shallow, separate-then-reunion
network structure is specifically suitable for color image steganalysis. We
have conducted extensive experiments on color image datasets generated from
BOSSBase raw images and another large-scale dataset which contains 100,000 raw
images, with different demosaicking algorithms and down-sampling algorithms.
The experimental results show that our proposed network outperforms other
state-of-the-art color image steganalytic models either hand-crafted or learned
using deep networks in the literature by a clear margin. Specifically, it is
noted that the detection performance gain is achieved with less than half the
complexity compared to the most advanced deep-learning steganalyzer as far as
we know, which is scarce in the literature.
Authors' comments: Accepted by IEEE IEEE Transactions on Information Forensics &
Security. DOI (identifier) 10.1109/TIFS.2019.2904413
Recently, Carnall et al. discovered two bright high redshift quasars using
the combination of the VST ATLAS and WISE surveys. The technique involved using
the 3-D colour plane i-z:z-W1:W1-W2 with the WISE W1 (3.4 micron) and W2 (4.5
micron) bands taking the place of the usual NIR J band to help decrease stellar
dwarf contamination. Here we report on our continued search for 5.7<z<6.4
quasars over an ~2x larger area of ~3577 sq. deg. of the Southern Hemisphere.
We have found two further z>6 quasars, VST-ATLAS J158.6938-14.4211 at z=6.07
and J332.8017-32.1036 at z=6.32 with magnitudes of z_AB=19.4 and 19.7 mag
respectively. J158.6938-14.4211 was confirmed by Keck LRIS observations and
J332.8017-32.1036 was confirmed by ESO NTT EFOSC-2 observations. Here we
present VLT X-shooter Visible and NIR spectra for the four ATLAS quasars. We
have further independently rediscovered two z>5.7 quasars previously found by
the VIKING/KiDS and PanSTARRS surveys. This means that in ATLAS we have now
discovered a total of six quasars in our target 5.7<z<6.4 redshift range.
Making approximate corrections for incompleteness, we find that our quasar
space density agrees with the SDSS results of Jiang et al. at M_1450A~-27mag.
Preliminary virial mass estimates based on the CIV and MIII emission lines give
black hole masses in the range M_BH~1-6x10e9 M_solar for the four ATLAS
quasars.
Authors' comments: 11 pages, 8 figures, 4 tables, accepted by MNRAS
We present the discovery of an extremely-luminous dust-obscured galaxy (DOG)
at $z_{\rm spec}$ = 3.703, WISE J101326.25+611220.1. This DOG is selected as a
candidate of extremely-luminous infrared (IR) galaxies based on the photometry
from the Sloan Digital Sky Survey and Wide-field Infrared Survey Explorer. In
order to derive its accurate IR luminosity, we perform follow-up observations
at 450 and 850 $\mu$m using the Submillimetre Common User Bolometer Array 2 on
the James Clerk Maxwell Telescope, and at 870 and 1300 $\mu$m using the
Submillimeter Array, which enable us to pin down its IR Spectral Energy
Distribution (SED). We perform SED fitting using 14 photometric data (0.4 -
1300 $\mu$m) and estimate its IR luminosity, $L_{\rm IR}$ (8-1000 $\mu$m), to
be $2.2^{+1.5}_{-1.0}$ $\times 10^{14}$ $L_{\odot}$, making it one of the most
luminous IR galaxies in the Universe. The energy contribution from an active
galactic nucleus (AGN) to the IR luminosity is $94^{+6}_{-20}$%, which
indicates it is an AGN-dominated DOG. On the other hand, its stellar mass
($M_*$) and star formation rate (SFR) are $\log \,(M_\ast/M_{\odot})$ =
$11.2^{+0.6}_{-0.2}$ and $\log \,({\rm SFR}/M_{\odot}\,{\rm yr}^{-1}$) =
$3.1^{+0.2}_{-0.1}$, respectively, which means that this DOG can be considered
as a starburst galaxy in $M_*$--SFR plane. This extremely-luminous DOG shows
significant AGN and star forming activity that provides us an important
laboratory to probe the maximum phase of the co-evolution of galaxies and
supermassive black holes.
Authors' comments: 10 pages, 6 figures, and 1 table, accepted for publication in ApJ
Stochastic gradient descent (SGD) has achieved great success in training deep
neural network, where the gradient is computed through back-propagation.
However, the back-propagated values of different layers vary dramatically. This
inconsistence of gradient magnitude across different layers renders
optimization of deep neural network with a single learning rate problematic. We
introduce the back-matching propagation which computes the backward values on
the layer's parameter and the input by matching backward values on the layer's
output. This leads to solving a bunch of least-squares problems, which requires
high computational cost. We then reduce the back-matching propagation with
approximations and propose an algorithm that turns to be the regular SGD with a
layer-wise adaptive learning rate strategy. This allows an easy implementation
of our algorithm in current machine learning frameworks equipped with
auto-differentiation. We apply our algorithm in training modern deep neural
networks and achieve favorable results over SGD.
Authors' comments: 12 pages, 3 figures
Many machine learning models, including those with non-smooth regularizers,
can be formulated as consensus optimization problems, which can be solved by
the alternating direction method of multipliers (ADMM). Many recent efforts
have been made to develop asynchronous distributed ADMM to handle large amounts
of training data. However, all existing asynchronous distributed ADMM methods
are based on full model updates and require locking all global model parameters
to handle concurrency, which essentially serializes the updates from different
workers. In this paper, we present a novel block-wise, asynchronous and
distributed ADMM algorithm, which allows different blocks of model parameters
to be updated in parallel. The lock-free block-wise algorithm may greatly
speedup sparse optimization problems, a common scenario in reality, in which
most model updates only modify a subset of all decision variables. We
theoretically prove the convergence of our proposed algorithm to stationary
points for non-convex general form consensus problems with possibly non-smooth
regularizers. We implement the proposed ADMM algorithm on the Parameter Server
framework and demonstrate its convergence and near-linear speedup performance
as the number of workers increases.
Photonic integrated circuits (PICs) directly written with a femtosecond laser
have shown great potential in many areas such as quantum information processing
(QIP). Many applications, like photon-based quantum computing, demand the
up-scaling of PICs and ever-higher optical performance, such as controllable
polarisation dependence and lower loss. In order to overcome current
limitations in fabrication precision, repeatability and material uniformity, a
solution for non-destructive testing of large-scale PICs in a component-wise
manner is desired to meet those ever-stricter demands. Here we demonstrate a
solution for non-destructive component-wise testing by predicting the
performance of a PIC component based on imaging with an adaptive optical
third-harmonic-generation (THG) three-dimensional (3D) microscope. The 3D THG
imaging can be performed on any component or part of it inside multi-component
PIC. Moreover, through discovering new phenomena we also demonstrated that 3D
THG microscopy provides a new pathway towards studying the fundamentals of
light-matter interaction in transparent materials.
Deep artificial neural networks (ANNs) can represent a wide range of complex
functions. Implementing ANNs in Von Neumann computing systems, though, incurs a
high energy cost due to the bottleneck created between CPU and memory.
Implementation on neuromorphic systems may help to reduce energy demand.
Conventional ANNs must be converted into equivalent Spiking Neural Networks
(SNNs) in order to be deployed on neuromorphic chips. This paper presents a way
to perform this translation. We map the ANN weights to SNN synapses
layer-by-layer by forming a least-square-error approximation problem at each
layer.
An optimal set of synapse weights may then be found for a given choice of ANN
activation function and SNN neuron. Using an appropriate constrained solver, we
can generate SNNs compatible with digital, analog, or hybrid chip
architectures. We present an optimal node pruning method to allow SNN layer
sizes to be set by the designer. To illustrate this process, we convert three
ANNs, including one convolutional network, to SNNs. In all three cases, a
simple linear program solver was used. The experiments show that the resulting
networks maintain agreement with the original ANN and excellent performance on
the evaluation tasks. The networks were also reduced in size with little loss
in task performance.
Authors' comments: Submitted to IEEE Symposium Series on Computational Intelligence
(SSCI) 2017
We consider the numerical simulation of the acoustic wave equations arising
from seismic applications, for which staggered grid finite difference methods
are popular choices due to their simplicity and efficiency. We relax the
uniform grid restriction on finite difference methods and allow the grids to be
block-wise uniform with nonconforming interfaces. In doing so, variations in
the wave speeds of the subterranean media can be accounted for more
efficiently. Staggered grid finite difference operators satisfying the
summation-by-parts (SBP) property are devised to approximate the spatial
derivatives appearing in the acoustic wave equation. These operators are
applied within each block independently. The coupling between blocks is
achieved through simultaneous approximation terms (SATs), which impose the
interface condition weakly, i.e., by penalty. Ratio of the grid spacing of
neighboring blocks is allowed to be rational number, for which specially
designed interpolation formulas are presented. These interpolation formulas
constitute key pieces of the simultaneous approximation terms. The overall
discretization is shown to be energy-conserving and examined on test cases of
both theoretical and practical interests, delivering accurate and stable
simulation results.
Modeling statistical regularity plays an essential role in ill-posed image
processing problems. Recently, deep learning based methods have been presented
to implicitly learn statistical representation of pixel distributions in
natural images and leverage it as a constraint to facilitate subsequent tasks,
such as color constancy and image dehazing. However, the existing CNN
architecture is prone to variability and diversity of pixel intensity within
and between local regions, which may result in inaccurate statistical
representation. To address this problem, this paper presents a novel fully
point-wise CNN architecture for modeling statistical regularities in natural
images. Specifically, we propose to randomly shuffle the pixels in the origin
images and leverage the shuffled image as input to make CNN more concerned with
the statistical properties. Moreover, since the pixels in the shuffled image
are independent identically distributed, we can replace all the large
convolution kernels in CNN with point-wise ($1*1$) convolution kernels while
maintaining the representation ability. Experimental results on two
applications: color constancy and image dehazing, demonstrate the superiority
of our proposed network over the existing architectures, i.e., using
1/10$\sim$1/100 network parameters and computational cost while achieving
comparable performance.
Authors' comments: 9 pages, 7 figures. To appear in ACM MM 2018
Despite the tremendous achievements of deep convolutional neural networks
(CNNs) in many computer vision tasks, understanding how they actually work
remains a significant challenge. In this paper, we propose a novel two-step
understanding method, namely Salient Relevance (SR) map, which aims to shed
light on how deep CNNs recognize images and learn features from areas, referred
to as attention areas, therein. Our proposed method starts out with a
layer-wise relevance propagation (LRP) step which estimates a pixel-wise
relevance map over the input image. Following, we construct a context-aware
saliency map, SR map, from the LRP-generated map which predicts areas close to
the foci of attention instead of isolated pixels that LRP reveals. In human
visual system, information of regions is more important than of pixels in
recognition. Consequently, our proposed approach closely simulates human
recognition. Experimental results using the ILSVRC2012 validation dataset in
conjunction with two well-established deep CNN models, AlexNet and VGG-16,
clearly demonstrate that our proposed approach concisely identifies not only
key pixels but also attention areas that contribute to the underlying neural
network's comprehension of the given images. As such, our proposed SR map
constitutes a convenient visual interface which unveils the visual attention of
the network and reveals which type of objects the model has learned to
recognize after training. The source code is available at
https://github.com/Hey1Li/Salient-Relevance-Propagation.
Authors' comments: 35 pages, 15 figures
Through the modelling of near-infrared photometry of star plus disk systems
with the codes BEDISK/BERAY, we successfully describe the WISE photometric
characteristics of Be stars in five young open clusters, NGC 663, NGC 869, NGC
884, NGC 3766 and NGC 4755, broadly studied in the literature. WISE photometry
allows previously known Be stars to be detected and to find new Be candidates
which could be confirmed spectroscopically. The location of Be stars in the
WISE colour-magnitude diagram, separates them in two groups; active (Be stars
hosting a developed circumstellar disk) and quiescent objects (Be stars in a
diskless phase), and this way, we can explore how often stars are observed in
these different stages. The variability observed in most active variable Be
stars is compatible with a disk dissipation phase. We find that 50 percent of
Be stars in the studied open clusters are in an active phase. We can interpret
this as Be stars having a developed circumstellar disk half of the time. The
location of Be stars with a developed disk in the CMD require mass loss rates
in agreement with values recently reported in the literature. For these
objects, we expect to have a tight relation between the equivalent width of the
H{\alpha} line and the mass of the disk, if the inclination is known. Also,
near-infrared photometry of Be stars in stellar clusters has the potential of
being useful to test whether there is a preferential viewing angle.
Authors' comments: 25 pages, 14 figures, Accepted for publication in AJ
The recent 'Planet Nine' hypothesis has led to many observational and
archival searches for this giant planet proposed to orbit the Sun at hundreds
of astronomical units. While trans-Neptunian object searches are typically
conducted in the optical, models suggest Planet Nine could be self-luminous and
potentially bright enough at ~3-5 microns to be detected by the Wide-field
Infrared Survey Explorer (WISE). We have previously demonstrated a Planet Nine
search methodology based on time-resolved WISE coadds, allowing us to detect
moving objects much fainter than would be possible using single-frame
extractions. In the present work, we extend our 3.4 micron (W1) search to cover
more than three quarters of the sky and incorporate four years of WISE
observations spanning a seven year time period. This represents the deepest and
widest-area WISE search for Planet Nine to date. We characterize the spatial
variation of our survey's sensitivity and rule out the presence of Planet Nine
in the parameter space searched at W1 < 16.7 in high Galactic latitude regions
(90% completeness).
Authors' comments: some edits based on referee report
We propose an extension of a special form of gradient descent -- in the
literature known as linearised Bregman iteration -- to a larger class of
non-convex functions. We replace the classical (squared) two norm metric in the
gradient descent setting with a generalised Bregman distance, based on a
proper, convex and lower semi-continuous function. The algorithm's global
convergence is proven for functions that satisfy the Kurdyka-\L ojasiewicz
property. Examples illustrate that features of different scale are being
introduced throughout the iteration, transitioning from coarse to fine. This
coarse-to-fine approach with respect to scale allows to recover solutions of
non-convex optimisation problems that are superior to those obtained with
conventional gradient descent, or even projected and proximal gradient descent.
The effectiveness of the linearised Bregman iteration in combination with early
stopping is illustrated for the applications of parallel magnetic resonance
imaging, blind deconvolution as well as image classification with neural
networks.
Authors' comments: 29 pages, 6 figures, journal submission
The outer Galaxy beyond the Outer Arm provides a good opportunity to study
star formation in an environment significantly different from that in the solar
neighborhood. However, star-forming regions in the outer Galaxy have never been
comprehensively studied or cataloged because of the difficulties in detecting
them at such large distances. We studied 33 known young star-forming regions
associated with 13 molecular clouds at $R_{\rm G}$ $\ge$ 13.5 kpc in the outer
Galaxy with data from the Wide-field Infrared Survey Explorer (WISE)
mid-infrared all-sky survey. From their color distribution, we developed a
simple identification criterion of star-forming regions in the outer Galaxy
with the WISE color. We applied the criterion to all the WISE sources in the
molecular clouds in the outer Galaxy at $R_{\rm G}$ $\ge$ 13.5 kpc detected
with the Five College Radio Astronomy Observatory (FCRAO) $^{12}$CO survey of
the outer Galaxy, of which the survey region is 102$^\circ$.49 $\le$ $l$ $\le$
141$^\circ$.54, $-$3$^\circ$.03 $\le$ $b$ $\le$ 5$^\circ$.41, and successfully
identified 711 new candidate star-forming regions in 240 molecular clouds. The
large number of samples enables us to perform the statistical study of
star-formation properties in the outer Galaxy for the first time. This study is
crucial to investigate the fundamental star-formation properties, including
star-formation rate, star-formation efficiency, and initial mass function, in a
primordial environment such as the early phase of the Galaxy formation.
Authors' comments: 54 pages, 16 figures, accepted for publication AJ
We identify 47,600 clusters of galaxies from photometric data of Two Micron
All Sky Survey (2MASS), Wide-field Infrared Survey Explorer (WISE), and
SuperCOSMOS, among which 26,125 clusters are recognized for the first time and
mostly in the sky outside the Sloan Digital Sky Survey (SDSS) area. About 90%
of massive clusters of M_{500}>3*10^{14} M_{\odot} in the redshift range of
0.025<z<0.3 have been detected from such survey data, and the detection rate
drops down to 50% for clusters with a mass of M_{500}~1*10^{14} M_{\odot}.
Monte Carlo simulations show that the false detection rate for the whole
cluster sample is less than 5%. By cross-matching with ROSAT and XMM-Newton
sources, we get 779 new X-ray cluster candidates which have X-ray counterparts
within a projected offset of 0.2 Mpc.
Authors' comments: 10 pages, 12 figures, 3 tables, updated to match the MNRAS version
Due to its excellent shock-capturing capability and high resolution, the WENO
scheme family has been widely used in varieties of compressive flow simulation.
However, for problems containing strong shocks and contact discontinuities,
such as the Lax shock tube problem, the WENO scheme still produces numerical
oscillations. To avoid such numerical oscillations, the characteristic-wise
construction method should be applied. Compared to component-wise
reconstruction, characteristic-wise reconstruction leads to much more
computational cost and thus is not suite for large scale simulation such as
direct numeric simulation of turbulence. In this paper, an adaptive
characteristic-wise reconstruction WENO scheme, i.e. the AdaWENO scheme, is
proposed to improve the computational efficiency of the characteristic-wise
reconstruction method. The new scheme performs characteristic-wise
reconstruction near discontinuities while switching to component-wise
reconstruction for smooth regions. Meanwhile, a new calculation strategy for
the WENO smoothness indicators is implemented to reduce over-all computational
cost. Several one dimensional and two dimensional numerical tests are performed
to validate and evaluate the AdaWENO scheme. Numerical results show that
AdaWENO maintains essentially non-oscillatory flow field near discontinuities
as the characteristic-wise reconstruction method. Besieds, compared to the
component-wise reconstruction, AdaWENO is about 40\% faster which indicates its
excellent efficiency.
Hot Dust-Obscured Galaxies (Hot DOGs) are hyperluminous
($L_{\mathrm{8-1000\,\mu m}}>10^{13}\,\mathrm{L_\odot}$) infrared galaxies with
extremely high (up to hundreds of K) dust temperatures. The sources powering
both their extremely high luminosities and dust temperatures are thought to be
deeply buried and rapidly accreting supermassive black holes (SMBHs). Hot DOGs
could therefore represent a key evolutionary phase in which the SMBH growth
peaks. X-ray observations can be used to study their obscuration levels and
luminosities. In this work, we present the X-ray properties of the 20
most-luminous ($L_{\mathrm{bol}}\gtrsim10^{14}\, L_\odot$) known Hot DOGs at
$z=2-4.6$. Five of them are covered by long-exposure ($10-70$ ks) Chandra and
XMM-Newton observations, with three being X-ray detected, and we study their
individual properties. One of these sources (W0116$-$0505) is a Compton-thick
candidate, with column density $N_H=(1.0-1.5)\times10^{24}\,\mathrm{cm^{-2}}$
derived from X-ray spectral fitting. The remaining 15 Hot DOGs have been
targeted by a Chandra snapshot (3.1 ks) survey. None of these 15 is
individually detected; therefore we applied a stacking analysis to investigate
their average emission. From hardness-ratio analysis, we constrained the
average obscuring column density and intrinsic luminosity to be
log$N_H\,\mathrm{[cm^{-2}]}>23.5$ and
$L_X\gtrsim10^{44}\,\mathrm{erg\,cm^{-2}\,s^{-1}}$, which are consistent with
results for individually detected sources. We also investigated the
$L_X-L_{6\mu\mathrm{m}}$ and $L_X-L_{bol}$ relations, finding hints that Hot
DOGs are typically X-ray weaker than expected, although larger samples of
luminous obscured QSOs are needed to derive solid conclusions.
Authors' comments: MNRAS, accepted 2017 November 29 . Received 2017 November 29 ; in
original form 2017 October 11. 15 pages, 6 figures
[not part of RNAAS note] We report the discovery of WISE J000100.45+065259.6
as a very low mass star/brown dwarf spectral binary candidate, on the basis of
low resolution near-infrared spectroscopy obtained with IRTF/SpeX.
Decomposition of the spectrum indicates component types of M8.5+T5 with a
predicted $\Delta{J}$ = 3.5. As the majority of confirmed spectral binary
candidates to date are very closely-separated systems ($\rho$ $\lesssim$ 3 AU;
$P$ $\lesssim$ 15~yr), this source may provide mass measurements across the
hydrogen burning limit within the decade.
Authors' comments: 3 pages, 1 figure, accepted to Research Notes of the AAS
