$\omega$-clones are multi-sorted structures that naturally emerge as algebras
for infinite trees, just as $\omega$-semigroups are convenient algebras for
infinite words. In the algebraic theory of languages, one hopes that a language
is regular if and only if it is recognized by an algebra that is finite in some
simple sense. We show that, for infinite trees, the situation is not so simple:
there exists an $\omega$-clone that is finite on every sort and finitely
generated, but recognizes a non-regular language.
We present a map of the three-dimensional (3D) distribution of dust in the
Orion complex. Orion is the closest site of high-mass star formation, making it
an excellent laboratory for studying the interstellar medium and star
formation. We use data from the Gaia-TGAS catalogue combined with photometry
from 2MASS and WISE to get the distances and extinctions of individual stars in
the vicinity of the Orion complex. We adopt the non-parametric method of Rezaei
Kh. et al. (2017) to infer the probability distribution function of the dust
densities at arbitrary points throughout the region. We map the dust
distribution towards different parts of the Orion complex and find the distance
and depth of the cloud compatible with other recent works which show the
ability of the method to be applicable on the local molecular clouds to map
their 3D dust distribution. We also demonstrate the danger of only using
colours of stars to derive their extinctions without considering further
physical constraints like the colour-magnitude diagram (CMD).
Authors' comments: Accepted for publication in A&A
In the present work, we consider a nonlinear inverse problem of identifying
the lowest coefficient of a parabolic equation. The desired coefficient depends
on spatial variables only. Additional information about the solution is given
at the final time moment, i.e., we consider the final redefinition. An
iterative process is used to evaluate the lowest coefficient, where at each
iteration we solve the standard initial-boundary value problem for the
parabolic equation. On the basis of the maximum principle for the solution of
the differential problem, the monotonicity of the iterative process is
established along with the fact that the coefficient approaches from above. The
possibilities of the proposed computational algorithm are illustrated by
numerical examples for a model two-dimensional problem.
Authors' comments: 15 pages, 6 figures
2524.
New Y and T dwarfs from WISE identified by Methane Imaging
C. G. Tinney, J. Davy Kirkpatrick, Jacqueline K. Faherty, Gregory N. Mace, Mike Cushing, Christopher R. Gelino, Adam J. Burgasser, Scott S. Sheppard et al.
We identify new Y- and T-type brown dwarfs from the WISE All Sky data release
using images obtained in filters that divide the traditional near-infrared H
and J bands into two halves -- specifically CH4s & CH4l in the H and J2 & J3 in
the J. This proves to be very effective at identifying cool brown dwarfs via
the detection of their methane absorption, as well as providing preliminary
classification using methane colours and WISE-to-near-infrared colours. New and
updated calibrations between T/Y spectral types and CH4s-CH4l, J3-W2, and
CH4s-W2 colours are derived, producing classification estimates good to a few
spectral sub-types. We present photometry for a large sample of T and Y dwarfs
in these filters, together with spectroscopy for 23 new ultra-cool dwarfs - two
Y dwarfs and twenty one T dwarfs. We identify a further 8 new cool brown
dwarfs, which we have high confidence are T dwarfs based on their methane
photometry. We find that, for objects observed on a 4m-class telescope at J
band magnitudes of ~20 or brighter, CH4s-CH4l is the more powerful colour for
detecting objects and then estimating spectral types. Due to the lower sky
background in the J-band, the J3 and J2 bands are more useful for identifying
fainter cool dwarfs at J>22. The J3-J2 colour is poor at estimating spectral
types. But fortunately, once J3-J2 confirms that an object is a cool dwarf, the
J3-W2 colour is very effective at estimating approximate spectral types.
Authors' comments: 29 pages, 6 figures. To appear in the Astrophysical Journal
Supplement
We say that n ideals of algebraic integers in a fixed number ring are k-wise
relatively r-prime if any k of them are relatively r-prime. In this article, we
provide an exact formula for the probability that n nonzero ideals of algebraic
integers in a fixed number ring are k-wise relatively r-prime.
Authors' comments: Final published version of the article
Recent advances in deep generative models have shown promising potential in
image inpanting, which refers to the task of predicting missing pixel values of
an incomplete image using the known context. However, existing methods can be
slow or generate unsatisfying results with easily detectable flaws. In
addition, there is often perceivable discontinuity near the holes and require
further post-processing to blend the results. We present a new approach to
address the difficulty of training a very deep generative model to synthesize
high-quality photo-realistic inpainting. Our model uses conditional generative
adversarial networks (conditional GANs) as the backbone, and we introduce a
novel block-wise procedural training scheme to stabilize the training while we
increase the network depth. We also propose a new strategy called adversarial
loss annealing to reduce the artifacts. We further describe several losses
specifically designed for inpainting and show their effectiveness. Extensive
experiments and user-study show that our approach outperforms existing methods
in several tasks such as inpainting, face completion and image harmonization.
Finally, we show our framework can be easily used as a tool for interactive
guided inpainting, demonstrating its practical value to solve common real-world
challenges.
We present the discovery of new star clusters in the central plane region
($|l|<30\deg$ and $|b|<6\deg$) of the Milky Way. In order to overcome the
extinction problem and the spatial limit of previous surveys, we use the
Wide-field Infrared Survey Explorer (WISE) data to find clusters. We also use
other infrared survey data in the archive for additional analysis. We find 923
new clusters, of which 202 clusters are embedded clusters. These clusters are
concentrated toward the Galactic plane and show a symmetric distribution with
respect to the Galactic latitude. The embedded clusters show a stronger
concentration to the Galactic plane than the non-embedded clusters. The new
clusters are found more in the first Galactic quadrant, while previously known
clusters are found more in the fourth Galactic quadrant. The spatial
distribution of the combined sample of known clusters and new clusters is
approximately symmetric with respect to the Galactic longitude. We estimate
reddenings, distances, and relative ages of the 15 class A clusters using
theoretical isochrones. Ten of them are relatively old (age $>800$ Myr) and
five are young (age $\approx4$ Myr).
Authors' comments: 29 pages, 16 figures, accepted to ApJ
Until recently, deep steganalyzers in spatial domain have been all designed
for gray-scale images. In this paper, we propose WISERNet (the wider
separate-then-reunion network) for steganalysis of color images. We provide
theoretical rationale to claim that the summation in normal convolution is one
sort of "linear collusion attack" which reserves strong correlated patterns
while impairs uncorrelated noises. Therefore in the bottom convolutional layer
which aims at suppressing correlated image contents, we adopt separate
channel-wise convolution without summation instead. Conversely, in the upper
convolutional layers we believe that the summation in normal convolution is
beneficial. Therefore we adopt united normal convolution in those layers and
make them remarkably wider to reinforce the effect of "linear collusion
attack". As a result, our proposed wide-and-shallow, separate-then-reunion
network structure is specifically suitable for color image steganalysis. We
have conducted extensive experiments on color image datasets generated from
BOSSBase raw images and another large-scale dataset which contains 100,000 raw
images, with different demosaicking algorithms and down-sampling algorithms.
The experimental results show that our proposed network outperforms other
state-of-the-art color image steganalytic models either hand-crafted or learned
using deep networks in the literature by a clear margin. Specifically, it is
noted that the detection performance gain is achieved with less than half the
complexity compared to the most advanced deep-learning steganalyzer as far as
we know, which is scarce in the literature.
Authors' comments: Accepted by IEEE IEEE Transactions on Information Forensics &
Security. DOI (identifier) 10.1109/TIFS.2019.2904413
Recently, Carnall et al. discovered two bright high redshift quasars using
the combination of the VST ATLAS and WISE surveys. The technique involved using
the 3-D colour plane i-z:z-W1:W1-W2 with the WISE W1 (3.4 micron) and W2 (4.5
micron) bands taking the place of the usual NIR J band to help decrease stellar
dwarf contamination. Here we report on our continued search for 5.7<z<6.4
quasars over an ~2x larger area of ~3577 sq. deg. of the Southern Hemisphere.
We have found two further z>6 quasars, VST-ATLAS J158.6938-14.4211 at z=6.07
and J332.8017-32.1036 at z=6.32 with magnitudes of z_AB=19.4 and 19.7 mag
respectively. J158.6938-14.4211 was confirmed by Keck LRIS observations and
J332.8017-32.1036 was confirmed by ESO NTT EFOSC-2 observations. Here we
present VLT X-shooter Visible and NIR spectra for the four ATLAS quasars. We
have further independently rediscovered two z>5.7 quasars previously found by
the VIKING/KiDS and PanSTARRS surveys. This means that in ATLAS we have now
discovered a total of six quasars in our target 5.7<z<6.4 redshift range.
Making approximate corrections for incompleteness, we find that our quasar
space density agrees with the SDSS results of Jiang et al. at M_1450A~-27mag.
Preliminary virial mass estimates based on the CIV and MIII emission lines give
black hole masses in the range M_BH~1-6x10e9 M_solar for the four ATLAS
quasars.
Authors' comments: 11 pages, 8 figures, 4 tables, accepted by MNRAS
We present the discovery of an extremely-luminous dust-obscured galaxy (DOG)
at $z_{\rm spec}$ = 3.703, WISE J101326.25+611220.1. This DOG is selected as a
candidate of extremely-luminous infrared (IR) galaxies based on the photometry
from the Sloan Digital Sky Survey and Wide-field Infrared Survey Explorer. In
order to derive its accurate IR luminosity, we perform follow-up observations
at 450 and 850 $\mu$m using the Submillimetre Common User Bolometer Array 2 on
the James Clerk Maxwell Telescope, and at 870 and 1300 $\mu$m using the
Submillimeter Array, which enable us to pin down its IR Spectral Energy
Distribution (SED). We perform SED fitting using 14 photometric data (0.4 -
1300 $\mu$m) and estimate its IR luminosity, $L_{\rm IR}$ (8-1000 $\mu$m), to
be $2.2^{+1.5}_{-1.0}$ $\times 10^{14}$ $L_{\odot}$, making it one of the most
luminous IR galaxies in the Universe. The energy contribution from an active
galactic nucleus (AGN) to the IR luminosity is $94^{+6}_{-20}$%, which
indicates it is an AGN-dominated DOG. On the other hand, its stellar mass
($M_*$) and star formation rate (SFR) are $\log \,(M_\ast/M_{\odot})$ =
$11.2^{+0.6}_{-0.2}$ and $\log \,({\rm SFR}/M_{\odot}\,{\rm yr}^{-1}$) =
$3.1^{+0.2}_{-0.1}$, respectively, which means that this DOG can be considered
as a starburst galaxy in $M_*$--SFR plane. This extremely-luminous DOG shows
significant AGN and star forming activity that provides us an important
laboratory to probe the maximum phase of the co-evolution of galaxies and
supermassive black holes.
Authors' comments: 10 pages, 6 figures, and 1 table, accepted for publication in ApJ
Stochastic gradient descent (SGD) has achieved great success in training deep
neural network, where the gradient is computed through back-propagation.
However, the back-propagated values of different layers vary dramatically. This
inconsistence of gradient magnitude across different layers renders
optimization of deep neural network with a single learning rate problematic. We
introduce the back-matching propagation which computes the backward values on
the layer's parameter and the input by matching backward values on the layer's
output. This leads to solving a bunch of least-squares problems, which requires
high computational cost. We then reduce the back-matching propagation with
approximations and propose an algorithm that turns to be the regular SGD with a
layer-wise adaptive learning rate strategy. This allows an easy implementation
of our algorithm in current machine learning frameworks equipped with
auto-differentiation. We apply our algorithm in training modern deep neural
networks and achieve favorable results over SGD.
Authors' comments: 12 pages, 3 figures
Many machine learning models, including those with non-smooth regularizers,
can be formulated as consensus optimization problems, which can be solved by
the alternating direction method of multipliers (ADMM). Many recent efforts
have been made to develop asynchronous distributed ADMM to handle large amounts
of training data. However, all existing asynchronous distributed ADMM methods
are based on full model updates and require locking all global model parameters
to handle concurrency, which essentially serializes the updates from different
workers. In this paper, we present a novel block-wise, asynchronous and
distributed ADMM algorithm, which allows different blocks of model parameters
to be updated in parallel. The lock-free block-wise algorithm may greatly
speedup sparse optimization problems, a common scenario in reality, in which
most model updates only modify a subset of all decision variables. We
theoretically prove the convergence of our proposed algorithm to stationary
points for non-convex general form consensus problems with possibly non-smooth
regularizers. We implement the proposed ADMM algorithm on the Parameter Server
framework and demonstrate its convergence and near-linear speedup performance
as the number of workers increases.
Photonic integrated circuits (PICs) directly written with a femtosecond laser
have shown great potential in many areas such as quantum information processing
(QIP). Many applications, like photon-based quantum computing, demand the
up-scaling of PICs and ever-higher optical performance, such as controllable
polarisation dependence and lower loss. In order to overcome current
limitations in fabrication precision, repeatability and material uniformity, a
solution for non-destructive testing of large-scale PICs in a component-wise
manner is desired to meet those ever-stricter demands. Here we demonstrate a
solution for non-destructive component-wise testing by predicting the
performance of a PIC component based on imaging with an adaptive optical
third-harmonic-generation (THG) three-dimensional (3D) microscope. The 3D THG
imaging can be performed on any component or part of it inside multi-component
PIC. Moreover, through discovering new phenomena we also demonstrated that 3D
THG microscopy provides a new pathway towards studying the fundamentals of
light-matter interaction in transparent materials.
Deep artificial neural networks (ANNs) can represent a wide range of complex
functions. Implementing ANNs in Von Neumann computing systems, though, incurs a
high energy cost due to the bottleneck created between CPU and memory.
Implementation on neuromorphic systems may help to reduce energy demand.
Conventional ANNs must be converted into equivalent Spiking Neural Networks
(SNNs) in order to be deployed on neuromorphic chips. This paper presents a way
to perform this translation. We map the ANN weights to SNN synapses
layer-by-layer by forming a least-square-error approximation problem at each
layer.
An optimal set of synapse weights may then be found for a given choice of ANN
activation function and SNN neuron. Using an appropriate constrained solver, we
can generate SNNs compatible with digital, analog, or hybrid chip
architectures. We present an optimal node pruning method to allow SNN layer
sizes to be set by the designer. To illustrate this process, we convert three
ANNs, including one convolutional network, to SNNs. In all three cases, a
simple linear program solver was used. The experiments show that the resulting
networks maintain agreement with the original ANN and excellent performance on
the evaluation tasks. The networks were also reduced in size with little loss
in task performance.
Authors' comments: Submitted to IEEE Symposium Series on Computational Intelligence
(SSCI) 2017
We consider the numerical simulation of the acoustic wave equations arising
from seismic applications, for which staggered grid finite difference methods
are popular choices due to their simplicity and efficiency. We relax the
uniform grid restriction on finite difference methods and allow the grids to be
block-wise uniform with nonconforming interfaces. In doing so, variations in
the wave speeds of the subterranean media can be accounted for more
efficiently. Staggered grid finite difference operators satisfying the
summation-by-parts (SBP) property are devised to approximate the spatial
derivatives appearing in the acoustic wave equation. These operators are
applied within each block independently. The coupling between blocks is
achieved through simultaneous approximation terms (SATs), which impose the
interface condition weakly, i.e., by penalty. Ratio of the grid spacing of
neighboring blocks is allowed to be rational number, for which specially
designed interpolation formulas are presented. These interpolation formulas
constitute key pieces of the simultaneous approximation terms. The overall
discretization is shown to be energy-conserving and examined on test cases of
both theoretical and practical interests, delivering accurate and stable
simulation results.
Modeling statistical regularity plays an essential role in ill-posed image
processing problems. Recently, deep learning based methods have been presented
to implicitly learn statistical representation of pixel distributions in
natural images and leverage it as a constraint to facilitate subsequent tasks,
such as color constancy and image dehazing. However, the existing CNN
architecture is prone to variability and diversity of pixel intensity within
and between local regions, which may result in inaccurate statistical
representation. To address this problem, this paper presents a novel fully
point-wise CNN architecture for modeling statistical regularities in natural
images. Specifically, we propose to randomly shuffle the pixels in the origin
images and leverage the shuffled image as input to make CNN more concerned with
the statistical properties. Moreover, since the pixels in the shuffled image
are independent identically distributed, we can replace all the large
convolution kernels in CNN with point-wise ($1*1$) convolution kernels while
maintaining the representation ability. Experimental results on two
applications: color constancy and image dehazing, demonstrate the superiority
of our proposed network over the existing architectures, i.e., using
1/10$\sim$1/100 network parameters and computational cost while achieving
comparable performance.
Authors' comments: 9 pages, 7 figures. To appear in ACM MM 2018
Despite the tremendous achievements of deep convolutional neural networks
(CNNs) in many computer vision tasks, understanding how they actually work
remains a significant challenge. In this paper, we propose a novel two-step
understanding method, namely Salient Relevance (SR) map, which aims to shed
light on how deep CNNs recognize images and learn features from areas, referred
to as attention areas, therein. Our proposed method starts out with a
layer-wise relevance propagation (LRP) step which estimates a pixel-wise
relevance map over the input image. Following, we construct a context-aware
saliency map, SR map, from the LRP-generated map which predicts areas close to
the foci of attention instead of isolated pixels that LRP reveals. In human
visual system, information of regions is more important than of pixels in
recognition. Consequently, our proposed approach closely simulates human
recognition. Experimental results using the ILSVRC2012 validation dataset in
conjunction with two well-established deep CNN models, AlexNet and VGG-16,
clearly demonstrate that our proposed approach concisely identifies not only
key pixels but also attention areas that contribute to the underlying neural
network's comprehension of the given images. As such, our proposed SR map
constitutes a convenient visual interface which unveils the visual attention of
the network and reveals which type of objects the model has learned to
recognize after training. The source code is available at
https://github.com/Hey1Li/Salient-Relevance-Propagation.
Authors' comments: 35 pages, 15 figures
Through the modelling of near-infrared photometry of star plus disk systems
with the codes BEDISK/BERAY, we successfully describe the WISE photometric
characteristics of Be stars in five young open clusters, NGC 663, NGC 869, NGC
884, NGC 3766 and NGC 4755, broadly studied in the literature. WISE photometry
allows previously known Be stars to be detected and to find new Be candidates
which could be confirmed spectroscopically. The location of Be stars in the
WISE colour-magnitude diagram, separates them in two groups; active (Be stars
hosting a developed circumstellar disk) and quiescent objects (Be stars in a
diskless phase), and this way, we can explore how often stars are observed in
these different stages. The variability observed in most active variable Be
stars is compatible with a disk dissipation phase. We find that 50 percent of
Be stars in the studied open clusters are in an active phase. We can interpret
this as Be stars having a developed circumstellar disk half of the time. The
location of Be stars with a developed disk in the CMD require mass loss rates
in agreement with values recently reported in the literature. For these
objects, we expect to have a tight relation between the equivalent width of the
H{\alpha} line and the mass of the disk, if the inclination is known. Also,
near-infrared photometry of Be stars in stellar clusters has the potential of
being useful to test whether there is a preferential viewing angle.
Authors' comments: 25 pages, 14 figures, Accepted for publication in AJ
The recent 'Planet Nine' hypothesis has led to many observational and
archival searches for this giant planet proposed to orbit the Sun at hundreds
of astronomical units. While trans-Neptunian object searches are typically
conducted in the optical, models suggest Planet Nine could be self-luminous and
potentially bright enough at ~3-5 microns to be detected by the Wide-field
Infrared Survey Explorer (WISE). We have previously demonstrated a Planet Nine
search methodology based on time-resolved WISE coadds, allowing us to detect
moving objects much fainter than would be possible using single-frame
extractions. In the present work, we extend our 3.4 micron (W1) search to cover
more than three quarters of the sky and incorporate four years of WISE
observations spanning a seven year time period. This represents the deepest and
widest-area WISE search for Planet Nine to date. We characterize the spatial
variation of our survey's sensitivity and rule out the presence of Planet Nine
in the parameter space searched at W1 < 16.7 in high Galactic latitude regions
(90% completeness).
Authors' comments: some edits based on referee report
We propose an extension of a special form of gradient descent -- in the
literature known as linearised Bregman iteration -- to a larger class of
non-convex functions. We replace the classical (squared) two norm metric in the
gradient descent setting with a generalised Bregman distance, based on a
proper, convex and lower semi-continuous function. The algorithm's global
convergence is proven for functions that satisfy the Kurdyka-\L ojasiewicz
property. Examples illustrate that features of different scale are being
introduced throughout the iteration, transitioning from coarse to fine. This
coarse-to-fine approach with respect to scale allows to recover solutions of
non-convex optimisation problems that are superior to those obtained with
conventional gradient descent, or even projected and proximal gradient descent.
The effectiveness of the linearised Bregman iteration in combination with early
stopping is illustrated for the applications of parallel magnetic resonance
imaging, blind deconvolution as well as image classification with neural
networks.
Authors' comments: 29 pages, 6 figures, journal submission
