It is common practice to decay the learning rate. Here we show one can usually obtain the same learning curve on both training and test sets by instead increasing the batch size during training. This procedure is successful for stochastic gradient descent (SGD), SGD with momentum, Nesterov momentum, and Adam. It reaches equivalent test accuracies after the same number of training epochs, but wi...

D D De e ep p pa a ar r rt t tm m me e en n nt t t O O Of f f C C Ch h he e em m mi i ic c ca a al l l E E En n ng g gi i in n ne e ee e er r ri i in n ng g g b b by y y T T To o ob b by y y M M Ma a ar r rs s sh h h S S Su u up p pe e er r rv v vi i is s so o or r r: : : D D Dr r r T T To o on n ny y y H H Ho o ow w we e es s s S S Su u ub b bm m mi i it t tt t te e ed d d: : : O O Oc c ct t t...

Abstract Sequencing batch reactor systems in wastewater treatment is widely applied activated sludge technology. The system performance not only dependent on the raw sewage quality and biochemical processes, but flow pattern within has a significant impact itself. varying stages of operation require different fluid conditions; biological stage shall be appropriately mixed, whereas low velocity ...

a r t i c l e i n f o Keywords: Marine snow Aggregates Biogeochemistry Density gradients Density interfaces Fluid dynamics Marine snow aggregates are often a dominant component of carbon flux and are sites of high bacterial activity; thus, small-scale changes in the settling behavior of marine snow can affect the vertical locations of carbon export and remineralization in the surface ocean. In ...

MOTIVATION Batch effects are due to probe-specific systematic variation between groups of samples (batches) resulting from experimental features that are not of biological interest. Principal component analysis (PCA) is commonly used as a visual tool to determine whether batch effects exist after applying a global normalization method. However, PCA yields linear combinations of the variables th...

Pelagic and demersal juvenile Baltic cod Gadus morhua L. were collected on the slope and the top of Rønne bank in the Baltic Sea during 2 cruises in November and December 1998. The growth, age at settling and vertical migration pattern were studied by otolith microstructure analysis. The relationship between fish and otolith size were found to change at settling, with an increase of fish size i...

many studies have considered the effects of suspension properties on the dewatering process but fewhave focused on ore properties. thus, the present work studied the effects of ore properties (density,particle size, mineralogy) on the dewatering process based on lab and pilot experiments. a hydrocyclonewas used to prepare the required samples for the experiments. to study the effects of mineral...

In this work, we investigate Batch Normalization technique and propose its probabilistic interpretation. We propose a probabilistic model and show that Batch Normalization maximazes the lower bound of its marginalized log-likelihood. Then, according to the new probabilistic model, we design an algorithm which acts consistently during train and test. However, inference becomes computationally in...

In many applications of black-box optimization, one can evaluate multiple points simultaneously, e.g. when evaluating the performances of several different neural network architectures in a parallel computing environment. In this paper, we develop a novel batch Bayesian optimization algorithm — the parallel knowledge gradient method. By construction, this method provides the one-step Bayes opti...