Object detection with multimodal inputs can improve many safety-critical systems such as autonomous vehicles (AVs). Motivated by AVs that operate in both day and night, we study object RGB thermal cameras, since the latter provides much stronger signatures under poor illumination. We explore strategies for fusing information from different modalities. Our key contribution is a probabilistic ens...

Common video-based object detectors exploit temporal contextual information to improve the performance of detection. However, detecting objects under challenging conditions has not been thoroughly studied yet. In this paper, we focus on improving detection for events such as aspect ratio change, occlusion, or large motion. To end, propose a video network using event-aware ConvLSTM and relation ...