Infrastructure vulnerability has drawn significant attention in recent years, partly because of the occurrence of low-probability and high-consequence disruptive events such as 2017 hurricanes Harvey, Irma, and Maria, 2011 Tuscaloosa and Joplin tornadoes, and 2015 Gorkha, Nepal, and 2017 Central Mexico earthquakes. Civil infrastructure systems support social welfare, thus viability and sustained operation is critical. A variety of frameworks, models, and tools exist for advancing infrastructure vulnerability research. Nevertheless, providing accurate vulnerability measurement remains challenging. This paper presents a state-of-the-art data collection and information extraction methodology to document infrastructure at high granularity to assess preevent vulnerability and postevent damage in the face of disasters. The methods establish a baseline of preevent infrastructure functionality that can be used to measure impacts and temporal recovery following a disaster. The Extreme Events Web Viewer (EEWV) presented as part of the methodology is a GIS-based web repository storing spatial and temporal data describing communities before and after disasters and facilitating data analysis techniques. This web platform can store multiple geolocated data formats including photographs and 360 degrees videos. A tool for automated extraction of photography from 360 degrees video data at locations of interest specified in the EEWV was created to streamline data utility. The extracted imagery provides a manageable data set to efficiently document characteristics of the built and natural environment. The methodology was tested to locate buildings vulnerable to flood and storm surge on Dauphin Island, Alabama. Approximately 1,950 buildings were passively documented with vehicle-mounted 360 degrees video. Extracted building images were used to train a deep learning neural network to predict whether a building was elevated or nonelevated. The model was validated, and methods for iterative neural network training are described. The methodology, from rapidly collecting large passive datasets, storing the data in an open repository, extracting manageable datasets, and obtaining information from data through deep learning, will facilitate vulnerability and postdisaster analyses as well as longitudinal recovery measurement.