Multi-modal situational awareness platform