Arman SavranSavran, Arman2025-10-062023979835030659010.1109/ASYU58738.2023.102967542-s2.0-85178262391https://www.scopus.com/inward/record.uri?eid=2-s2.0-85178262391&doi=10.1109%2FASYU58738.2023.10296754&partnerID=40&md5=947d732b1a1eb6c99546515ddb3a5ff0https://gcris.yasar.edu.tr/handle/123456789/8519https://doi.org/10.1109/ASYU58738.2023.10296754The use of visual signals to detect vocally active duration is quite helpful when there is severe acoustic noise or even can be the only option if the audio channel is missing. There has been significant progress in video-based voice activity detection (VAD). On the other hand while recently emerging event camera (EC) technology has demonstrated great benefits for applications in robotics drones autonomous vehicles and mobile devices including visual speech recognition topics it has not been explored to be used as a vision-only VAD front-end. In this work we propose an event intensity-based method by designing a fully convolutional network to efficiently realize an EC-VAD that segments vocally active duration. Efficiency is due to pooling the data over the mouth area reducing the dimensions by totally collapsing local spatial information as well as due to one-stage detection by a fully temporal convolutional network. Experimental evaluations show successful detection of voice activity with about 0.91 area under the receiver operating curve over a dataset including high speech content variability and different types of facial actions. © 2023 Elsevier B.V. All rights reserved.Englishinfo:eu-repo/semantics/closedAccessEvent Camera, Fully Convolutional Network, Lip Activity, Visual Speech, Voice Activity Detection, Acoustic Noise, Audio Acoustics, Convolution, Speech Recognition, Audio Channels, Autonomous Vehicles, Camera Technology, Convolutional Networks, Event Camera, Fully Convolutional Network, Lip Activity, Visual Signals, Visual Speech, Voice-activity Detections, CamerasAcoustic noise, Audio acoustics, Convolution, Speech recognition, Audio channels, Autonomous Vehicles, Camera technology, Convolutional networks, Event camera, Fully convolutional network, Lip activity, Visual signals, Visual speech, Voice-activity detections, CamerasEvent CameraVisual SpeechFully Convolutional NetworkLip ActivityVoice Activity DetectionConference Object