awesome-diarization

Awesome Speaker Diarization

Table of contents

• Overview
• Software
  • Framework
  • Evaluation
  • Clustering
  • Speaker embedding
  • Speaker change detection
  • Audio feature extraction
  • Audio data augmentation
  • Other software
• Datasets
  • Diarization datasets
  • Speaker embedding training sets
  • Augmentation noise sources
• Conferences
• Products
• Publications
  • Special topics
    • Review and survey papers
    • Large language model (LLM)
    • Supervised diarization
    • Joint diarization and ASR
    • Online speaker diarization
    • Challenges
    • Audio-Visual Speaker Diarization
  • Other (2026 · 2025 · 2024 · 2023 · 2022 · 2021 · 2020 · 2019 · 2018 · 2017 · 2016 · 2015 · 2014 · 2013 · 2011 · 2009 · 2008 · 2006)
• Other learning materials
  • Online courses
  • Books
  • Tech blogs
  • Video tutorials
• Star History

Overview

This is a curated list of awesome Speaker Diarization papers, libraries, datasets, and other resources.

The purpose of this repo is to organize the world’s resources for speaker diarization, and make them universally accessible and useful.

To add items to this page, simply send a pull request. (contributing guide)

Software

Framework

Link	Language	Description
FunASR	Python & PyTorch	Industrial-grade speech recognition toolkit with built-in speaker diarization (cam++), VAD, ASR (SenseVoice/Paraformer), and punctuation. 50+ languages, 170x realtime.
NVIDIA NeMo Speech	Python & PyTorch	Scalable generative AI and speech toolkit featuring end-to-end and modular speaker diarization (Sortformer, MSDD, TitaNet speaker embeddings, MarbleNet VAD, and joint ASR-diarization pipelines).
WhisperX	Python & PyTorch	Fast automatic speech recognition with word-level timestamps (phoneme forced alignment) and speaker diarization via pyannote-audio.
ESPnet	Python & PyTorch	End-to-end speech processing toolkit including neural speaker diarization (EEND, EEND-EDA) and joint speech enhancement/separation and diarization recipes.
3D-Speaker	Python & PyTorch & C++	Open-source toolkit for single- and multi-modal (audio-visual) speaker verification, recognition, and speaker diarization (CAM++, ERes2Net, overlap detection, and ONNX runtime).
MiniVox	MATLAB	MiniVox is an open-source evaluation system for the online speaker diarization task.
SpeechBrain	Python & PyTorch	SpeechBrain is an open-source and all-in-one speech toolkit based on PyTorch.
SIDEKIT for diarization (s4d)	Python	An open-source package extension of SIDEKIT for speaker diarization (source).
pyAudioAnalysis	Python	Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications.
AaltoASR	Python & Perl	Speaker diarization scripts, based on AaltoASR.
LIUM SpkDiarization	Java	LIUM_SpkDiarization is software dedicated to speaker diarization (i.e. speaker segmentation and clustering). It is written in Java, and includes developments in the domain (as of 2013).
kaldi-asr	Bash	Example scripts for speaker diarization on a portion of CALLHOME used in the 2000 NIST speaker recognition evaluation.
kaldi-speaker-diarization	Bash	Icelandic speaker diarization scripts using kaldi.
Alize LIA_SpkSeg	C++	ALIZÉ is an open-source platform for speaker recognition; LIA_SpkSeg provides the tools for speaker diarization.
pyannote-audio	Python & PyTorch	Neural building blocks for speaker diarization: speech activity detection, speaker change detection, speaker embedding.
pyBK	Python	Speaker diarization using binary key speaker modelling. Computationally light solution that does not require external training data.
Speaker-Diarization	Python	Speaker diarization using uis-rnn and GhostVLAD. An easier way to support openset speakers.
EEND	Python & Bash & Perl	End-to-End Neural Diarization.
VBx	Python	Variational Bayes HMM over x-vectors diarization. x-vector extractor recipe
RE-VERB	Python & JavaScript	RE: VERB is speaker diarization system, it allows the user to send/record audio of a conversation and receive timestamps of who spoke when.
diart	Python & PyTorch	Real-time/streaming speaker diarization extending pyannote.audio to online processing (formerly StreamingSpeakerDiarization).
simple_diarizer	Python	Simplified diarization pipeline using pretrained models. Made to be as simple as possible to go from an input audio file to diarized segments.
Picovoice Falcon	C & Python	A lightweight, accurate, and fast speaker diarization engine written in C and available in Python, running on CPU with minimal overhead.
DiaPer	Python & PyTorch	PyTorch implementation for DiaPer: End-to-End Neural Diarization with Perceiver-Based Attractors including models pre-trained on free and public data.
sherpa-onnx	C++ & C & C# & Dart & Go & Java & JavaScript & Kotlin & Pascal & Python & Rust & Swift	Supports speaker diarization, speech recognition, and text-to-speech on various platforms with various language bindings.
FluidAudio	Swift	A native Swift speaker diarization library for Apple platforms, using CoreML for efficient, real-time audio processing with high accuracy.
speakrs	Rust & Python	Rust implementation of the pyannote community-1 diarization pipeline (segmentation, embedding, PLDA, VBx clustering) with native CPU, CUDA, and CoreML backends. 7.0% DER on VoxConverse dev at 1912x realtime on an RTX 4090.
diarizers	Python & PyTorch	Unified pipeline for ASR, standalone speaker diarization (neural segmentation, ECAPA-TDNN speaker embeddings, spectral clustering), and DiarizationLM post-processing, with an interactive Hugging Face Space.

Evaluation

Link	Language	Description
pyannote-metrics	Python	A toolkit for reproducible evaluation, diagnostic, and error analysis of speaker diarization systems.
SimpleDER	Python	A lightweight library to compute Diarization Error Rate (DER), Jaccard Error Rate (JER), and Word Diarization Error Rate (WDER).
DiarizationLM	Python	Implements Word Error Rate (WER), Word Diarization Error Rate (WDER), and concatenated minimum-permutation Word Error Rate (cpWER).
NIST md-eval	Perl	(1) md-eval-v21.pl from jitendra; (2) md-eval-22.pl from nryant
dscore	Python & Perl	Diarization scoring tools.
Sequence Match Accuracy	Python	Match the accuracy of two sequences with Hungarian algorithm.
spyder	Python & C++	Simple Python package for fast DER computation.
CDER	Python	Conversational DER from The Conversational Short-phrase Speaker Diarization (CSSD) Task: Dataset, Evaluation Metric and Baselines
Selective Collar	Python	Selective collar for mitigating evaluation bias in speaker diarization from Beyond Uniform Forgiveness: Introducing the Selective Collar to Mitigate Evaluation Bias in Speaker Diarization

Clustering

Link	Language	Description
uis-rnn	Python & PyTorch	Google's Unbounded Interleaved-State Recurrent Neural Network (UIS-RNN) algorithm, for Fully Supervised Speaker Diarization. This clustering algorithm is supervised.
uis-rnn-sml	Python & PyTorch	A variant of UIS-RNN, for the paper Supervised Online Diarization with Sample Mean Loss for Multi-Domain Data.
DNC	Python & ESPnet	Transformer-based Discriminative Neural Clustering (DNC) for Speaker Diarisation. Like UIS-RNN, it is supervised.
SpectralCluster	Python	Spectral clustering with affinity matrix refinement operations, auto-tune, and speaker turn constraints.
sklearn.cluster	Python	scikit-learn clustering algorithms.
PLDA	Python	Probabilistic Linear Discriminant Analysis & classification, written in Python.
PLDA	C++	Open-source implementation of simplified PLDA (Probabilistic Linear Discriminant Analysis).
Auto-Tuning Spectral Clustering	Python	Auto-tuning Spectral Clustering method that does not need development set or supervised tuning.

Speaker embedding

Link	Method	Language	Description
resemble-ai/Resemblyzer	d-vector	Python & PyTorch	PyTorch implementation of generalized end-to-end loss for speaker verification, which can be used for voice cloning and diarization.
Speaker_Verification	d-vector	Python & TensorFlow	TensorFlow implementation of generalized end-to-end loss for speaker verification.
PyTorch_Speaker_Verification	d-vector	Python & PyTorch	PyTorch implementation of "Generalized End-to-End Loss for Speaker Verification" by Wan, Li et al. With UIS-RNN integration.
Real-Time Voice Cloning	d-vector	Python & PyTorch	Implementation of "Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis" (SV2TTS) with a vocoder that works in real-time.
conformer-speaker-encoder	d-vector	Python & TFLite	Massively multilingual conformer-based speaker recognition models in TFLite format.
deep-speaker	d-vector	Python & Keras	Third party implementation of the Baidu paper Deep Speaker: an End-to-End Neural Speaker Embedding System.
x-vector-kaldi-tf	x-vector	Python & TensorFlow & Perl	TensorFlow implementation of x-vector topology on top of Kaldi recipe.
kaldi-ivector	i-vector	C++ & Perl	Extension to Kaldi implementing the standard i-vector hyperparameter estimation and i-vector extraction procedure.
voxceleb-ivector	i-vector	Perl	Voxceleb1 i-vector based speaker recognition system.
pytorch_xvectors	x-vector	Python & PyTorch	PyTorch implementation of Voxceleb x-vectors. Additionally, includes meta-learning architectures for embedding training. Evaluated with speaker diarization and speaker verification.
ASVtorch	i-vector	Python & PyTorch	ASVtorch is a toolkit for automatic speaker recognition.
asv-subtools	i-vector & x-vector	Kaldi & PyTorch	ASV-Subtools is developed based on PyTorch and Kaldi for the task of speaker recognition, language identification, etc. The 'sub' of 'subtools' means that there are many modular tools and the parts constitute the whole.
WeSpeaker	x-vector & r-vector	Python & C++ & PyTorch	WeSpeaker is a research and production oriented speaker verification, recognition and diarization toolkit, which supports very strong recipes with on-the-fly data preparation, model training and evaluation, as well as runtime C++ codes.
ReDimNet	improved resnet	Python & PyTorch	Neural network architecture presented in the paper Reshape Dimensions Network for Speaker Recognition

Speaker change detection

Link	Language	Description
change_detection	Python & Keras	Code for Speaker Change Detection in Broadcast TV using Bidirectional Long Short-Term Memory Networks.
tinydiarize	Python & PyTorch	Diarization inside OpenAI Whisper decoder

Audio feature extraction

Link	Language	Description
LibROSA	Python	Python library for audio and music analysis. https://librosa.github.io/
python_speech_features	Python	This library provides common speech features for ASR including MFCCs and filterbank energies. https://python-speech-features.readthedocs.io/en/latest/
pyAudioAnalysis	Python	Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications.

Audio data augmentation

Link	Language	Description
pyroomacoustics	Python	Pyroomacoustics is a package for audio signal processing for indoor applications. It was developed as a fast prototyping platform for beamforming algorithms in indoor scenarios. https://pyroomacoustics.readthedocs.io
gpuRIR	Python	Python library for Room Impulse Response (RIR) simulation with GPU acceleration
rir_simulator_python	Python	Room impulse response simulator using python
WavAugment	Python & PyTorch	WavAugment performs data augmentation on audio data. The audio data is represented as PyTorch tensors.
EEND_dataprep	Bash & Python	Recipes for generating simulated conversations used to train end-to-end diarization models.

Other software

Link	Language	Description
VB Diarization	Python	VB Diarization with Eigenvoice and HMM Priors.
DOVER-Lap	Python	Python package for combining diarization system outputs
Diar-az	Bash & Python	Data formatting tool to support the ruv-di dataset. Kaldi to Gecko to Kaldi and corpus and back.
voxsolo	Python	Verbatim per-speaker audio from diarization: keeps one speaker bit-exact, silences other speakers and overlapped speech; exports EDL/SRT/VTT/Audacity labels for editors.
VoxLock	Python	Streaming target speaker extraction: keeps one speaker's voice and removes the other voices in the room before speech recognition. 27M parameters, 24 ms algorithmic latency on CPU, ONNX and safetensors weights.
OATS	Rust & TypeScript	Open-source macOS app for meeting transcription and notes with speaker diarization (FluidAudio) and optional fully offline mode.
akou	TypeScript & Rust	Open-source macOS app that records calls and meetings and transcribes them on-device, with speaker labels from NVIDIA Nemotron 3 Diarization.
Local Transcriber	Python & Swift	macOS menu bar app that records calls and meetings and transcribes them on-device (Whisper large-v3-turbo on MLX), with pyannote diarization per audio track and a voice database that recognizes known speakers.

Datasets

Diarization datasets

Audio	Diarization ground truth	Language	Pricing	Additional information
2000 NIST Speaker Recognition Evaluation	Disk-6 (Switchboard), Disk-8 (CALLHOME)	Multiple	$500.00	Evaluation Plan
2003 NIST Rich Transcription Evaluation Data	Together with audios	en, ar, zh	$2000.00	Telephone speech, broadcast news.
CALLHOME American English Speech	CALLHOME American English Transcripts	en	$1500.00 + $1000.00	CH109 whitelist
The ICSI Meeting Corpus	Together with audios	en	Free	~72 hours (75 meetings). License (CC BY 4.0)
The AMI Meeting Corpus	Together with audios (need to be processed; see ami-diarization-setup)	en	Free	100 hours of multi-accent English meetings. License (CC BY 4.0)
Fisher English Training Speech Part 1 Speech	Fisher English Training Speech Part 1 Transcripts	en	$7000.00 + $1000.00	Conversational telephone speech (5,850 calls, ~975 hours).
Fisher English Training Part 2, Speech	Fisher English Training Part 2, Transcripts	en	$7000.00 + $1000.00	Conversational telephone speech (5,849 calls, ~975 hours).
DIHARD III (Eval)	Together with audios	en, zh	$300.00 + $300.00	68.15 hours (34.15h dev + 34.00h eval) across 11 diverse acoustic domains (clinical, courtroom, restaurant, web video, CTS, etc.).
VoxConverse	Dev & Test RTTMs (v0.3)	Multiple (mostly en)	Free	Audio-visual diarisation dataset of 63.8 hours across 448 multispeaker YouTube clips (CC BY 4.0).
CHiME-6	Together with audios	en	Free	~50 hours (20 4-speaker dinner-party sessions) recorded on distant Kinect microphone arrays and binaural microphones (OpenSLR 150).
AISHELL-4	Together with audios	zh	Free	120 hours (211 sessions, 4–8 speakers per session) of real Mandarin multi-party meetings recorded on an 8-channel circular mic array + headsets (CC BY-SA 4.0).
MiniVox Benchmark	Generated automatically	en	Free	MiniVox is an automatic framework to transform any speaker-labelled dataset into continuous speech datastream with episodically revealed label feedbacks.
The AliMeeting Corpus	Together with audios	zh	Free	118.75 hours of real Mandarin meetings (far-field 8-ch mic array + near-field headsets, ~42% overlap in train; CC BY-SA 4.0). Baseline repo.

Speaker embedding training sets

Name	Utterances	Speakers	Language	Pricing	Additional information
TIMIT	6.3K	630	en	$250.00	Published in 1993, the TIMIT corpus of read speech is one of the earliest speaker recognition datasets.
VCTK	44K	110	en	Free	CSTR VCTK Corpus (v0.92, CC BY 4.0). Newspaper sentences plus the Rainbow Passage and an elicitation paragraph across diverse English accents.
LibriSpeech	292K	2.4K+	en	Free	Large-scale (~1,000 hours) corpus of read English speech (CC BY 4.0).
Multilingual LibriSpeech (MLS)	12.3M	6.3K+	en, de, nl, es, fr, it, pt, pl	Free	Large-scale (~50.8K hours) multilingual corpus derived from read audiobooks from LibriVox across 8 languages - English, German, Dutch, Spanish, French, Italian, Portuguese, Polish (CC BY 4.0).
LibriVox	350K+ chapters	14.9K+	Multiple	Free	Free public-domain audiobooks (21.8K+ cataloged works across 49 languages). LibriSpeech and MLS are processed subsets of LibriVox. Each unsegmented chapter recording can be very long.
VoxCeleb 1&2	1.28M+	7.3K+	Multiple	Free	Audio-visual dataset (~2,794 hours) consisting of short clips of human speech extracted from YouTube interview videos (CC BY-SA 4.0).
The Spoken Wikipedia Corpora	5.4K articles	879	en, de, nl	Free	Volunteer readers reading full Wikipedia articles (~1,005 hours total, CC BY-SA 4.0).
CN-Celeb 1&2	660K	3K	zh	Free	Multi-genre Chinese speaker recognition corpus (~1,364 hours across 11 genres: CN-Celeb1 + CN-Celeb2; CC BY-SA 4.0) released by CSLT@Tsinghua University.
BookTubeSpeech	8.4K videos	8.4K	en	Free	Audio samples (~1,090 hours) extracted from BookTube YouTube videos (CC BY 4.0). The dataset can be downloaded using BookTubeSpeech-download.
DeepMine	540K+	1,858	fa, en	Paid (contact authors)	A speech database in Persian and English (>480 hours transcribed) designed to build and evaluate speaker verification and Persian ASR systems.
NISP-Dataset	28K+	345	en, hi, kn, ml, ta, te	Free	Multi-accent Indian English and 5 Indian languages (56.9 hours, CC BY 4.0) along with speaker physical parameters (height, weight, ...) and regional/linguistic metadata.
VoxBlink2	9.9M	111K+	18 languages (en, pt, es, ru, ar, ...)	Free	Multilingual dataset (~16,672 hours, CC BY-NC-SA 4.0) from VoxBlink2: A 100K+ Speaker Recognition Corpus and the Open-Set Speaker-Identification Benchmark

Augmentation noise sources

Name	Utterances	Pricing	Additional information
AudioSet	2M+	Free	A large-scale dataset of 2.08M human-annotated 10-second audio event clips (~5,789 hours; CC BY 4.0).
MUSAN	2K+ (~109 hours)	Free	Corpus of music (42.5h), speech (~60h), and noise (~6h, 929 files) recordings (CC BY 4.0).
RIRS_NOISES	60K+ RIRs & noises	Free	Simulated and real room impulse responses plus isotropic and point-source noises at 16 kHz (Apache 2.0).

Conferences

Conference/Workshop	Frequency	Page Limit	Organization	Double-Blind Review
ICASSP	Annual	4 + 1 (ref)	IEEE	No
Interspeech	Annual	4 + 2 (ref)	ISCA	Yes
Speaker Odyssey	Biennial	6 + 2 (ref)	ISCA	Yes
SLT	Biennial	6 + 2 (ref)	IEEE	Yes
ASRU	Biennial	6 + 2 (ref)	IEEE	Yes
WASPAA	Biennial	4 + 1 (ref)	IEEE	Yes
IJCB	Annual	8 + unlimited (ref)	IEEE & IAPR TC-4	Yes

Products

Company	Product
Google	Recorder app
Google	Google Cloud Speech-to-Text API
Google	Gemini 3.5 Transcribe
Amazon	Amazon Transcribe
Microsoft	Azure AI Speech Diarization API
IBM	Watson Speech to Text
Alibaba	Tongyi Tingwu (通义听悟)
pyannoteAI	pyannoteAI - commercial cloud API and speaker diarization models from the creators of pyannote.audio
AssemblyAI	Speaker Diarization API
Deepgram	Diarization API
Speechmatics	Speaker Diarization API
ElevenLabs	Scribe Speech to Text
Kviskr	Kviskr - macOS app for local dictation and meeting transcription with speaker diarization using NB-Whisper
diarize	diarize.io - hosted API and web app for speaker-labeled transcripts of YouTube and other video links
Screenpipe	Screenpipe - Desktop screen/audio history with speaker diarization, local storage, and optional cloud transcription (source-available, Screenpipe Commercial License)

Publications

Special topics

Review and survey papers

• A Review of Speaker Diarization: Recent Advances with Deep Learning, 2022
• A review on speaker diarization systems and approaches, 2012
• Speaker diarization: A review of recent research, 2012

Large language model (LLM)

• SpeakerLM: End-to-End Versatile Speaker Diarization and Recognition with Multimodal Large Language Models, 2026
• DiarizationLM: Speaker Diarization Post-Processing with Large Language Models, 2024
• Enhancing Speaker Diarization with Large Language Models: A Contextual Beam Search Approach, 2024
• Lexical speaker error correction: Leveraging language models for speaker diarization error correction, 2023

Supervised diarization

• DiaPer: End-to-End Neural Diarization with Perceiver-Based Attractors, 2024
• Powerset multi-class cross entropy loss for neural speaker diarization, 2023
• TOLD: A Novel Two-Stage Overlap-Aware Framework for Speaker Diarization, 2023
• Encoder-Decoder Based Attractors for End-to-End Neural Diarization, 2022
• Speaker Overlap-aware Neural Diarization for Multi-party Meeting Analysis, 2022
• End-to-End Diarization for Variable Number of Speakers with Local-Global Networks and Discriminative Speaker Embeddings, 2021
• Discriminative Neural Clustering for Speaker Diarisation, 2021
• Supervised online diarization with sample mean loss for multi-domain data, 2020
• End-to-End Neural Speaker Diarization with Permutation-Free Objectives, 2019
• End-to-End Neural Speaker Diarization with Self-attention, 2019
• Fully Supervised Speaker Diarization, 2019

Joint diarization and ASR

• Train Short, Infer Long: Speech-LLM Enables Zero-Shot Streamable Joint ASR and Diarization on Long Audio, 2026
• Sortformer: A Novel Approach for Permutation-Resolved Speaker Supervision in Speech-to-Text Systems, 2025
• One Model to Rule Them All? Towards End-to-End Joint Speaker Diarization and Speech Recognition, 2024
• WhisperX: Time-Accurate Speech Transcription of Long-Form Audio, 2023
• A Comparative Study on Speaker-attributed Automatic Speech Recognition in Multi-party Meetings, 2022
• Turn-to-Diarize: Online Speaker Diarization Constrained by Transformer Transducer Speaker Turn Detection, 2022
• Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR, 2022
• Joint Speech Recognition and Speaker Diarization via Sequence Transduction, 2019
• Says who? Deep learning models for joint speech recognition, segmentation and diarization, 2018

Online speaker diarization

• Speaker Diarization as a Fully Online Bandit Learning Problem in MiniVox, 2021
• VoiceID on the Fly: A Speaker Recognition System that Learns from Scratch, 2020

Challenges

• The CHiME-8 DASR Challenge for Generalizable and Array Agnostic Distant Automatic Speech Recognition and Diarization, 2024
• M2MeT: The ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Challenge, 2022
• The Hitachi-JHU DIHARD III system: Competitive end-to-end neural diarization and x-vector clustering systems combined by DOVER-Lap, 2021
• Diarization is Hard: Some Experiences and Lessons Learned for the JHU Team in the Inaugural DIHARD Challenge, 2018
• ODESSA at Albayzin Speaker Diarization Challenge 2018, 2018
• Joint Discriminative Embedding Learning, Speech Activity and Overlap Detection for the DIHARD Challenge, 2018

Audio-Visual Speaker Diarization

• 3D-Speaker-Toolkit: An Open-Source Toolkit for Multimodal Speaker Verification and Diarization, 2025
• AVA-AVD: Audio-Visual Speaker Diarization in the Wild, 2022
• DyViSE: Dynamic Vision-Guided Speaker Embedding for Audio-Visual Speaker Diarization, 2022
• End-to-End Audio-Visual Neural Speaker Diarization, 2022
• MSDWild: Multi-modal Speaker Diarization Dataset in the Wild, 2022

Other

2026

• Efficient and Robust Speaker Diarization via Structured Pruning of Self-Supervised Models

2025

• Leveraging Self-Supervised Learning for Speaker Diarization

2024

• TS-SEP: Joint Diarization and Separation Conditioned on Estimated Speaker Embeddings

2023

• pyannote.audio 2.1 speaker diarization pipeline: principle, benchmark, and recipe

2022

• From Simulated Mixtures to Simulated Conversations as Training Data for End-to-End Neural Diarization
• Multi-scale Speaker Diarization with Dynamic Scale Weighting

2021

• Overlap-aware low-latency online speaker diarization based on end-to-end local segmentation
• End-to-end speaker segmentation for overlap-aware resegmentation
• DIVE: End-to-end Speech Diarization via Iterative Speaker Embedding
• DOVER-Lap: A method for combining overlap-aware diarization outputs
• Bayesian HMM clustering of x-vector sequences (VBx) in speaker diarization: Theory, implementation and analysis on standard tasks
• AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenario

2020

• Spot the conversation: speaker diarisation in the wild
• Speaker Diarization with Region Proposal Network
• Target-Speaker Voice Activity Detection: a Novel Approach for Multi-Speaker Diarization in a Dinner Party Scenario
• Overlap-aware diarization: resegmentation using neural end-to-end overlapped speech detection
• Speaker diarization using latent space clustering in generative adversarial network

2019

• A study of semi-supervised speaker diarization system using gan mixture model
• Enhancements for Audio-only Diarization Systems
• LSTM based Similarity Measurement with Spectral Clustering for Speaker Diarization
• Meeting Transcription Using Virtual Microphone Arrays
• Speaker diarisation using 2D self-attentive combination of embeddings
• Speaker Diarization with Lexical Information

2018

• Speaker Diarization with LSTM
• Neural speech turn segmentation and affinity propagation for speaker diarization
• Multimodal Speaker Segmentation and Diarization using Lexical and Acoustic Cues via Sequence to Sequence Neural Networks

2017

• Speaker diarization using deep neural network embeddings
• Speaker diarization using convolutional neural network for statistics accumulation refinement
• pyannote.metrics: a toolkit for reproducible evaluation, diagnostic, and error analysis of speaker diarization systems
• Speaker Change Detection in Broadcast TV using Bidirectional Long Short-Term Memory Networks
• Speaker Diarization using Deep Recurrent Convolutional Neural Networks for Speaker Embeddings

2016

• A Speaker Diarization System for Studying Peer-Led Team Learning Groups

2015

• Diarization resegmentation in the factor analysis subspace

2014

• A study of the cosine distance-based mean shift for telephone speech diarization
• Speaker diarization with PLDA i-vector scoring and unsupervised calibration
• Artificial neural network features for speaker diarization

2013

• Unsupervised methods for speaker diarization: An integrated and iterative approach

2011

• PLDA-based Clustering for Speaker Diarization of Broadcast Streams
• Speaker diarization of meetings based on speaker role n-gram models

2009

• Speaker Diarization for Meeting Room Audio

2008

• Stream-based speaker segmentation using speaker factors and eigenvoices

2006

• An overview of automatic speaker diarization systems
• A spectral clustering approach to speaker diarization

Other learning materials

Online courses

• Course on Udemy: A Tutorial on Speaker Diarization

Books

• Voice Identity Techniques: From core algorithms to engineering practice (Chinese) by Quan Wang, 2020

Tech blogs

• Literature Review For Speaker Change Detection by Halil Erdoğan
• Speaker Diarization: Separation of Multiple Speakers in an Audio File by Jaspreet Singh
• Speaker Diarization with Kaldi by Yoav Ramon
• Who spoke when! How to Build your own Speaker Diarization Module by Rahul Saxena

Video tutorials

• pyannote audio: neural building blocks for speaker diarization by Hervé Bredin
• Google's Diarization System: Speaker Diarization with LSTM by Google
• Fully Supervised Speaker Diarization: Say Goodbye to clustering by Google
• Turn-to-Diarize: Online Speaker Diarization Constrained by Transformer Transducer Speaker Turn Detection by Google
• Speaker Diarization: Optimal Clustering and Learning Speaker Embeddings by Microsoft Research
• Robust Speaker Diarization for Meetings: the ICSI system by Microsoft Research
• 【机器之心&博文视点】入门声纹技术｜第二讲：声纹分割聚类与其他应用 by Quan Wang

Star History