Preprint
Swiss German Speech to Text system evaluation
Yanick Schraner et al., arXiv (Computation and Language), 2022
Read the originalRead on October 17, 2026
- What it is
- The FHNW team compared four anonymized commercial speech to text systems for Swiss German with their own model, on two test sets. Their model had the best word error rate and BLEU score on both.
- How much weight it carries
- The authors built the model they rank first, so treat the margin as their own measurement. The commercial systems are anonymized and the evaluation dates from May 2022.
Facts taken from this source
- In the FHNW team's 2022 evaluation, their own Swiss German model had almost half the word error rate of the best commercial system.
“Our best model has almost half the word error rate and a 15 points higher BLEU score than the best commercial system.” (Section 4, Evaluation)