Automated Voice And Audio Quality Test Measurement

50 %
50 %
Information about Automated Voice And Audio Quality Test Measurement
Technology

Published on July 24, 2009

Author: sevana

Source: slideshare.net

Description

AQuA is a simple but powerful tool to provide perceptual voice quality testing and audio file comparison. This is the easiest way to compare two audio files and test sound signals quality between original and degraded files.

Making your voice quality testing easy Sevana Oy Endre Domiczi Mobile: +358 9 23164165 E-mail: ceo@sevana.fi

This Presentation … is you to meet Sevana, it’s team, management, technology and services … is to discuss what one demands from a voice quality software in different systems devoted to test networks, codecs, QoS, QoE … is to present Sevana Voice Quality Testing approach and software … is to describe who is ideal partner or/and customer for Sevana Voice Quality Testing software … is to clearly show the benefits our customers obtain working with us … is to tell you why we think that Sevana is your trusted partner

… is you to meet Sevana, it’s team, management, technology and services

… is to discuss what one demands from a voice quality software in different systems devoted to test networks, codecs, QoS, QoE

… is to present Sevana Voice Quality Testing approach and software

… is to describe who is ideal partner or/and customer for Sevana Voice Quality Testing software

… is to clearly show the benefits our customers obtain working with us

… is to tell you why we think that Sevana is your trusted partner

Company Presentation Sevana Oy (Ltd) is a privately owned Helsinki based Finnish company established in 2003 as a software development company with the emphasis to emerging software technologies in telecom and industrial solutions. Sevana Oy Agrikolankatu 11 00530 Helsinki email: info@sevana.fi Finland tel. : +358 9 23164165

Company management and shareholders Sevana Oy (Ltd.) is currently owned by its founders and employees. The company has three different international software research and development teams organized by product lines. Sevana Oy (Ltd.) is lead by Mr. Endre Domiczi company CEO who is one of the main shareholders and co-founders. He is currently responsible for company operations and managing activities in Finland and European markets.

What do we want from a voice quality system? Let’s consider voice quality from a user point of view: We want to know when audio sounds good and when it sounds bad We want to be sure that if our customer uses our system to approach somebody the one at the destination will be able to communicate with the one at the origin We want to have a possibility to predict how our system will work when brought live We want to speak, hear and be heard We do not want to know HOW this is done, but we want to hear and be heard! Sound’s good!

Let’s consider voice quality from a user point of view:

We want to know when audio sounds good and when it sounds bad

We want to be sure that if our customer uses our system to approach somebody the one at the destination will be able to communicate with the one at the origin

We want to have a possibility to predict how our system will work when brought live

We want to speak, hear and be heard

We do not want to know HOW this is done, but we want to hear and be heard!

What do we want you to get from a voice quality system? Let’s consider voice quality from a user point of view: We want you to be able to automatically detect when audio sounds good and when it does not – and thereby be able to easily predict user satisfaction in your oraganization (and among your product and services users) We want to be sure that when your customer uses voice quality concept and software system and approaches somebody, the one at the destination will be able to communicate with the one at the origin with 100% satisfaction. We want you to predict how our system will work when going live We want your customers to speak, hear, be heard and satisfied with the quality We want you to be able to demand clarifications from your voice carrier provider (fixed, mobile, VoIP) referring to quantitative reasons for quality loss We want you to hear and be heard with a 100% satisfaction! Sound’s good!

Let’s consider voice quality from a user point of view:

We want you to be able to automatically detect when audio sounds good and when it does not – and thereby be able to easily predict user satisfaction in your oraganization (and among your product and services users)

We want to be sure that when your customer uses voice quality concept and software system and approaches somebody, the one at the destination will be able to communicate with the one at the origin with 100% satisfaction.

We want you to predict how our system will work when going live

We want your customers to speak, hear, be heard and satisfied with the quality

We want you to be able to demand clarifications from your voice carrier provider (fixed, mobile, VoIP) referring to quantitative reasons for quality loss

We want you to hear and be heard with a 100% satisfaction!

Cost-Effective Automated Testing Avoid expensive, imprecise, time and effort consuming manual tests Surveillance Continuous and precise monitoring of voice/audio service availability, quality and performance (KQI, KPI) Service Quality Management Precise measurement of voice/audio service availability, performance and quality Reporting flexible, dynamic, automated reporting and alarming environment Scalability Starting from a small stand-alone or/and desktop to network distributed systems What does one typically demand from a voice quality system?

Cost-Effective Automated Testing

Avoid expensive, imprecise, time and effort consuming manual tests

Surveillance

Continuous and precise monitoring of voice/audio service availability, quality and performance (KQI, KPI)

Service Quality Management

Precise measurement of voice/audio service availability, performance and quality

Reporting

flexible, dynamic, automated reporting and alarming environment

Scalability

Starting from a small stand-alone or/and desktop to network distributed systems

Flexible User Interface User-friendly and user-specific modern GUI Flexible User Access Accessibility from Internet, Intranet, LAN, etc Open Interface Seamless and easy integration and combination of existing and new tools Flexible Customer Environment Availability for various customer environments and adaptation to specific customer needs What does one typically demand from a voice quality system?

Flexible User Interface

User-friendly and user-specific modern GUI

Flexible User Access

Accessibility from Internet, Intranet, LAN, etc

Open Interface

Seamless and easy integration and combination of existing and new tools

Flexible Customer Environment

Availability for various customer environments and adaptation to specific customer needs

Cost-Effective Automated Testing Quick ROI when automating voice quality testing: when automating IVR systems testing ROI period maybe less than 1 month! Surveillance Integrating voice quality testing (VQT) module into your existing environment allows easy, continuous and precise monitoring of service availability, quality and performance. Service Quality Management Precise measurement of service availability, performance and quality is achieved by ability to tune voice quality testing software utilizing a large variety of software parameters Reporting Automated reporting utilizing existing or introducing highly customized reporting systems. Scalability Starting from a PDA or desktop to network distributed systems Sevana product & service offerings (1/2) Features and benefits

Cost-Effective Automated Testing

Quick ROI when automating voice quality testing: when automating IVR systems testing ROI period maybe less than 1 month!

Surveillance

Integrating voice quality testing (VQT) module into your existing environment allows easy, continuous and precise monitoring of service availability, quality and performance.

Service Quality Management

Precise measurement of service availability, performance and quality is achieved by ability to tune voice quality testing software utilizing a large variety of software parameters

Reporting

Automated reporting utilizing existing or introducing highly customized reporting systems.

Scalability

Starting from a PDA or desktop to network distributed systems

Flexible User Interface Customized user-friendly GUI based on multiplatform or ribbon technologies Flexible User Access Accessibility from Internet, Intranet, LAN based on any Windows/Linux solution Open Interface Seamless and easy integration into Windows/Linux systems Flexible Customer Environment Availability for various customer environments and low cost customization to specific customer needs (down to offshore rates!) Sevana product & service offerings (2/2) Features and benefits

Flexible User Interface

Customized user-friendly GUI based on multiplatform or ribbon technologies

Flexible User Access

Accessibility from Internet, Intranet, LAN based on any Windows/Linux solution

Open Interface

Seamless and easy integration into Windows/Linux systems

Flexible Customer Environment

Availability for various customer environments and low cost customization to specific customer needs (down to offshore rates!)

Preface Simple but powerful tool to provide perceptual voice quality testing and audio file comparison in terms of audio quality. This is the easiest way to compare two audio files and test voice quality loss between original and degraded files. Besides this a most demanded functionality of the software can also test audio codecs and generate audio signals for voice quality testing. Requirements Hardware: starting from a modern PDA OS: Windows/Linux/Other (when Java based) Audio: 8kHz, 16 bit, Mono 16kHz, 16bit, Mono, Stereo 22kHz-44kHz, 16bit, Mono, Stereo Features Generate test signals Test voice codecs Compare audio files (.pcm or .wav) Sevana Voice Quality Testing Technology

Preface

Simple but powerful tool to provide perceptual voice quality testing and audio file comparison in terms of audio quality. This is the easiest way to compare two audio files and test voice quality loss between original and degraded files. Besides this a most demanded functionality of the software can also test audio codecs and generate audio signals for voice quality testing.

Requirements

Hardware: starting from a modern PDA

OS: Windows/Linux/Other (when Java based)

Audio:

8kHz, 16 bit, Mono

16kHz, 16bit, Mono, Stereo

22kHz-44kHz, 16bit, Mono, Stereo

Features

Generate test signals

Test voice codecs

Compare audio files (.pcm or .wav)

Our Customers Fixed line telecom operators Land lines voice quality ADSL/SIP voice quality Voice services (e.g. IVR) Mobile operators Call quality check and monitoring Voice services (e.g. IVR) Voice/audio streaming VoIP operators Call quality monitoring Network monitoring for VoIP calls VoIP IVR Automated voice quality feedback

Fixed line telecom operators

Land lines voice quality

ADSL/SIP voice quality

Voice services (e.g. IVR)

Mobile operators

Call quality check and monitoring

Voice services (e.g. IVR)

Voice/audio streaming

VoIP operators

Call quality monitoring

Network monitoring for VoIP calls

VoIP IVR

Automated voice quality feedback

Companies providing voice quality testing solutions Fixed lines Mobile VoIP Companies providing QoS monitoring solutions Fixed lines (ADSL/SIP) Mobile VoIP Network monitoring Companies providing IT solutions for health care Companies providing industrial solutions Companies providing audio/speech/music equipment consulting Voice related products manufacturers Companies providing environmental consulting Our Business Partners

Companies providing voice quality testing solutions

Fixed lines

Mobile

VoIP

Companies providing QoS monitoring solutions

Fixed lines (ADSL/SIP)

Mobile

VoIP

Network monitoring

Companies providing IT solutions for health care

Companies providing industrial solutions

Companies providing audio/speech/music equipment consulting

Voice related products manufacturers

Companies providing environmental consulting

Implementation Approach Available: Windows/Linux command line Windows DLL library Customizable: Windows Mobile Java Desktop

Available:

Windows/Linux command line

Windows DLL library

Customizable:

Windows Mobile

Java

Desktop

Business Solutions (1): Automated IVR systems testing Check IVR System for: Voice services availability Announcements correctness Recognized prompt and prompt parts Entire architecture of your IVR system Define and create KPIs

Check IVR System for:

Voice services availability

Announcements correctness

Recognized prompt and prompt parts

Entire architecture of your IVR system

Define and create KPIs

Business Solutions (2): Automated IVR systems testing IVR System Under Test IVR system available Telecom equipment for making calls and DTMF input available Test scenarios known Audio recordings available Testing process Make call Create interaction (send DTMF tone) Receive voice response Compare received voice response with the correct (original) one Still doing this manually? Using expensive SR?

IVR System Under Test

IVR system available

Telecom equipment for making calls and DTMF input available

Test scenarios known

Audio recordings available

Testing process

Make call

Create interaction (send DTMF tone)

Receive voice response

Compare received voice response with the correct (original) one

Automate IVR systems testing Testing process Make call Create interaction (send DTMF tone) Receive voice response Compare received voice response with the correct one (original recording) by using Sevana Voice Quality Testing module: Original vs. Response = 80%-99% of similarity – correct! Original vs. Response < 60% of similarity – wrong! Otherwise – repeat test. Value: 1 test call takes 1 minute, 1 man hour costs 10 euros, amount of test calls 1000 (we know the numbers are really small!) Savings: over 166 euros, over 16 hours of work ROI: in reality after making 2001 test, this maybe less than 1 month!

Testing process

Make call

Create interaction (send DTMF tone)

Receive voice response

Compare received voice response with the correct one (original recording) by using Sevana Voice Quality Testing module:

Original vs. Response = 80%-99% of similarity – correct!

Original vs. Response < 60% of similarity – wrong!

Otherwise – repeat test.

Value: 1 test call takes 1 minute, 1 man hour costs 10 euros, amount of test calls 1000 (we know the numbers are really small!)

Savings: over 166 euros, over 16 hours of work

ROI: in reality after making 2001 test, this maybe less than 1 month!

Business Solutions(4): VQT in Mobile Networks Mobile device with a stored voice/audio of original quality initiating a call to “answering machine” Mobile network of any standard providing carrier to the “answering machine” and being reason for audio degradation “ Answering machine” when receiving a call plays back the same original audio to the mobile device Test network quality for voice transmission from a Windows Mobile enabled device in seconds! Mobile Network Originating a phone call Answering to phone call Playing recorded audio Receiving degraded sound

Business Solutions(5): VQ Monitoring Computer generating and storing “speech model” – a set of sounds typical for human speech – delivering to the reception side through carrier channel/trunk Network carrier: PSTN/GSM/3G/CDMA/IP Computer receiving degraded “speech model” and calculating voice quality value in % plus reasons for voice quality loss Test channels/trunks for voice quality continuously. No other equipment required than what you already have! Carrier Network Speech Model Signal Degraded Speech Model Signal

Business Solutions(6): VoIP: QoE Feedback Avoid asking VoIP users for voice quality feedback, automate receiving perceptual quality of experience values – make your system more customer friendly! On one end of VoIP conversation outgoing (original) and incoming (degraded) are recorded On the other end of VoIP conversation outgoing (original) and incoming (degraded) are recorded as well VoIP Network VQ Server tests original1 to degraded2 and degraded1 to original1 providing 2 values for voice quality of the conversation

Business Solutions(7): VoIP: QoS Monitor your VoIP provider by doing sudden tests and be aware that your provider maintains appropriate network and voice quality (especially if you signed SLA) Initiating a call would requite just the same client device/application and 1 license of Sevana Voice Quality Software Test voice quality in your VoIP environment and get back to your VoIP provider with questions on SLA and reasons for voice quality loss – you will be prepared with estimations and actual reasons what degrades voice quality in your network. VoIP network conditions as well as voice quality conditions may vary, but when you are paying for your VoIP provider you should have means to check the actual situation of voice quality in your VoIP VoIP Network Test HD Voice easily!

How to make it happen – the Procedure Consulting Study Analysis Solution Deployment Customization Implementation Testing Deployment Deployment Audit Support Benefits of the specially designed standardized procedure Fully fits into customer environment requirements Utilizes available hardware, software, resources and business processes Provides the best routes to optimize customer satisfaction

Consulting

Study

Analysis

Solution

Deployment

Customization

Implementation

Testing

Deployment

Deployment

Audit

Support

Benefits of the specially designed standardized procedure

Fully fits into customer environment requirements

Utilizes available hardware, software, resources and business processes

Provides the best routes to optimize customer satisfaction

How to make it happen – Sevana Consulting Study Study existing customer goals and create wish-lists Inform customer about unknown options/possibilities/challenges Finalize customer’s wish-list Analysis Analyze available solutions, vendors, architectures, technologies Analyze HW/SW required and available, work out the best option Analyze costs involved, create POC (proof-of-concept) plan Solution Work out customer requirements specification Work out technical requirements specification Work out project deployment and implementation plan Value Ease and speed up deployment and implementation Increase ROI Tailored user satisfaction measurement Highly customized solution

Study

Study existing customer goals and create wish-lists

Inform customer about unknown options/possibilities/challenges

Finalize customer’s wish-list

Analysis

Analyze available solutions, vendors, architectures, technologies

Analyze HW/SW required and available, work out the best option

Analyze costs involved, create POC (proof-of-concept) plan

Solution

Work out customer requirements specification

Work out technical requirements specification

Work out project deployment and implementation plan

Value

Ease and speed up deployment and implementation

Increase ROI

Tailored user satisfaction measurement

Highly customized solution

Innovative approach The most competitive technology and pricing on the market We don’t sell expensive HW/SW testing equipment – we are making your own resources perform required tasks (turn your recording server into VQT server at the cost of 1 license !) Lowest software customization prices Most advanced multiplatform support Great potential for further feature expansion within the same support/maintenance contract Value Proposition: Why Sevana?

Innovative approach

The most competitive technology and pricing on the market

We don’t sell expensive HW/SW testing equipment – we are making your own resources perform required tasks (turn your recording server into VQT server at the cost of 1 license !)

Lowest software customization prices

Most advanced multiplatform support

Great potential for further feature expansion within the same support/maintenance contract

THANK YOU!

Add a comment

Related presentations

Presentación que realice en el Evento Nacional de Gobierno Abierto, realizado los ...

In this presentation we will describe our experience developing with a highly dyna...

Presentation to the LITA Forum 7th November 2014 Albuquerque, NM

Un recorrido por los cambios que nos generará el wearabletech en el futuro

Um paralelo entre as novidades & mercado em Wearable Computing e Tecnologias Assis...

Microsoft finally joins the smartwatch and fitness tracker game by introducing the...

Related pages

Voice, Video, and Data Quality Test Solutions

... for performing automated tests for voice, ... used for voice quality testing solutions ... the voice quality measurement and analysis ...
Read more

Voice Quality Testing (VQT) Software - GL Communications ...

GL Communications voice quality testing solution ... Evaluate audio quality with MOS, E ... and Data Quality Test Solutions. Automated Wireless Drive ...
Read more

AQuA Technology - Sevana

... Audio Quality Analyzer 2.1 Manual Download Automatic Sound Signals Quality ... Perceptual voice quality measurement is a ... test audio file ...
Read more

OPERA Voice/Audio Quality Analyzer - OPTICOM

Voice/Audio Quality Analyzer ... • All result values as in the voice and audio quality measurement ... of Systems Under Test • End-to-end voice quality ...
Read more

Audio system measurements - Wikipedia, the free encyclopedia

These methods of audio quality measurement are used by ... 'Test level', 'measurement level' and ... cables to the DC resistance of a voice ...
Read more

Mean Opinion Score (MOS) - A Measure Of Voice Quality

Software Automated Mean Opinion Score Tests. ... Some examples are AppareNet Voice, Brix VoIP Measurement ... rate your VoIP audio quality ...
Read more

OPERA™ Control For developers and manufacturers of ...

> Voice Quality Testing > Audio Quality ... > OPERA™ Distributed Network Test System > OPERA™ Control Center ... distortion measurement. In the automated
Read more

Mobile Phone Testing - NTi Audio Analyzer, Sound Level Meter

The FX100 provides a detailed view of the voice quality and thus the ... conduct a reliable automated quality test. ... audio quality test typically ...
Read more