Audio Workflow Overview

Qualcomm Technologies, Inc.

80-NU146-1 B

Confidential and Proprietary – Qualcomm Technologies, Inc.

Restricted Distribution: Not to be distributed to anyone who is not an employee of either

Qualcomm Technologies, Inc. or its affiliated companies without the express approval of
Qualcomm Configuration Management.
 Confidential and Proprietary – Qualcomm Technologies, Inc.

NO PUBLIC DISCLOSURE PERMITTED: Please report postings of this document on public servers or websites to: DocCtrlAgent@qualcomm.com.
Not to be used, copied, reproduced, or modified in whole or in part, nor its contents revealed in any manner to others without the express written permission of
Qualcomm Technologies, Inc.
Qualcomm is a trademark of Qualcomm Incorporated, registered in the United States and other countries. All Qualcomm Incorporated trademarks are used with
permission. Other product and brand names may be trademarks or registered trademarks of their respective owners.
This technical data may be subject to U.S. and international export, re-export, or transfer (“export”) laws. Diversion contrary to U.S. and international law is strictly
prohibited.
Qualcomm Technologies, Inc.
5775 Morehouse Drive
San Diego, CA 92121
U.S.A.
© 2014, 2015 Qualcomm Technologies, Inc. and/or its affiliated companies. All rights reserved.

PAGE 2 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Revision History

Revision Date Description

A Nov 2014 Initial release

B Apr 2015 Updated QACT version in slide 20 and slide 24

PAGE 3 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Contents

 Customer Project Lifecycle

 Description of Project Stages
 Additional Information
 References
 Questions?

PAGE 4 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Customer Project Lifecycle

PAGE 5 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 OEM Project Lifecycle

Evaluate Define Design Build Bring-up

Integrate Verify Certify Manufacture

 The block diagram shows 9 key phases in the customer project lifecycle. Next page shows how these apply to
Audio development.
 Evaluate: Review QTI SPL, Feature set, Roadmaps, Customization, Schedule, KPIs, Competitive analysis,
Cost analysis, Sign license.
 Define: OEM product requirements, Market, Competitive feature set, Proprietary features, Functionality, Set
goals, Schedule, KPIs, Cost.
 Design: Feasibility studies, Resource scheduling, Proprietary features, Software final details and plans,
Development schedule, Plan/prepare for testing, Certification, Manufacturing, Post launch support.
 Build: Build initial hardware, Work with Manufacturing org., Start manufacturing process, Manufacturing builds
hardware, Verify hardware from manufacturer (without product software), Implement software, Implement BSP,
software for hardware changes, Implement OEM proprietary features and functionality, Code reviews,
Simulations, Develop on similar platforms.
 Bring-up: Validate multimedia use case, Software/hardware video codec,
End-to-end playback and recording
 Integrate: Validate OEM proprietary, features, Validate concurrency, Stability testing, use-cases, focus on
concurrency
 Verify: Fine tuning of key technologies, Multimedia, Performance, Field testing, Friendly user tests
 Certify: Pre-certification testing, Work with third party organizations – Carrier and Market tests, Certifications,
Technical acceptances, Waivers and corrective action items
 Manufacture: Mass Production, Factory tests, Failure recovery, Yield/process imp., After launch, Provisioning,
Software updates
PAGE 6 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Project Stages

 The stages shown in the following figure are applicable to all OEMs in
general, irrespective of the beginning of the project cycle, with respect to
the Qualcomm Technologies, Inc. (QTI) software release schedule.
Evaluate Define Build Integrate Verify Certify
design Bring-up manufacture

Project Kickoff Hardware Verification I Verification II Launch

pre-kickoff bringup
 OEM provides  Software  Software  OEMs product
 Software project details,  The basic Feature commercial launched on
schedule software Complete (FC) carrier or open
schedule, quality reached
defined capability market
 Performance specifications,  OEM starts (CS)
required for
defined and customer
using the  Performance
requirements feature validated
 All reference hardware
information is  Feature gaps bring-up is  Feature
made available are identified made available reaches
to the OEM  Test plan is  OEM hardware maturity with
 Documentation exchanged/ bring-up usage and test
is ready and identified  Issues and
shared with the  OEMs have the
Engineering concerns
OEM
Sample (ES) raised by OEM
through
Salesforce;
worked upon
and fixed

Once per chipset Once per project

PAGE 7 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Project Stages (cont.)

 OEMs, who start the projects at a later stage are encouraged to use the
latest QTI software branch releases available at that time for their
respective stages.
 For example, project_X uses a CTA branch release for hardware bringup,
Project_Y uses a CMCC branch release for the same purpose, Project_Z
uses a CS release, etc.

Project Hardware Tuning Tuning

Project_Z Kickoff Launch
pre-kickoff bring-up start end

……
Project Hardware Tuning Tuning
Project_Y Kickoff Launch
pre-kickoff bring-up start end

Project Hardware Tuning Tuning

Project_X Kickoff Launch
pre-kickoff bring-up start end

PAGE 8 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Description of Project Stages

PAGE 9 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Pre-kickoff Stage

Item Description Delivery format

Plan of Record  Release timelines
(PoR)  Key feature list Salesforce solution
 Feature description document
Performance  How KPIs are measured
 KPIs and memory requirements for the Salesforce solution
chipset
 System performance projection
Schedule  Audio enablement plan “When a customer
can do what” Salesforce solution
 QTI schedule
(audio hardware bringup, functional
readiness, performance readiness,
tuning, tool availability timeline, WCD
evaluation board/QCET readiness)

PAGE 10 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Pre-kickoff Stage (cont.)

Item Description Delivery format

Hardware  Electroacoustic specification (microphone, Application Note:
recommendation speaker, jacks, housing, etc.) Electroacoustic Design
 PCB/PWB specification (codec, passive Guidelines For
components placement/routing/layout) Smartphones
(80-VE797-16)
Documentation  Customer engagement model (Application  This document –
note) Audio Workflow
 Documentation tree (solution) Overview
 Migration plan (Application note) (80-NU146-1)
 Deltas from previous chipsets/SP  Salesforce solution
 Architecture difference
 Software leverage
 Performance and power delta
Customer training Developer conference training guides Training
(Application note)

PAGE 11 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Kick-off Stage

Item Description Delivery format

Hardware Customer hardware design discussion Salesforce solution
review
Customer  Customer deliverables
requirements  Component selection, feature requests, Salesforce solution
schedules, KPI expectations, target
market/carriers
 Customization plan
Schedule gap Internal schedule proposal for feature gaps Workshop
Support Developer conference follow-up, for example, with Workshop/
specific OEMs, for differentiating features/capabilities, questionnaire
etc.
Tuning/  Tuning milestone agreement, tuning ownership
hardware identified Salesforce solution
evaluation  Application form for QTI lab support
 Evaluation hardware and tool availability, for
example, WCD evaluation, QCET, SVAKCT, etc.
Licensing  OpenDSP NA
 Optional software features, for example, Fluence™
family
PAGE 12 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Hardware Bring-up Stage

Item Description Delivery format

Hardware Review customer hardware Salesforce solution
review (schematics/layout/form factor) design and
finalization against QTI’s reference design, and
review changes
FTM  Check audio path connection over PoR’ed Software release
capabilities audio interface
 Test audio playback and recording
Software  Audio playback, audio recording, MT/MO voice Software release
baseline calls
 WCD functionalities
 Device selection
 Release note (capabilities and limitation)
Tool  FTM tool with initial metrics met  Release Notes:
 QACT™ (for audio path configuration) QACT 5.0 Release
00007 (QACT.WIN.
5.0-00007-QACT)
(80-NT688-8)
 QACT V5.x.x User
Guide (80-VM407-8)
PAGE 13 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Hardware Bring-up Stage (cont.)

Item Description Delivery format

Documentation  Hardware bring-up guide (in Mandarin) Ongoing
 Initial code walkthrough and training video
 Initial feature enablement and customization guide
Software test Software test report with software release See the respective
plan software release
notes
Support  Publish hardware bring-up branch release updates Software patch
to all OEMs
 Only fixes for hardware bring-up blocking issues
 Review SRs and merge applicable ones to
mainline

PAGE 14 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Tuning Start Stage

Item Description Delivery format

Software  Software feature complete Software release
baseline  Tuning enabled (initial feature set)
 Customization framework enabled
 Audio enablement plan updates (solution)
Tool  QACT Tool release
 SVAKCT
 Tool capabilities aligned to the software
Documentation  Tuning workflow and guidelines Application note/workshop
 Tuning tool user guides
 Release notes (capabilities and
limitations)
 Final code walkthrough and training video
 Final feature enablement and
customization guide
 Publish CTA release updates to all OEMs This information will be
 Only fixes for CTA blocking issues provided in a future
Support  Review SRs and merge applicable ones revision of this document.
to mainline

PAGE 15 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Tuning Start Stage (cont.)

Item Description Delivery format

Performance  Customers measure KPIs on their Salesforce case
hardware
 System performance measured and
validated on target (internal, aligned to
overall system maturity)
Tuning Customer conducts objective and subject
tuning
Software test Software test report with software release Application note
plan
 Last-minute subjective tuning onsite Lab
cowork planning
Support  Engineer available for onsite tuning, as
required
 Publish CTA release updates to all OEMs This information will be
 Only fixes for CTA blocking issues provided in a future
 Review SRs and merge applicable ones revision of this document.
to mainline

PAGE 16 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Tuning End Stage

Item Description Delivery format

Software Full software product PoR Software release
baseline
Support  Publish CMCC release updates to all OEMs Software patch
 Only fixes for CMCC blocking issues
 Review SRs and merge applicable ones to
mainline
Performance System performance measured and validated Internal report
on target (internal, commercial quality)

PAGE 17 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Internal Readiness of Launch Stage

Item Detailed deliverables or actions Delivery format

Support Post-CS CPL software management process Software patch
 Publish critical CRs and known issues
 Patch management per OEM requests

PAGE 18 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Key Audio Documents

 To download documents
1. Go to https://support.cdmatech.com/login/ and click Docs & Downloads to log in.
2. Click Quick Search.
3. Enter the Document Control Number (DCN) in the search field and click Search.

DCN/
Audio feature Salesforce Description
reference
80-VE797-16 Electroacoustic design guidelines for all audio
features
80-NK880-2 Fluence v5 acoustic echo cancellation training (in
progress)
Fluence v5.5 80-NB428-1 Fluence Pro single-mic and multi-mic acoustic
Echo Canceller (EC) audio tuning guide
80-NK880-3 Fluence v5 Noise Suppression (NS) overview
80-NB428-2 Fluence v5 dual and single mic NS tuning (in
progress)

PAGE 19 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Key Audio Documents (cont.)

DCN/
Audio feature Salesforce Description
reference
Snapdragon™ 80-NK129-1 SVA keyword guidelines (application note)
Voice Activation 80-NF311-1 Always-on feature (application note for Linux
(SVA) v2.0 Android)
– Salesforce solution
Audio software – Salesforce solution
– Salesforce solution
Tools (QACT 80-NT688-8 QACT v5.x release notes
v5.x) 80-VM407-8 QACT v5.x.x user guide

PAGE 20 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Additional Information

PAGE 21 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Using Salesforce System Solutions

1. Log in to the Salesforce system at

https://support.cdmatech.com/login/.

2. Click Solutions.

3. Enter the solution number in the Search for field and click Find Solution.

Note: All solutions have hyperlinks for easy browsing and a single click for document downloads.

PAGE 22 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Branch Strategy

 OEM rebase of releases occur on a monthly basis

 Branch releases are maintained separately from mainline releases
 Changes on branch releases are pushed to all OEMs
 Changes on branch releases are reviewed regularly to identify the root
cause and are propagated to the mainline release
 Post-CS CSPs are created per OEM upon request; OEMs select CR fixes
on their own CSP branch

PAGE 23 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 References

Documents

Qualcomm Technologies, Inc.

Title DCN

Application Note: Electroacoustic Design Guidelines For Smartphones 80-VE797-16

Release Notes: QACT 5.0 Release 00007 (QACT.WIN.5.0-00007-QACT) 80-NT688-8

QACT V5.x.x User Guide 80-VM407-8

Presentation: Fluence V5 Acoustic Echo Cancellation Audio Tuning Training 80-NK880-2

Fluence V5 Dual And Single Mic Noise Suppression Audio Tuning Guide 80-NB428-2

Snapdragon Voice Activation Keyword Guidelines 80-NK129-1

Presentation: Fluence V5 Noise Suppression Audio Tuning Training 80-NK880-3

Application Note: Always-on Listen Feature 80-NF311-1

Application Note: Linux Audio Device Management 80-NL239-28

Application Note: Multibutton Headset Control 80-NL239-27

Factory Test Mode for Audio on MSM8x10/MSM8x26 Android 80-NC839-24

Application Note: Electroacoustic Design Guidelines for Smartphones 80-VE797-16

PAGE 24 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 References (cont.)

Acronyms

Term Definition
EC Echo Canceller
NS Noise Suppression
QACT Qualcomm Audio Calibration Tool
QCET Qualcomm Codec Evaluation Tool

PAGE 25 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION
 Questions?
https://support.cdmatech.com

PAGE 26 80-NU146-1 B Apr 2015 Confidential and Proprietary – Qualcomm Technologies, Inc. | MAY CONTAIN U.S. AND INTERNATIONAL EXPORT CONTROLLED INFORMATION