[Cloud Computing Tencent Cloud] WeChat Mini Program integrate Tencent Cloud Smart Oral Evaluation-English (SOE-E)

Posted on 2021-07-17 Edited on 2024-09-12 In Cloud Native , Cloud Computing , Tencent Cloud Views: Word count in article: 5.9k Reading time ≈ 5 mins.

Smart Oral Evaluation-English (SOE-E)

Tencent Cloud Smart Oral Evaluation-English (SOE-E) is a voice evaluation product launched by Tencent Cloud. In the past, oral English practice had to rely on professional teachers to perform subjective assessment after listening, so the cost was high and the learning time was difficult to guarantee. Tencent Cloud launched an English voice evaluation product for this scenario, supporting voice evaluation covering all ages from children to adults, supporting multiple modes such as words (words), sentences, and supporting pronunciation accuracy (GOP), fluency, completeness, and stress Accuracy and other omni-directional scoring mechanism, and the similarity of experts’ scoring is more than 95%.

Features

Coverage for all ages

It supports English voice evaluation and scoring covering all age groups from children to adults, and provides personalized and differentiated evaluation ability support for children.
Multi-dimensional scoring

Supports multiple voice evaluation modes such as words, sentences, paragraphs, and free speaking, and supports all-round scoring mechanisms such as pronunciation accuracy, fluency, and completeness.
Not an expert, better than an expert

The scoring results of the voice evaluation of Zhiling Speaking Evaluation are more than 95% fit with the expert scoring, which can be widely used in the oral English teaching business.

Mini Program plug-in

The Smart Oral Evaluation-English (SOE-E) Mini Program plug-in Mini Program plug-in encapsulates the recording function of the Mini Program and the calls of Wisdom Speaking Evaluation API, allowing developers to access the voice evaluation capabilities through simple configuration, eliminating the need for complicated voice fragmentation and authentication logic. Focus on business development.

Prerequites

Tecent Cloud
- Account and Balance
  
  First, you must have a Tencent Cloud Account and have sufficient balance in your account.
  
  Sign up - Tencent Cloud - https://intl.cloud.tencent.com/register
- API key
  
  You can create an API key for a sub-user/collaborator. After the API key is created, the sub-user/collaborator can use APIs, SDKs, or other development tools to manage the resources under the root account within the scope of the configured permissions.
  
  Access Key | Tencent Cloud - https://intl.cloud.tencent.com/document/product/598/32675
WeChat Mini Program
- WeChat Developer Tools - https://developers.weixin.qq.com/miniprogram/en/dev/devtools/download.html
WeChat Developer Tools is a web debugging tools to help developers develop and debug Weixin Mini Programs more simply and efficiently based on the original Official Account.

Usages

Import Plug-in code

Log in to the Mini Program Plug-in Center - https://mp.weixin.qq.com/wxopen/plugindevdoc?appid=wxe5a00a1780c8eb95&token=486467026&lang=zh_CN to add the plug-in.

Introduce the following code in app.json:

// app.json

 "plugins": {
   "myPlugin": {
     "version": "1.1.1",
     "provider": "wxe5a00a1780c8eb95"
   }
 }

Import plug-in code.

1	let plugin = requirePlugin("myPlugin");

Initialization

Option 1 (recommended): Obtain authorization credentials from the backend to the applet plug-in, and the applet plug-in obtains the authorization credentials to initiate a request. During the formal deployment, please add a layer of permission check of your own website on the backend:

let plugin = requirePlugin("myPlugin");
let manager = plugin.getSoeRecorderManager({
getAuthorization: function (callback) {
 wx.request({
   url: 'https://example.com/server/getAuthorization',
   method: 'POST',
   data: {},
   success: data => {
      callback({
       timestamp: data.result.timestamp,
       authorization: data.result.authorization
     })
   }
 });
}
});

Option 2: The authorization certificate is obtained through the applet cloud function, and the applet plug-in gets the authorization certificate to initiate a request. The applet cloud has its own permission check, and no additional permission check is required:

let plugin = requirePlugin("myPlugin");
let manager = plugin.getSoeRecorderManager({
getAuthorization: function (callback) {
 wx.cloud.callFunction({
   name: 'getAuthorization',
   data: {},
   success: data => {
     callback({
       timestamp: data.result.timestamp,
       authorization: data.result.authorization
     })
   }
 })
}
});

Option 3: The applet uses a fixed key to calculate the authorization certificate. This format is suitable for front-end debugging. If you use this format, please avoid revealing the key.

let plugin = requirePlugin("myPlugin");
let manager = plugin.getSoeRecorderManager({
 secretId: yourSecretId,
 secretKey: yourSecretKey
});

Record, stop and get evaluation result:

// start record
manager.start({
   content: 'about'
})

// stop record
manager.stop()

// Or use local voice data(Base64)
/**  
* 支持将音频数据作为参数进行测评，仅支持base64格式  
* @param {  
*   content: 'about', // 测评文本  
*   audioBase64: '//uQBAAAA', // 测评音频base64格式  
*   ...options // option中其他非必传参数  
* }  
*/  
manager.uploadLocalFile({    
  content: 'about',     
  audioBase64: '//uQBAAAA'  
});

Get evaluation result callback:

manager.onSuccess((res) => {
 //打印识别结果
 console.log(res)
});

Other callback methods:

// start callback
manager.onStart((res) => {
 console.log("成功开始录音识别", res)
});

// stop callback
manager.onStop((res) => {
 console.log("录音已停止", res)
});

// error callback
manager.onError((res) => {
 // print log
 console.log(res)
})