In just two weeks, the online capture of dolls has changed from a silently profitable industry to a slogan industry, from hardware to software architecture, from profit to investment, from operation to promotion. H5 grabbing dolls (specifically mobile web, WeChat catching dolls) is still very mysterious.
Is H5 catching a doll really so mysterious? This article is an all-round disclosure for you.
1. What is the H5 catching doll that most people say?H5 grabs the doll, which refers to the web-side grabbing doll that supports HTML5. Can be divided into two categories: PC and mobile.
The H5 capture doll on the PC side can directly use the Agora Web SDK as long as it supports the WebRTC browser. Of course, you can also use WebRTC self-research to solve a number of server-side transmission, device adaptation, echo, availability and other issues, you can use it. The H5 grabbing doll on the PC side has a very mature solution.
The H5 catching doll on the mobile side is more complicated. The H5 grabbing dolls on the mobile side refer to two types: mobile web browsers and WeChat webpages. The demand for most of the doll manufacturers is to grab the doll on the WeChat promotion page, not a mobile browser other than WeChat.
Well, the problem is very clear. Most people say that the H5 catching doll refers to the WeChat built-in browser to catch the doll. For the convenience of description below, it is referred to as WeChat H5.
2. What is the difference between WeChat H5 and the Naive App?The current mature PC-side Web capture doll is implemented through WebRTC. Most browsers have good support for WebRTC. However, WeChat's built-in browser does not support WebRTC.
The above picture is the approximate processing flow of online real-time video streaming of dolls. In the business scene of catching a doll, the acquisition is realized by a motherboard or a PC placed on the doll machine, and the rendering/playing is the operation end of the doll machine. The only difference between WeChat H5 and Do App is that it is the operating end of the doll machine. The former is WeChat built-in browser, the latter is Native App.
3. How to implement the WeChat H5 catching doll?Next, we use the WeChat Ag5 H5 program of the sound network to uncover the mystery of WeChat H5.
As mentioned before, WeChat H5 has to solve the last link - the video is played on the console. The strategy adopted by the sound network is to use JSMpeg to play on the WeChat browser.
Sound network Agora online capture doll technical architecture
JSMpeg is a video player implemented in JavaScript that includes an MPEG splitter, MPEG1 video and MP2 audio decoder, WebGL and Canvas2D rendering and WebAudio sound output.
JSMpeg is relatively small and works well on most browsers, and can decode 720P video at 30fps on the iPhone 5S.
Since JSMpeg only supports MPEG1 format, a transcoding server is added in the decoding process to convert the video format to MPEG1. The video is distributed to the WeChat browser through the relay server and played through JSMpeg.
In other links, the WeChat H5 solution is identical to the non-WeChat H5 solution.
At the doll machine end, two cameras are connected through a motherboard or a PC to collect video data.
Video stream optimization through Agora's patented encoder encoder.
Real-time video transmission via Agora's global real-time virtual communication network SD-RTNTM
Finally arrive at the console, decode, play
The operation terminal sends the manipulation command to the doll machine through the service server, and obtains real-time feedback through the video stream.
A high-latency rtmp stream can be played from the SD-RTNTM to the viewer.
Through the technical architecture diagram, we can see that WeChat H5 grabbed the doll, and finally realized through mature open source projects, which is also the implementation of most mainstream WeChat H5 grabbing dolls. So, what is the difference between the WeChat H5 and the doll experience?
4. Deciding on the difference between WeChat H5 and the doll experience?The most critical experience of catching a doll has the following three aspects:
Delay
Availability
Stable service
Delay
The delay has a command delay from the operation end to the doll machine, and a video delay from the doll machine to the operation end.
Command delay: Due to the instruction from the operator to the doll machine, the data packet is extremely small, so the delay is very low, usually tens of milliseconds.
Video delay: If the video delay is within 400ms, the player can accept it.
The key to deciding to capture the doll's delayed experience is the video delay.
Video clarity and latency are two opposites. In the case of constant bandwidth, the clearer the video, the higher the frame rate and bit rate, and the higher the delay. Therefore, a balance between video clarity and latency is required.
The sound network uses a proprietary patented codec to reduce the bit rate as much as possible while ensuring clarity. Weak network defense strategies such as packet retransmission, FEC, bandwidth detection, and dynamic bit rate adjustment ensure that users can get a smooth experience when network quality is poor.
The sound network deploys nearly 100 nodes around the world to form an SD-RTNTM communication network. The SD-RTNTM system can automatically allocate the optimal and most smooth transmission path according to the connection and transmission status of each node, the load status, and the distance and response time to the user, achieving the quality assurance level required for real-time transmission.
2. Availability
According to Callstats.io data, 89% of WebRTC-based real-time communication can be successfully established in the United States. The SD-RTNTM of the sound network has increased the login success rate to 99% through dense placement in each region.
3. Service stability
With an average 400ms delay and a stable 400ms delay, the user experience is different. A stable 400ms delay (there will be expectations in the user's mind), compared to 200 for a while, 800 will have a better experience.
The key issue after catching a doll on the line is to keep it. In addition to the business model, it is the quality of experience that is determined by the user. To abandon the user experience and seek for it, it is the end of the cart. Returning to quality and user experience is the long-term development path.
The overall solution for the sound network online catching dolls has been caught by wow, wow, dolls, happy catching dolls, music catching, seconds catching, catching a lot, screaming cool catching dolls, loving catching, catching dolls, catching chickens, catching, etc. Almost all mainstream manufacturers adopt it.
Top Plug,Top Plug In,Standard Power Conversion Plug,Power Conversion Plug
WENZHOU TENGCAI ELECTRIC CO.,LTD , https://www.tengcaielectric.com