Table of Contents

Developer guide for image cloud recognition in WeChat Mini Programs

This chapter mainly introduces the common functions and implementation methods of combining EasyAR cloud recognition with WeChat Mini Programs.

Features and usage

WeChat Mini Program XR-FRAME is an official XR/3D application development solution launched by WeChat. It uses hybrid rendering technology to achieve near-native performance, combining visual effects with development convenience for quickly building AR applications. The framework supports core functions such as image tracking, 3D model loading, animation control, video playback, and particle effects. The development mode is primarily based on WXML template programming, requiring only a small amount of logic code to achieve high-quality visual effects.

EasyAR Cloud Recognition Service (CRS) focuses on image-based search scenarios with massive image libraries. It achieves efficient target recognition through cloud algorithms, featuring high cost-effectiveness and low access barriers. Developers can quickly integrate and complete feature development.

Data flow

flowchart TB

B[API or EasyAR Web] --> A[Cloud recognition CRS] <-->  D[Device end WeChat Mini Program]

C[Virtual content] <-->  D[Device end WeChat Mini Program]

After combining XR-FRAME with cloud recognition, local devices are no longer limited by the number of target images, solving the need for ultra-large-scale applications.

Implementation process

  1. Cloud recognition service invocation‌

    • Initiate image recognition requests through EasyAR Cloud Recognition (CRS) API
    • Process recognition results (success/failure, process meta, etc.)

  2. Tracking image configuration‌

    • Dynamically configure xr-ar-tracker based on trackingImage in recognition results

  3. Virtual resource loading‌

    • Parse resource identifiers in meta data
    • Download 3D models or videos using xr-asset
    • Add virtual assets to the scene and configure resource properties (such as scaling, initial position, etc.)

  4. AR content presentation‌

    • Spatially bind virtual assets with recognition markers
    • Achieve real-virtual fusion rendering effects
    • Handle user interaction events (such as clicks, drags, etc.)

Common features

After obtaining cloud recognition results, commonly used AR features in WeChat Mini Programs include:

  • Recognition only and display recognition results
  • Recognition only and display videos, animations, models, scripts associated with recognition targets
  • Recognition + tracking overlay videos, animations, models, scripts