Mediapipe Vision Task Files Not Loading from Local Server on iOS Devices with Version <16

[nandanpytech]

Have I written custom code (as opposed to using a stock example script provided in MediaPipe)

None

OS Platform and Distribution

iOS with version < 16

MediaPipe Tasks SDK version

0.10.18

Task name (e.g. Image classification, Gesture recognition etc.)

Face LandMark Detection

Programming Language and version (e.g. C++, Python, Java)

JavaScript

Describe the actual behavior

When serving Mediapipe Vision task files (e.g., .wasm, .task) from a local server, the application fails to work on specific iOS devices (e.g., iPhone 12, iPhone 13) running iOS versions less than 16. However, when these files are served from a CDN, the application works perfectly fine under the same conditions. This discrepancy suggests that the issue might be related to how local servers handle requests on older iOS versions.

Describe the expected behaviour

It should work fine when we server from local.

Standalone code/steps you may have used to try to get what you need

const wasmFileSet = { wasmLoaderPath: 'assets/detection-models/vision_wasm_internal.js', wasmBinaryPath: 'assets/detection-models/vision_wasm_internal.wasm', };
async initializeFaceLandMarker() {
try {
this.faceLandmarker = await FaceLandmarker.createFromOptions(wasmFileSet, {
baseOptions: {
modelAssetPath: TaskFile.face,
delegate: processingUnit,
},
numFaces: 1,
minTrackingConfidence: 0.8,
minFaceDetectionConfidence: 0.8,
runningMode: 'VIDEO',
outputFacialTransformationMatrixes: true,
});
return this.faceLandmarker;
} catch (error) {
console.log('error: ', error);
}
}

Other info / Complete Logs

No response

[kuaashish]

Hi @nandanpytech,

It seems that the issue is related to the Wasm file not functioning in offline mode. This appears to be a similar issue #5729 that has been reported previously. Could you confirm if the version is greater than 16 and if you are experiencing the same behavior?

Thank you!!

[nandanpytech]

It works fine with a locally downloaded .wasm file if the version is greater than 16.

[schmidt-sebastian]

How are you serving the files to the SDK? Are you hosting them on a local server?

[kuaashish]

Hi @nandanpytech,.

Could you please review the information provided above and let us know any further details?

Thank you!!

[github-actions]

This issue has been marked stale because it has no recent activity since 7 days. It will be closed if no further activity occurs. Thank you.

[NandanBilagi]

I am loading files using the code below. Instead of CDN files, I downloaded vision_wasm_internal.wasm and vision_wasm_internal.js and am serving them from my server. This works fine with iOS versions 16 and above, but not with versions below 16.

// File paths for WASM files

const wasmFileSet = {
  wasmLoaderPath: 'assets/detection-models/vision_wasm_internal.js',
  wasmBinaryPath: 'assets/detection-models/vision_wasm_internal.wasm',
};

const TaskFile = {
  face: 'assets/detection-models/face_landmarker.task',
  hand: 'assets/detection-models/hand_landmarker.task',
};

 /**
   * Initializes the Hand Landmarker with given mode
   * @returns {Promise<Object>} - HandLandmarker instance
   */
  async initializeHandLandMarker() {
    try {
      this.handLandmarker = await HandLandmarker.createFromOptions(wasmFileSet, {
        baseOptions: {
          modelAssetPath: TaskFile.hand,
          delegate: processingUnit,
        },
        numHands: 1,
        runningMode: 'VIDEO',
        minHandDetectionConfidence: 0.5,
        minTrackingConfidence: 0.5,
      });

      return this.handLandmarker;
    } catch (error) {
      console.log('error: ', error);
    }
  }