Context

JIT Emitters are part of code generation feature (a.k.a. tensor compiler) that automatically produces highly-efficient optimized fused subgraph binary code. Each emitter implements specific operation from low level OpenVINO dialect.

Currently, Negative op is supported in CPU Plugin as Math op on x64 and ARM platforms. The Math ops use not efficient C++ implementations. The idea is to move Negative op from Math to Eltwise ops which use JIT emitters for the better performance. We already have x64 JIT emitter, so need to implement the same emitter for ARM

Prerequisites

Recommended to use ARM CPU based platform for development (e.g. Mac, Raspberry Pi etc). Emulators (e.g. QEMU) is still an option, but not that convenient, especially for final performance evaluation.

What needs to be done?

• Create fp32 Negative operation JIT emitter for ARM64 SIMD platform. Use OpenVINO CPU plugin JIT emitters documentation and Arm A-profile A64 Instruction Set Architecture documentation for details.
• Modify ARM64 executor and ARM64 kernel (in both places: create_eltwise_emitter and get_supported_precisions) to apply developed JIT emitter.
• Add algorithm type EltwiseNegative for Negative op. Also, replace the type Math with Eltwise in TypeToNameMap.
• Register Negative op in Eltwise node to execute this node on x64 platforms using already implemented JIT emitter.

Before emitter implementation, please, modify tests to be sure that developed functionality is covered by test:

• Add jit kernel check in activation test, the test must fail.
• If test doesn't fail then add supported operation in CPU activation test instantiation if it's absent.

Tests

Tests are disabled in default build, so ensure to add -DENABLE_TESTS=ON into cmake command.

GoogleTest is used for testing. CPU functional test target is ov_cpu_func_tests. You can use GoogleTest filter:

./bin/[platform]/[build_type]/ov_cpu_func_tests --gtest_filter="*smoke*Activation*Negative*"

Example Pull Requests

• The Floor op implementation: [CPU] [ARM] JIT Floor #24041
• Sigmoid operation, which reuses Exp emitter: [CPU] [ARM64] jit sigmoid #23065

Resources

• Contribution guide - start here!
• What is OpenVINO?
• CPU plugin JIT emitters
• Blog post on contributing to OpenVINO
• User documentation
• Intel DevHub Discord channel - engage in discussions, ask questions and talk to OpenVINO developers
• How to link your Pull Request to an issue

Contact points

@a-sidorova, @dmitry-gorokhov