Integrating Sony FCB-EV9500L/FCB-EV9520L with NVIDIA ORIN NX

LVDS to MIPI Custom Hardware and V4L2 Driver Development

Introduction

High-performance edge AI systems demand real-time, high-resolution imaging. However, integrating advanced camera modules with compute platforms often faces interface compatibility challenges.

At OPPILA, we successfully integrated the SONY FCB-EV9500L Full HD camera (60 FPS) with NVIDIA's ORIN NX, overcoming the differences between LVDS output and CSI-2 MIPI input. This project involved custom hardware design, V4L2 driver development, rigorous performance evaluation, and future expansion planning for scalable multi-camera integration. This setup also works for Sony Camera Block FCB-EV9520L.

Problem Statement

• The Sony Camera Blocks such as FCB-EV9500L & FCB-EV9520L outputs video in Digital Y/Pb/Pr 4:2:2 format over LVDS, while the NVIDIA ORIN NX natively supports CSI-2 (MIPI) input for video streams.
• Bridging these two different video standards without degrading performance — especially frame rate and latency — posed a significant technical challenge.

Hardware Innovation: Custom LVDS to MIPI Adapter Board

To bridge the gap, we designed and developed a custom adapter board that converts LVDS signals to MIPI CSI-2 format, enabling seamless connectivity between the Sony camera Blocks which has video outputs in Digital Y/Pb/Pr 4:2:2 format over LVDS and NVIDIA ORIN NX Development Board, over 30 Pin Co-axial cable.

Block Diagram

Connection Diagram

Key Features of the Adapter Board:

• Converts LVDS video outputs in Digital Y/Pb/Pr 4:2:2 format to 4-lane MIPI CSI-2
• Supports Full HD (1920x1080) at 60 FPS
• End to end Latency < 50ms
• Compact and ruggedized for embedded applications
• Electrical isolation and signal integrity optimization

Our custom hardware solution ensures high-quality video streaming, making it ideal for AI-based vision applications.

Software Development: V4L2 Camera Driver for ORIN NX

In addition to the hardware solution, we developed a custom V4L2 (Video4Linux2) camera driver to interface the Sony Camera Block FCB-EV9500L with the ORIN NX platform.

Driver Development Highlights:

• Proper sensor initialization and video stream negotiation
• Handling of buffer management for high frame rate (60 FPS)
• Integration with NVIDIA’s media pipeline
• Fine-tuned for minimal latency and maximum throughput

The result is a fully integrated system where the Sony camera streams directly into the ORIN NX's AI processing pipelines with excellent stability.

Rigorous Testing and Performance Evaluation

Performance validation is critical for any real-world AI deployment.

We conducted extensive testing to evaluate latency, frame stability, and reliability under multiple operating conditions.

https://youtu.be/b57pXNZQZ3U

Test Results:

These results showcase that the integration meets the stringent requirements for real-time AI inferencing and analytics.

Future Development: Compact Carrier Board for Dual Camera Input

Building on the success of this project, we are currently designing a compact single carrier board that will interface two camera blocks simultaneously with the ORIN NX:

First Camera:

• Based on LVDS input (Sony FCB-EV9500L or FCB-EV9520L)

Second Camera:

• Based on HDMI input (Sony FCB-ER8530 4K, 30 FPS)

The carrier board will handle:

• LVDS to MIPI conversion for the first camera
• HDMI to MIPI conversion for the second camera

Utilizing the two 4-lane MIPI CSI interfaces on the ORIN NX, this board will enable parallel operation of both cameras — ideal for AI applications like multi-camera perception, 3D vision, or stereo imaging.

Additional Adapter Boards Developed by OPPILA

To offer complete flexibility across camera models and interfaces, we have developed additional adapter solutions:

Each adapter is supported by a dedicated V4L2 camera driver developed by OPPILA, ensuring seamless integration with ORIN NX hosts.

Conclusion

By combining innovative hardware engineering with precise software development, OPPILA successfully achieved real-time integration of Sony's FCB-EV9500L & FCB-EV9520L Camera Blocks with Nvidia Jetson Orin Nx. Our complete solution - from LVDS-to-MIPI adapter board to V4L2 camera driver - provides a high-performance imaging platform ready for advanced AI applications. With ongoing development of compact carrier boards and multi-camera support, we continue to push the boundaries of vision integration for edge AI Applications.