a hidden state is worth a thousand words.

I am Bokai Xu (胥博凯), I received bachelor degree at CUHK Shenzhen. After that I work as an llm researcher at Modelbest Inc., where I do works in omni interaction models.

My long-term passion is understanding nature of human conciousness.

Feel free to get in touch via Email / WeChat.

News

• Feb 4, 2026: Our omni foundation model, MiniCPM-o-4.5 released, the world’s first omnimodal full-duplex model, where I co-design omnimodal full-duplex architecture, co-lead large-scale omnimodal pretrain, and lead speech interaction post train.

• Jan 19, 2025: Our omni foundation model, MiniCPM-o-2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone released, where I contributed to end-to-end speech capability.

• Oct 14, 2024: Our paper, pure VLM-based RAG VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documents released, where I co-designed the architecture and implemented training and evaluation framework of VLM-based dense retrieval models.

• Sep 4, 2024: Our work, text dense retrieval model MiniCPM-Embedding released, contributed to contrastive learning train & eval framework.

• Aug 5, 2024: Our model MiniCPM-V-2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone released, where I contributed to enhanced OCR capability and multi-image understanding capability.

• July 1, 2024: Act as a multimodality LLM engineer at Modelbest Inc, I work with Prof. Yuan Yao, Mr. Junbo Cui, Mr. Weiyue Sun, and Ms. Yingjing Xu.

• Jan 9, 2024: Converted to Modelbest Inc. machine learning intern, my mentors are Dr. Huadong Wang and Mr. Shi Yu.

• May 23, 2023: Our paper UltraChat: Enhancing Chat Language Models by Scaling High-quality Instructional Conversations released.

• Apr 17 2023: Our paper Tool Learning with Foundation Models released.

• Apr 3, 2023: Joined ICBI@SIAT as a part-time research assistant. I work closely with Dr. Chaoyu Yang and Prof. Pengcheng Zhou on brain reconstruction.

• June 1, 2022: Joined THUNLP@THU as a part-time research assistant, my mentor is Dr. Huadong Wang.