Research Scientist, Editing; Multimodality

Position: Research Scientist, Intelligent Editing (Multimodality)
About the team The Intelligent Creation Team is the AI, special effects, and audio-video creation technology team, responsible for the core technology and business development. It covers a variety of technical fields, including deep learning, computer vision, graphics, speech, recording and editing, special effects, client and server engineering, and provides cutting-edge content understanding, content creation, interactive experience, and consumption capabilities and industry solutions to other business lines within the company and external partners in various forms.

Responsibilities
1. Conduct cutting-edge research and development in computer vision and machine learning, especially in the areas of multi-modal understanding, vision and language, large-scale training, etc. 2. Transfer advanced technologies to Byte Dance products;
3. Explore new products with artificial intelligence technology at its core.

Minimum Qualifications - At least 1 year of research and practical experience in one or more areas of computer vision, including but not limited to:

- Experience in multimodal understanding, such as video highlight detection and slicing, audio/music understanding, etc.

- Experience in vision and language, such as image/video captioning, retrieval, VQA, and other related fields.

- Experience with language models and apply them in various downstream tasks, especially for intelligent editing.

- Experience in large-scale training and RLHF.

Preferred Qualifications - Preferring candidates with publications in venues such as CVPR, ECCV, ICCV, NeurIPS, ICLR, ICML or ACL, EMNLP, COLING, etc - Highly competent in algorithms and programming;
Strong coding skills in C/C++ and Python.

- Work and collaborate well with team members.

- Ability to work independently.