Develop and evaluate machine-learning algorithms, use behavioral and customer data to propose value, build prototype applications, collaborate with business teams, and publish research.
Researcher, Natural Language Processing (NLP) for Multimodal Machine Learning
About this role
This research role sits in an R&D organization focused on large-scale generative AI for entertainment content creation and production across music, film, and games. The work connects fundamental research with Sony business groups, universities, product teams, and studio workflows.
The researcher will investigate multimodal learning, multimodal LLMs, music and video understanding, agents, reasoning, controllable generation, discrete-data generative models, image and audio captioning, text-to-image and text-to-audio systems, vision-language pre-training, and commonsense knowledge graphs. Responsibilities include developing large-scale data, submitting papers to conferences such as ACL, EMNLP, NeurIPS, ICLR, and CVPR, collaborating on research, and deploying technologies in products and AI-assisted content-creation tools. Applicants need a master's degree or equivalent practical experience, at least three years using Python, C/C++, and Linux/Unix, at least two years in machine learning and NLP with PyTorch or TensorFlow, and evidence of research ability through papers, open-source software, or other scientific work.
This is an AI-generated summary of the employer's original posting — details can be incomplete, out of date or simply wrong. Always confirm everything on the official posting before applying.
Similar jobs
Investigates speech and audio AI/ML methods, developing algorithms and analyzing data for speech-based large language modeling, diarization, and speech synthesis.
Investigates machine-learning methods for generating and editing video, sound, and 3D geometry, while studying memorization, concept erasure, and data attribution in generative AI.
Leads security operations, architecture, and implementation across Keyence’s global IT infrastructure, covering monitoring, incident response, threat analysis, cloud security, and security tools.
Oversee the overall security of Money Forward Kessai, collaborating with developers and information system staff to maintain and enhance security.
Work directly with business stakeholders to translate between data and business needs, analyze results, and communicate findings to senior leadership in the Tokyo-based Japan Central Ops role.