Lead software development from requirements through release and maintenance, improve architecture and development processes, and support team growth across GO's mobility products. The role may involve hands-on implementation, people management, and generative AI adoption.
About this role
This data engineer role supports the data platform and execution infrastructure for AI and algorithmic products used by the GO taxi application. The platform collects vehicle data at a scale of up to one billion records per day, application database and log data, and external data such as map information.
Responsibilities include collecting large-scale vehicle and application data in BigQuery using services such as Dataflow, developing and operating batch data-processing jobs, hosting analysis tools including Streamlit and Looker, and managing access and security controls for approximately 100 users. The role also designs, develops, and operates the execution platform for AI and advanced algorithms, supports data scientists, and develops batch learning and production inference-serving systems. High performance and high availability must be addressed through system design, implementation, and operations. The position participates in a 24/365 on-call system in which the assigned person is contacted in rotation when a system incident occurs; there is no standby requirement.
Required experience includes at least three years of commercial production-system operations and incident response, RDBMS-based development, development with Go or Python, batch development using a job controller such as Airflow, development on Google Cloud or AWS, development with Linux or Docker, and pull-request-based development using Git. At least one year of experience is required in developing resident processes such as web applications or APIs, addressing performance issues by identifying CPU, memory, I/O, or network bottlenecks, conducting code reviews, leading three or more people, and independently identifying and resolving system issues. Native-level or business-level Japanese is required.
The data-platform environment includes BigQuery, Dataflow, Python, Dataform, Cloud Composer with Airflow, GKE, Dataplex, Streamlit, Kepler.gl, and Kubeflow. The data-product execution environment includes Redis, AWS Aurora with MySQL and PostgreSQL, Go, Python, Grafana, Sentry, and Feast. The development environment also names GitHub Copilot, Claude Code, Gemini, MCPs, VS Code, GitHub Actions, GitHub, Google Workspace, and Slack. Preferred experience includes BigQuery or Snowflake, machine-learning training or inference batches, Google Cloud administration or SRE work, Google Cloud certifications, the Applied Information Technology Engineer Examination, and a computer science degree.
The position belongs to the AI Technology Development Division's Data Platform Group, consisting of four members, and works with data scientists, data analysts, and data architects. Employment is permanent and full-time. The salary is determined according to skills and experience and includes a fixed overtime allowance for 45 hours per month unless hired as a manager. The position is based in Minato, Tokyo, and permits full remote work within Japan, with no specified number of office days, although attendance may be required for designated events. A super-flextime system without core hours applies. Benefits include social insurance, transportation reimbursement up to 50,000 yen per month, a monthly 10,000-yen new-normal allowance, commuting-related taxi assistance, paid leave and other listed leave programs, welcome lunches, clubs, and casual dress.
This is an AI-generated summary of the employer's original posting — details can be incomplete, out of date or simply wrong. Always confirm everything on the official posting before applying.
Similar jobs
Manage user-facing B2C mobility products from planning and design through launch, measurement, and improvement, while prioritizing features, setting roadmaps, and aligning stakeholders.
Own product planning, design, release, measurement, and improvement for mobility products, defining priorities, aligning stakeholders, and leading development from user problems to business outcomes.
Develop and manage autonomous construction systems, focusing on technology selection and project management.
Develops autonomous-driving and ADAS technology through vehicle-motion-control design, driver-behavior analysis, traffic-participant modeling, and machine-learning-based control algorithms.
Provide pre-sales technical consulting for Apple’s Business and Education customers, advising clients and reseller partners on technical architectures across macOS, iOS, iPadOS, and Windows.