Specifications
- Apply from: Overseas OK
- Salary: 6M-20M
- Location: Not Specified
- Conditions: Fulltime
Requirements
- Japanese:
- English: Business
- Minimum Experience: Not Specified
- Status:
OPEN
Job Description
Responsibilities
-
Data Pipeline Development
- Design and implement large-scale data collection, processing, curation, and publishing pipelines for robotics datasets.
- Build data schemas, storage solutions, and query interfaces for efficient dataset access.
- Collaborate with researchers to refine data requirements and improve pipelines.
- Scale distributed data-processing pipelines for petabyte-scale multimodal datasets (RGB/Depth, point clouds).
- Establish data-quality metrics and feedback loops for continuous improvement.
Requirements
-
Qualifications
- Master’s in Computer Science, Engineering, or related field, with 5+ years in data engineering.
- Experience with distributed data systems, ETL pipelines (Spark, Flink, Ray), and orchestration tools (Airflow, Kedro).
- Knowledge of storage architectures like Delta Lake, Iceberg, or Hudi, and data governance tools.
- Proficiency in data modeling, quality, and lineage management.
- Ability to align platform design with business KPIs and optimize performance.
Apply Now
