Senior Data Engineer - Dynamic Pricing Infrastructure | Remote GCP Expert

We are seeking an accomplished Senior Data Engineer to spearhead the architecture, development, and operation of sophisticated data infrastructure powering our dynamic pricing systems. In this pivotal role, you will construct scalable data pipelines using Cloud Composer (Airflow), maintain robust BigQuery data warehousing solutions, and transform complex pricing data into actionable business intelligence. This position offers an exceptional opportunity to shape cutting-edge data architecture for a high-impact business function. Key Responsibilities - Design and implement comprehensive data analysis frameworks for both internal stakeholders and external communications, ensuring data integrity and accessibility throughout the organization. - Architect and maintain advanced data pipelines utilizing Cloud Composer (Airflow 2.7+) for orchestrating complex ETL workflows with emphasis on reliability and scalability. - Develop and optimize BigQuery data warehousing infrastructure with focus on performance tuning, cost-efficiency, and enterprise-grade data modeling techniques. - Engineer competitive data acquisition systems using Scrapy 2.11+ and related web scraping technologies to fuel dynamic pricing algorithms. - Implement robust data quality monitoring protocols and establish governance practices across the data ecosystem. - Collaborate with machine learning specialists to operationalize ML models in production environments, including feature engineering pipelines and model monitoring. - Document technical specifications, data lineage, and infrastructure components to ensure knowledge continuity and operational excellence. - Participate in strategic planning for data architecture evolution and capacity forecasting. Required Skills & Qualifications - Master's degree in Computer Science, Data Science, Engineering, or equivalent practical experience in data engineering roles. - Minimum 3 years of experience in object-oriented programming, with demonstrable proficiency in Python 3.10+ and advanced SQL. - Proven track record (3+ years) designing and operating data pipelines in production environments, preferably with Google Cloud Platform. - Expert knowledge in developing and maintaining data warehouses or data marts using BigQuery, including optimization techniques and best practices. - Experience supporting machine learning operations in production, including model deployment pipelines and performance monitoring. - Demonstrated success working in fast-paced startup environments with ability to manage competing priorities and deliver under pressure. - Strong analytical thinking with exceptional problem-solving capabilities and meticulous attention to detail. - Proficiency in version control systems (Git) and CI/CD methodologies for data infrastructure deployments. - Advanced knowledge of dimensional modeling, data vault architecture, and modern data governance frameworks. - Excellent written and verbal communication skills in English for cross-functional collaboration. Nice to Have - Experience implementing real-time data processing using technologies such as Kafka, Pub/Sub, or similar event-streaming platforms. - Familiarity with containerization and orchestration using Docker and Kubernetes for data workloads. - Knowledge of infrastructure-as-code principles using Terraform or equivalent tools for GCP resource provisioning. - Background in pricing analytics, revenue optimization systems, or algorithmic pricing models. - Experience with dbt (data build tool) for analytics engineering and transformation workflows. - Proficiency in Japanese language for expanded collaboration opportunities. - Expertise with data visualization platforms such as Looker, Tableau, or Power BI for stakeholder reporting. - Certification in Google Cloud Platform data engineering specializations. Why Join Our Team As a Senior Data Engineer on our team, you'll play an instrumental role in building the technological foundation of our dynamic pricing capability. You'll work with cutting-edge cloud technologies in a remote-first environment that values technical excellence, innovation, and work-life balance. We offer competitive compensation, professional development opportunities, and the chance to solve complex data challenges that directly impact business growth. Join us in creating data infrastructure that transforms how our industry approaches pricing strategy and competitive positioning.