The project, a platform for creating and publishing content on social media using artificial intelligence tools, is looking for a Lead Data Engineer.

Responsibilities:

- Design, develop, and maintain robust and scalable data pipelines for collecting.

processing, and storing data from diverse social media sources and user interactions.

- Design of data warehouse.

- Implement rigorous data quality checks and validation processes to uphold the integrity.

accuracy, and reliability of social media data used by our AI models.

- Automate Extract, Transform, Load (ETL) processes to streamline data ingestion and transformation, reducing manual intervention and enhancing efficiency.

- Continuously monitor and optimize data pipelines to improve speed, reliability, and scalability, ensuring seamless operation of our AI Assistant.

- Collaborate closely with Data Scientists, ML Engineers, and cross-functional teams to understand data requirements and provide the necessary data infrastructure for model development and training.

- Enforce data governance practices, guaranteeing data privacy, security, and compliance with relevant regulations, including GDPR, in the context of social media data.

- Establish performance benchmarks and implement monitoring solutions to identify and address bottlenecks or anomalies in the data pipeline.

- Collaborate with data analysts and business teams to design interactive dashboards that enable data-driven decision-making.

- Develop and support data marts and dashboards that provide real-time insights into social media data.

- Stay updated with emerging data technologies, tools, and frameworks, evaluating their potential to improve data engineering processes.

Qualifications:

- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.

- Proven experience in data engineering, focusing on ETL processes, data pipeline development, and data quality assurance.

- Strong proficiency in programming languages such as Python, SQL and knowledge of data engineering libraries and frameworks.

- Experience with cloud-based data storage and processing solutions, such as AWS, Azure, or Google Cloud.

- Familiarity with DataOps principles and Agile methodologies.

- Excellent problem-solving skills and the ability to work collaboratively in a cross-functional team.

- Strong communication skills to convey technical concepts to non-technical stakeholders.

- Knowledge of data governance and data privacy regulations is a plus.

Project: IT service provider for the life science and healthcare industry.

Responsibilities:

• Design/build/deploy complex, forward-looking Infrastructure as code to support the enterprise cloud platform
• Work closely with architects and operations to design and implement a scalable cloud architecture
• Work closely with different business units and application developers to help them provision their infrastructure in the cloud
• Collaborate with infrastructure, network, and security teams to provision environments, configure services, and perform capacity planning
• Develop and maintain application documentation according to the quality systems and software development life cycle standards and procedures.

What we expect:

• Linux/Unix-based platforms (RedHat, CentOS, etc.)
• Proven experience with and understanding of lambda functions
• Strong Boto3 proficiency
• Knowledge of Chef/Ansible etc
• Experience with at least one of the CI/CD tools (Jenkins, GitLab, etc.)
• Experience with Docker
• Experience with AWS (experience with Azure, Google Cloud Platform will be a plus)
• Python as a scripting language
• Upper-Intermediate English or higher

Nice to have:

• Knowledge of and experience in working with Kubernetes
• Knowledge of and experience in SRE
• Skill in working with cloud automation and provisioning IaC tools (Terraform, CloudFormation, etc.).

The project: a cloud-based quant platform.

Requirements:

• a degree in math and prior experience developing real-time trading apps.
• competency in multiple platforms (AWS, GCP, Azure).