As a Senior Data Engineer, you will design and build scalable data pipelines and data infrastructure that power Smart SMS features, including SMS categorization, fraud detection, spam intelligence, and AI-driven cap[a]bilities. You will work closely with Data Scientists, Data Analysts, and Product teams to develop robust data platforms, enable feature engineering for ML models, and deliver reliable datasets that drive product insights and decision-making for over a million daily users. What you"ll do: Maintain and improve the ingestion pipeline to reliably deliver billions of events daily within defined SLAs Provide support for all teams in building and optimizing their complex pipelines Work closely with other teams to identify pain points and problems around the platform Develop new tools and frameworks to improve the data platform Facilitate a company-wide, data-driven culture Work in close collaboration with data scientists and data analysts to help support their work going into production Work on large-scale projects such as building an ML platform and streaming use cases Set up best practices and processes around software and data development What you bring in: Experience working with an orchestration tool (e.g., Airflow) Experience working with large data sets Experience building complex ETL pipelines Experience working with cloud providers such as GCP Strong programm[i]ng skills in Spark with Scala and Python Experience working with CI/CD tools like Jenkins and Git Strong understanding of software engineering practices and principles Excellent problem-solving and communication skills Self-motivated with a proven ability to take initiative to own and solve problems as they come up It would be great if you also have: Experience working with messaging systems like Kafka Knowledge of Kubernetes Hands-on experience with any streaming platform Experience managing a data warehouse in BigQuery or Redshift CV måste vara på engelska

Log in to apply for this assignment
Username
Password